2024-04-25T01:58:03.318 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T01:58:03.319 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/blogbench}} --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371 -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/orig.config.yaml 2024-04-25T01:58:03.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T01:58:03.449 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371 branch: squid description: fs/upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672371' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.dir_split install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbpCV1bgL7ue9D583Nfcg23/xDW5nEmlm3PWRffZ9YkyTXr+rI/BCPoJgvh1+jeg8CAPoV0B/zPgCDYsPHhx/s= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF3jPYSXHtG3jFz7pYyhb4zwF8aH3kncdjLXJxfDrIi/0D/tPz0XG7R4vJdaCQr1WiOKRQCpcgAN+L+ZEQzZhoU= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: branch: reef - print: '**** done install.upgrade on client.0' - ceph.healthy: null - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - suites/blogbench.sh teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T01:58:03.449 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-25T01:58:03.450 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-25T01:58:03.450 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T01:58:03.452 INFO:teuthology.task.internal:Checking packages... 2024-04-25T01:58:03.476 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T01:58:03.476 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:58:03.477 INFO:teuthology.packaging:ref: None 2024-04-25T01:58:03.477 INFO:teuthology.packaging:tag: None 2024-04-25T01:58:03.477 INFO:teuthology.packaging:branch: squid 2024-04-25T01:58:03.477 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:58:03.477 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=squid 2024-04-25T01:58:03.672 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-25T01:58:03.673 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T01:58:03.680 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T01:58:03.680 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T01:58:03.699 INFO:teuthology.task.internal:Saving configuration 2024-04-25T01:58:03.716 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T01:58:03.722 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T01:58:03.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:53:03.611303', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbpCV1bgL7ue9D583Nfcg23/xDW5nEmlm3PWRffZ9YkyTXr+rI/BCPoJgvh1+jeg8CAPoV0B/zPgCDYsPHhx/s='} 2024-04-25T01:58:03.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:53:03.612736', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF3jPYSXHtG3jFz7pYyhb4zwF8aH3kncdjLXJxfDrIi/0D/tPz0XG7R4vJdaCQr1WiOKRQCpcgAN+L+ZEQzZhoU='} 2024-04-25T01:58:03.769 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T01:58:03.775 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-25T01:58:03.776 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['client.0'] 2024-04-25T01:58:03.776 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T01:58:03.845 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f163a2ec3a0>, signals=[15]) 2024-04-25T01:58:03.845 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T01:58:03.851 INFO:teuthology.task.internal:Opening connections... 2024-04-25T01:58:03.851 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T01:58:03.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:58:03.933 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T01:58:03.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:58:04.014 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T01:58:04.021 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-04-25T01:58:04.044 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-04-25T01:58:04.044 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-04-25T01:58:04.106 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-04-25T01:58:04.106 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8" 2024-04-25T01:58:04.106 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-25T01:58:04.107 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:58:04.108 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-04-25T01:58:04.129 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-04-25T01:58:04.151 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-04-25T01:58:04.151 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-25T01:58:04.213 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-04-25T01:58:04.213 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2024-04-25T01:58:04.213 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-04-25T01:58:04.214 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:58:04.214 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2024-04-25T01:58:04.214 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2024-04-25T01:58:04.214 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-25T01:58:04.214 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-04-25T01:58:04.214 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-25T01:58:04.215 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:58:04.215 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:58:04.215 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-25T01:58:04.215 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:58:04.215 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-25T01:58:04.238 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T01:58:04.250 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T01:58:04.256 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T01:58:04.256 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:58:04.258 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:58:04.279 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T01:58:04.285 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T01:58:04.285 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:58:04.320 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:58:04.350 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T01:58:04.403 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T01:58:04.420 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-25T01:58:04.420 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-25T01:58:04.421 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:58:04.421 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:58:04.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:58:04.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:58:04.444 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-04-25T01:58:04.445 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-25T01:58:04.505 INFO:teuthology.orchestra.run.smithi195.stdout:4.18.0-489.el8.x86_64 2024-04-25T01:58:04.505 INFO:teuthology.task.kernel:Running kernel on smithi195: 4.18.0-489.el8.x86_64 2024-04-25T01:58:04.505 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-04-25T01:58:04.506 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-489.el8.x86_64 2024-04-25T01:58:04.506 INFO:teuthology.task.kernel:Running kernel on smithi078: 4.18.0-489.el8.x86_64 2024-04-25T01:58:04.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2024-04-25T01:58:08.102 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - AppStream 27 MB/s | 28 MB 00:01 2024-04-25T01:58:08.350 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - AppStream 23 MB/s | 28 MB 00:01 2024-04-25T01:58:13.819 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-25T01:58:14.462 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - BaseOS 9.8 MB/s | 10 MB 00:01 2024-04-25T01:58:16.028 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - Extras 31 kB/s | 18 kB 00:00 2024-04-25T01:58:16.362 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - Extras common packages 34 kB/s | 7.7 kB 00:00 2024-04-25T01:58:16.493 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2024-04-25T01:58:16.614 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-25T01:58:16.952 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 7.7 kB 00:00 2024-04-25T01:58:17.195 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-04-25T01:58:18.879 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2024-04-25T01:58:19.306 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 16 MB 00:02 2024-04-25T01:58:22.679 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 480 kB/s | 24 kB 00:00 2024-04-25T01:58:23.140 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 328 kB/s | 24 kB 00:00 2024-04-25T01:58:25.709 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-25T01:58:25.709 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-25T01:58:25.824 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T01:58:25.825 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T01:58:25.825 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-25T01:58:25.825 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T01:58:25.825 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-25T01:58:25.825 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-25T01:58:25.825 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-25T01:58:25.826 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-25T01:58:25.826 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-25T01:58:25.826 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T01:58:25.826 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-25T01:58:25.826 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T01:58:25.826 INFO:teuthology.orchestra.run.smithi195.stdout:Install 3 Packages 2024-04-25T01:58:25.826 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T01:58:25.827 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 90 M 2024-04-25T01:58:25.827 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 96 M 2024-04-25T01:58:25.827 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-25T01:58:26.212 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-25T01:58:26.212 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-25T01:58:26.333 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-04-25T01:58:26.335 INFO:teuthology.orchestra.run.smithi078.stdout:Install 3 Packages 2024-04-25T01:58:26.336 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T01:58:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 90 M 2024-04-25T01:58:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 96 M 2024-04-25T01:58:26.336 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-04-25T01:58:26.764 INFO:teuthology.orchestra.run.smithi195.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 12 MB/s | 10 MB 00:00 2024-04-25T01:58:28.089 INFO:teuthology.orchestra.run.smithi195.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 17 MB/s | 36 MB 00:02 2024-04-25T01:58:28.523 INFO:teuthology.orchestra.run.smithi195.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 17 MB/s | 44 MB 00:02 2024-04-25T01:58:28.523 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:28.523 INFO:teuthology.orchestra.run.smithi195.stdout:Total 34 MB/s | 90 MB 00:02 2024-04-25T01:58:29.141 INFO:teuthology.orchestra.run.smithi078.stdout:(1/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 14 MB/s | 36 MB 00:02 2024-04-25T01:58:29.210 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-25T01:58:29.667 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-25T01:58:29.667 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-25T01:58:30.250 INFO:teuthology.orchestra.run.smithi078.stdout:(2/3): kernel-core-4.18.0-552.el8.x86_64.rpm 12 MB/s | 44 MB 00:03 2024-04-25T01:58:30.409 INFO:teuthology.orchestra.run.smithi078.stdout:(3/3): kernel-4.18.0-552.el8.x86_64.rpm 2.7 MB/s | 10 MB 00:03 2024-04-25T01:58:30.409 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:30.409 INFO:teuthology.orchestra.run.smithi078.stdout:Total 22 MB/s | 90 MB 00:04 2024-04-25T01:58:30.924 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-25T01:58:30.960 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-25T01:58:31.095 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-04-25T01:58:31.523 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-04-25T01:58:31.523 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-04-25T01:58:32.780 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-04-25T01:58:32.806 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-04-25T01:58:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-25T01:58:34.272 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T01:58:35.603 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-04-25T01:58:36.148 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T01:58:37.824 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T01:58:38.355 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T01:58:39.704 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T01:58:40.072 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T01:58:41.793 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T01:58:42.095 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:58:43.511 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T01:58:43.770 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:59:04.447 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:59:04.471 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:59:04.838 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:59:04.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-25T01:59:04.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-25T01:59:05.595 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:59:05.595 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T01:59:05.595 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-25T01:59:05.595 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-25T01:59:05.596 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-25T01:59:05.596 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T01:59:05.596 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-25T01:59:05.705 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:59:05.730 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:59:05.764 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T01:59:05.980 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T01:59:05.980 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T01:59:05.981 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-25T01:59:05.981 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T01:59:05.981 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T01:59:05.981 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-25T01:59:05.981 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T01:59:05.981 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T01:59:06.082 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:59:06.082 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-25T01:59:06.082 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-25T01:59:06.192 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T01:59:06.192 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T01:59:06.193 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2024-04-25T01:59:06.226 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2024-04-25T01:59:06.226 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2024-04-25T01:59:06.226 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.02 2024-04-25T01:59:06.226 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 129.el8 2024-04-25T01:59:06.227 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2024-04-25T01:59:06.227 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-25T01:59:06.227 INFO:teuthology.orchestra.run.smithi195.stdout:Group : System Environment/Base 2024-04-25T01:59:06.227 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 9265586 2024-04-25T01:59:06.227 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2024-04-25T01:59:06.227 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-25T01:59:06.228 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-25T01:59:06.228 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-25T01:59:06.228 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-25T01:59:06.228 INFO:teuthology.orchestra.run.smithi195.stdout:Relocations : (not relocatable) 2024-04-25T01:59:06.228 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : CentOS BuildSystem 2024-04-25T01:59:06.228 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : CentOS 2024-04-25T01:59:06.229 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T01:59:06.229 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2024-04-25T01:59:06.229 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2024-04-25T01:59:06.229 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T01:59:06.229 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T01:59:06.230 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T01:59:06.230 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T01:59:06.230 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2024-04-25T01:59:06.230 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T01:59:06.230 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T01:59:06.232 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T01:59:06.232 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 4.18.0-552.el8.x86_64 2024-04-25T01:59:06.232 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T01:59:06.581 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T01:59:06.581 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T01:59:06.581 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-04-25T01:59:06.581 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-25T01:59:06.581 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-25T01:59:06.582 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T01:59:06.582 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-04-25T01:59:06.729 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T01:59:06.947 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T01:59:06.947 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T01:59:06.947 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-25T01:59:06.947 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T01:59:06.948 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T01:59:06.948 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T01:59:06.948 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T01:59:06.948 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T01:59:07.163 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T01:59:07.164 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T01:59:07.164 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2024-04-25T01:59:07.198 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2024-04-25T01:59:07.198 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2024-04-25T01:59:07.198 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.02 2024-04-25T01:59:07.198 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 129.el8 2024-04-25T01:59:07.198 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2024-04-25T01:59:07.198 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-25T01:59:07.198 INFO:teuthology.orchestra.run.smithi078.stdout:Group : System Environment/Base 2024-04-25T01:59:07.198 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 9265586 2024-04-25T01:59:07.198 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:Relocations : (not relocatable) 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : CentOS BuildSystem 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T01:59:07.199 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2024-04-25T01:59:07.200 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T01:59:07.200 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T01:59:07.200 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T01:59:07.201 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 4.18.0-552.el8.x86_64 2024-04-25T01:59:07.201 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T01:59:07.600 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-04-25T01:59:08.848 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-04-25T01:59:09.813 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-04-25T01:59:09.815 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-25T01:59:09.838 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.CvoUzJDxyD 2024-04-25T01:59:09.838 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CvoUzJDxyD 2024-04-25T01:59:09.912 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.CvoUzJDxyD 2024-04-25T01:59:10.067 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.CvoUzJDxyD is 6KB 2024-04-25T01:59:10.116 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.CvoUzJDxyD 2024-04-25T01:59:10.133 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T01:59:10.207 INFO:teuthology.orchestra.run.smithi195.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-25T01:59:10.207 INFO:teuthology.orchestra.run.smithi195.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-25T01:59:10.207 INFO:teuthology.orchestra.run.smithi195.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-25T01:59:10.207 INFO:teuthology.orchestra.run.smithi195.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-25T01:59:10.208 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-25T01:59:10.377 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-04-25T01:59:10.723 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-04-25T01:59:10.724 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-04-25T01:59:10.755 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.oJ09FMRmSC 2024-04-25T01:59:10.756 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oJ09FMRmSC 2024-04-25T01:59:10.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.oJ09FMRmSC 2024-04-25T01:59:10.992 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.oJ09FMRmSC is 6KB 2024-04-25T01:59:11.039 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.oJ09FMRmSC 2024-04-25T01:59:11.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T01:59:11.139 INFO:teuthology.orchestra.run.smithi078.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-25T01:59:11.139 INFO:teuthology.orchestra.run.smithi078.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-25T01:59:11.139 INFO:teuthology.orchestra.run.smithi078.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-25T01:59:11.139 INFO:teuthology.orchestra.run.smithi078.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-25T01:59:11.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-25T01:59:11.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-04-25T01:59:40.405 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T01:59:40.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T01:59:40.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:59:41.304 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T01:59:41.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-25T01:59:41.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:59:58.751 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-25T01:59:59.774 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-04-25T02:00:07.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T02:00:07.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:00:08.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-25T02:00:08.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:00:11.838 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-04-25T02:00:23.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-25T02:00:23.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:00:55.875 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-04-25T02:00:56.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-25T02:00:56.826 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-552.el8.x86_64"... 2024-04-25T02:00:56.826 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-04-25T02:00:57.424 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-552.el8.x86_64 2024-04-25T02:00:57.424 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-25T02:00:57.424 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T02:00:57.425 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T02:00:58.426 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T02:00:58.426 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T02:00:58.499 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-04-25T02:00:58.520 DEBUG:teuthology.parallel:result is None 2024-04-25T02:01:07.760 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T02:01:19.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T02:01:19.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:01:20.121 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-25T02:01:20.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T02:01:20.407 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-552.el8.x86_64"... 2024-04-25T02:01:20.408 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-25T02:01:20.427 INFO:teuthology.orchestra.run.smithi195.stdout:4.18.0-552.el8.x86_64 2024-04-25T02:01:20.427 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-25T02:01:20.427 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T02:01:20.428 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T02:01:21.429 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-04-25T02:01:21.430 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T02:01:21.495 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-04-25T02:01:21.512 DEBUG:teuthology.parallel:result is None 2024-04-25T02:01:21.513 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T02:01:21.521 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T02:01:21.521 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T02:01:21.523 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T02:01:21.545 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T02:01:21.552 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T02:01:21.561 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T02:01:21.561 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T02:01:21.587 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T02:01:21.626 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T02:01:21.633 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T02:01:21.633 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T02:01:21.663 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T02:01:21.705 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:01:21.712 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:01:21.715 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:01:21.723 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:01:21.724 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T02:01:21.732 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T02:01:21.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T02:01:21.734 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T02:01:21.786 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T02:01:21.799 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T02:01:21.799 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T02:01:21.803 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T02:01:21.845 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:01:21.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:01:21.973 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:01:22.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:01:22.059 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:01:22.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T02:01:22.125 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:01:22.175 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:01:22.229 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:01:22.316 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:01:22.361 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:01:22.361 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T02:01:22.431 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-04-25T02:01:22.433 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-04-25T02:01:22.501 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:01:22.538 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:01:22.965 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T02:01:22.975 INFO:teuthology.task.internal:Starting timer... 2024-04-25T02:01:22.975 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T02:01:22.986 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T02:01:22.995 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-25T02:01:22.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2024-04-25T02:01:23.096 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2024-04-25T02:01:23.098 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-04-25T02:01:23.180 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-04-25T02:01:23.182 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T02:01:23.182 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2024-04-25T02:01:23.246 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2024-04-25T02:01:23.246 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-04-25T02:01:23.294 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-04-25T02:01:23.294 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi078.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-04-25T02:01:23.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:01:23.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:01:23.321 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:01:23.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:01:23.351 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T02:01:23.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2024-04-25T02:01:23.388 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-04-25T02:01:23.433 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T02:01:23.448 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T02:01:23.467 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T02:01:23.469 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T02:07:19.317 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-04-25T02:07:19.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-25T02:07:19.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:07:19.405 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-04-25T02:07:19.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-04-25T02:07:19.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T02:07:19.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:07:19.550 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-25T02:07:19.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T02:07:19.626 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T02:07:19.639 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T02:07:19.639 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:07:19.640 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:07:19.642 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:07:19.642 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:07:19.674 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:07:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:07:19.753 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2024-04-25T02:07:19.764 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2024-04-25T02:07:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:07:19.786 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-04-25T02:07:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:07:19.797 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-04-25T02:07:19.811 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:07:19.824 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:07:19.859 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2024-04-25T02:07:19.862 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:07:19.862 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-04-25T02:07:19.862 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:19.862 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:19.862 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:19.862 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:19.885 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2024-04-25T02:07:19.888 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:07:19.888 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-25T02:07:19.888 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:19.888 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:19.889 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:19.889 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:19.889 INFO:teuthology.run_tasks:Running task install... 2024-04-25T02:07:19.903 DEBUG:teuthology.task.install:project ceph 2024-04-25T02:07:19.904 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T02:07:19.904 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T02:07:19.904 INFO:teuthology.task.install:Using flavor: default 2024-04-25T02:07:19.913 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T02:07:19.913 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2024-04-25T02:07:19.913 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:07:19.913 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:07:19.913 INFO:teuthology.packaging:ref: None 2024-04-25T02:07:19.914 INFO:teuthology.packaging:tag: None 2024-04-25T02:07:19.914 INFO:teuthology.packaging:branch: pacific 2024-04-25T02:07:19.914 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:07:19.914 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-04-25T02:07:19.916 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:07:19.916 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:07:19.916 INFO:teuthology.packaging:ref: None 2024-04-25T02:07:19.916 INFO:teuthology.packaging:tag: None 2024-04-25T02:07:19.916 INFO:teuthology.packaging:branch: pacific 2024-04-25T02:07:19.916 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:07:19.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-04-25T02:07:20.129 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/ 2024-04-25T02:07:20.130 INFO:teuthology.task.install.rpm:Package version is 16.2.15-0 2024-04-25T02:07:20.168 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:07:20.168 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:07:20.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:07:20.196 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2024-04-25T02:07:20.196 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:07:20.196 INFO:teuthology.packaging:ref: None 2024-04-25T02:07:20.196 INFO:teuthology.packaging:tag: None 2024-04-25T02:07:20.197 INFO:teuthology.packaging:branch: pacific 2024-04-25T02:07:20.197 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:07:20.197 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:07:20.236 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/ 2024-04-25T02:07:20.236 INFO:teuthology.task.install.rpm:Package version is 16.2.15-0 2024-04-25T02:07:20.263 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:07:20.263 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:07:20.263 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:07:20.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:07:20.291 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2024-04-25T02:07:20.291 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:07:20.291 INFO:teuthology.packaging:ref: None 2024-04-25T02:07:20.291 INFO:teuthology.packaging:tag: None 2024-04-25T02:07:20.291 INFO:teuthology.packaging:branch: pacific 2024-04-25T02:07:20.291 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:07:20.291 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:07:20.342 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:07:20.359 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:07:20.408 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2024-04-25T02:07:20.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2024-04-25T02:07:20.435 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:07:20.501 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-04-25T02:07:20.502 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-04-25T02:07:20.682 INFO:teuthology.orchestra.run.smithi078.stdout:78 files removed 2024-04-25T02:07:20.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2024-04-25T02:07:20.764 INFO:teuthology.orchestra.run.smithi195.stdout:78 files removed 2024-04-25T02:07:20.792 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2024-04-25T02:07:21.211 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 769 kB/s | 76 kB 00:00 2024-04-25T02:07:21.274 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 972 kB/s | 76 kB 00:00 2024-04-25T02:07:21.320 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 217 kB/s | 15 kB 00:00 2024-04-25T02:07:21.383 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 216 kB/s | 15 kB 00:00 2024-04-25T02:07:21.404 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 32 kB/s | 1.7 kB 00:00 2024-04-25T02:07:21.475 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 27 kB/s | 1.7 kB 00:00 2024-04-25T02:07:22.184 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - AppStream 41 MB/s | 28 MB 00:00 2024-04-25T02:07:22.305 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - AppStream 32 MB/s | 28 MB 00:00 2024-04-25T02:07:27.693 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 10 MB 00:00 2024-04-25T02:07:27.964 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-25T02:07:29.827 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2024-04-25T02:07:30.014 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2024-04-25T02:07:30.294 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 7.7 kB 00:00 2024-04-25T02:07:30.502 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 7.7 kB 00:00 2024-04-25T02:07:36.045 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - PowerTools 897 kB/s | 5.0 MB 00:05 2024-04-25T02:07:36.365 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 8 - PowerTools 879 kB/s | 5.0 MB 00:05 2024-04-25T02:07:37.130 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-25T02:07:37.450 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-25T02:07:38.675 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-04-25T02:07:39.076 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-04-25T02:07:42.449 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 426 kB/s | 24 kB 00:00 2024-04-25T02:07:42.927 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 298 kB/s | 24 kB 00:00 2024-04-25T02:07:46.182 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-25T02:07:46.183 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-25T02:07:46.200 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-04-25T02:07:46.201 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-04-25T02:07:46.202 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-04-25T02:07:46.271 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T02:07:46.283 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-04-25T02:07:46.283 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-25T02:07:46.283 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-04-25T02:07:46.283 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-25T02:07:46.283 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:16.2.15-0.el8 ceph 6.3 k 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:16.2.15-0.el8 ceph 6.1 M 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:16.2.15-0.el8 ceph 911 k 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:16.2.15-0.el8 ceph 1.6 M 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:16.2.15-0.el8 ceph-noarch 3.1 M 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.15-0.el8 ceph-noarch 8.6 M 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:16.2.15-0.el8 ceph-noarch 27 k 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:16.2.15-0.el8 ceph 12 M 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:16.2.15-0.el8 ceph 52 M 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:16.2.15-0.el8 ceph 25 k 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:16.2.15-0.el8 ceph 825 k 2024-04-25T02:07:46.284 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:16.2.15-0.el8 ceph 131 k 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:16.2.15-0.el8 ceph 215 k 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:16.2.15-0.el8 ceph 389 k 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:16.2.15-0.el8 ceph 369 k 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:16.2.15-0.el8 ceph 114 k 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:16.2.15-0.el8 ceph 88 k 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:16.2.15-0.el8 ceph 175 k 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-04-25T02:07:46.285 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:16.2.15-0.el8 ceph 4.2 M 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-25T02:07:46.286 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:16.2.15-0.el8 ceph 24 M 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:16.2.15-0.el8 ceph-noarch 24 k 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:16.2.15-0.el8 ceph 2.4 M 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:16.2.15-0.el8 ceph-noarch 245 k 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:16.2.15-0.el8 ceph 5.2 M 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:16.2.15-0.el8 ceph 19 M 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:16.2.15-0.el8 ceph-noarch 15 k 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:16.2.15-0.el8 ceph 26 k 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-25T02:07:46.287 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:16.2.15-0.el8 ceph 174 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:16.2.15-0.el8 ceph 494 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:16.2.15-0.el8 ceph 3.8 M 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:16.2.15-0.el8 ceph 45 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:16.2.15-0.el8 ceph 99 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-25T02:07:46.291 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-25T02:07:46.292 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-25T02:07:46.293 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-25T02:07:46.293 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-25T02:07:46.293 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-25T02:07:46.293 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-25T02:07:46.293 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-25T02:07:46.293 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-25T02:07:46.293 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:07:46.293 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-25T02:07:46.293 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-04-25T02:07:46.294 INFO:teuthology.orchestra.run.smithi195.stdout:Install 108 Packages 2024-04-25T02:07:46.294 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 19 Packages 2024-04-25T02:07:46.294 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:07:46.294 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 209 M 2024-04-25T02:07:46.294 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-25T02:07:46.559 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-25T02:07:46.560 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-25T02:07:46.577 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-04-25T02:07:46.578 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-04-25T02:07:46.579 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-04-25T02:07:46.645 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-04-25T02:07:46.657 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================================ 2024-04-25T02:07:46.657 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-04-25T02:07:46.657 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================================ 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:16.2.15-0.el8 ceph 6.3 k 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:16.2.15-0.el8 ceph 6.1 M 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:16.2.15-0.el8 ceph 911 k 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:16.2.15-0.el8 ceph 1.6 M 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:16.2.15-0.el8 ceph-noarch 3.1 M 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.15-0.el8 ceph-noarch 8.6 M 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:16.2.15-0.el8 ceph-noarch 27 k 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:16.2.15-0.el8 ceph 12 M 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:16.2.15-0.el8 ceph 52 M 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:16.2.15-0.el8 ceph 25 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:16.2.15-0.el8 ceph 825 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:16.2.15-0.el8 ceph 131 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:16.2.15-0.el8 ceph 215 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:16.2.15-0.el8 ceph 389 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:16.2.15-0.el8 ceph 369 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:16.2.15-0.el8 ceph 114 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:16.2.15-0.el8 ceph 88 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:16.2.15-0.el8 ceph 175 k 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:16.2.15-0.el8 ceph 4.2 M 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:16.2.15-0.el8 ceph 24 M 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:16.2.15-0.el8 ceph-noarch 24 k 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:16.2.15-0.el8 ceph 2.4 M 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:16.2.15-0.el8 ceph-noarch 245 k 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:16.2.15-0.el8 ceph 5.2 M 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:16.2.15-0.el8 ceph 19 M 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:16.2.15-0.el8 ceph-noarch 15 k 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:16.2.15-0.el8 ceph 26 k 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:16.2.15-0.el8 ceph 174 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:16.2.15-0.el8 ceph 494 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:16.2.15-0.el8 ceph 3.8 M 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:16.2.15-0.el8 ceph 45 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:16.2.15-0.el8 ceph 99 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-25T02:07:46.664 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-25T02:07:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-25T02:07:46.666 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================================ 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout:Install 108 Packages 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 19 Packages 2024-04-25T02:07:46.667 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:07:46.668 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 209 M 2024-04-25T02:07:46.668 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-04-25T02:07:46.683 INFO:teuthology.orchestra.run.smithi195.stdout:(1/127): ceph-16.2.15-0.el8.x86_64.rpm 109 kB/s | 6.3 kB 00:00 2024-04-25T02:07:46.725 INFO:teuthology.orchestra.run.smithi195.stdout:(2/127): ceph-fuse-16.2.15-0.el8.x86_64.rpm 21 MB/s | 911 kB 00:00 2024-04-25T02:07:46.833 INFO:teuthology.orchestra.run.smithi195.stdout:(3/127): ceph-base-16.2.15-0.el8.x86_64.rpm 29 MB/s | 6.1 MB 00:00 2024-04-25T02:07:46.884 INFO:teuthology.orchestra.run.smithi195.stdout:(4/127): ceph-mds-16.2.15-0.el8.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-04-25T02:07:46.886 INFO:teuthology.orchestra.run.smithi078.stdout:(1/127): ceph-16.2.15-0.el8.x86_64.rpm 160 kB/s | 6.3 kB 00:00 2024-04-25T02:07:46.934 INFO:teuthology.orchestra.run.smithi195.stdout:(5/127): ceph-mgr-16.2.15-0.el8.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-25T02:07:46.953 INFO:teuthology.orchestra.run.smithi078.stdout:(2/127): ceph-fuse-16.2.15-0.el8.x86_64.rpm 13 MB/s | 911 kB 00:00 2024-04-25T02:07:47.060 INFO:teuthology.orchestra.run.smithi195.stdout:(6/127): ceph-mon-16.2.15-0.el8.x86_64.rpm 30 MB/s | 5.2 MB 00:00 2024-04-25T02:07:47.070 INFO:teuthology.orchestra.run.smithi078.stdout:(3/127): ceph-base-16.2.15-0.el8.x86_64.rpm 28 MB/s | 6.1 MB 00:00 2024-04-25T02:07:47.137 INFO:teuthology.orchestra.run.smithi078.stdout:(4/127): ceph-mgr-16.2.15-0.el8.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-25T02:07:47.188 INFO:teuthology.orchestra.run.smithi078.stdout:(5/127): ceph-mds-16.2.15-0.el8.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-04-25T02:07:47.330 INFO:teuthology.orchestra.run.smithi078.stdout:(6/127): ceph-mon-16.2.15-0.el8.x86_64.rpm 27 MB/s | 5.2 MB 00:00 2024-04-25T02:07:47.376 INFO:teuthology.orchestra.run.smithi195.stdout:(7/127): ceph-common-16.2.15-0.el8.x86_64.rpm 32 MB/s | 24 MB 00:00 2024-04-25T02:07:47.401 INFO:teuthology.orchestra.run.smithi195.stdout:(8/127): ceph-selinux-16.2.15-0.el8.x86_64.rpm 1.0 MB/s | 26 kB 00:00 2024-04-25T02:07:47.602 INFO:teuthology.orchestra.run.smithi195.stdout:(9/127): ceph-osd-16.2.15-0.el8.x86_64.rpm 28 MB/s | 19 MB 00:00 2024-04-25T02:07:47.627 INFO:teuthology.orchestra.run.smithi195.stdout:(10/127): libcephfs-devel-16.2.15-0.el8.x86_64. 1.0 MB/s | 25 kB 00:00 2024-04-25T02:07:47.638 INFO:teuthology.orchestra.run.smithi078.stdout:(7/127): ceph-common-16.2.15-0.el8.x86_64.rpm 31 MB/s | 24 MB 00:00 2024-04-25T02:07:47.663 INFO:teuthology.orchestra.run.smithi078.stdout:(8/127): ceph-selinux-16.2.15-0.el8.x86_64.rpm 1.0 MB/s | 26 kB 00:00 2024-04-25T02:07:47.686 INFO:teuthology.orchestra.run.smithi195.stdout:(11/127): libcephfs2-16.2.15-0.el8.x86_64.rpm 14 MB/s | 825 kB 00:00 2024-04-25T02:07:47.719 INFO:teuthology.orchestra.run.smithi195.stdout:(12/127): libcephsqlite-16.2.15-0.el8.x86_64.rp 5.1 MB/s | 174 kB 00:00 2024-04-25T02:07:47.745 INFO:teuthology.orchestra.run.smithi195.stdout:(13/127): librados-devel-16.2.15-0.el8.x86_64.r 5.2 MB/s | 131 kB 00:00 2024-04-25T02:07:47.778 INFO:teuthology.orchestra.run.smithi195.stdout:(14/127): libradosstriper1-16.2.15-0.el8.x86_64 15 MB/s | 494 kB 00:00 2024-04-25T02:07:47.822 INFO:teuthology.orchestra.run.smithi078.stdout:(9/127): ceph-radosgw-16.2.15-0.el8.x86_64.rpm 24 MB/s | 12 MB 00:00 2024-04-25T02:07:47.881 INFO:teuthology.orchestra.run.smithi078.stdout:(10/127): libcephfs-devel-16.2.15-0.el8.x86_64. 438 kB/s | 25 kB 00:00 2024-04-25T02:07:47.920 INFO:teuthology.orchestra.run.smithi195.stdout:(15/127): ceph-radosgw-16.2.15-0.el8.x86_64.rpm 14 MB/s | 12 MB 00:00 2024-04-25T02:07:47.923 INFO:teuthology.orchestra.run.smithi078.stdout:(11/127): libcephfs2-16.2.15-0.el8.x86_64.rpm 19 MB/s | 825 kB 00:00 2024-04-25T02:07:47.937 INFO:teuthology.orchestra.run.smithi195.stdout:(16/127): python3-ceph-argparse-16.2.15-0.el8.x 2.7 MB/s | 45 kB 00:00 2024-04-25T02:07:47.948 INFO:teuthology.orchestra.run.smithi078.stdout:(12/127): libcephsqlite-16.2.15-0.el8.x86_64.rp 6.8 MB/s | 174 kB 00:00 2024-04-25T02:07:47.962 INFO:teuthology.orchestra.run.smithi195.stdout:(17/127): python3-ceph-common-16.2.15-0.el8.x86 3.9 MB/s | 99 kB 00:00 2024-04-25T02:07:47.973 INFO:teuthology.orchestra.run.smithi078.stdout:(13/127): librados-devel-16.2.15-0.el8.x86_64.r 5.1 MB/s | 131 kB 00:00 2024-04-25T02:07:47.987 INFO:teuthology.orchestra.run.smithi195.stdout:(18/127): python3-cephfs-16.2.15-0.el8.x86_64.r 8.5 MB/s | 215 kB 00:00 2024-04-25T02:07:48.007 INFO:teuthology.orchestra.run.smithi078.stdout:(14/127): libradosstriper1-16.2.15-0.el8.x86_64 15 MB/s | 494 kB 00:00 2024-04-25T02:07:48.021 INFO:teuthology.orchestra.run.smithi195.stdout:(19/127): python3-rados-16.2.15-0.el8.x86_64.rp 11 MB/s | 389 kB 00:00 2024-04-25T02:07:48.055 INFO:teuthology.orchestra.run.smithi195.stdout:(20/127): python3-rbd-16.2.15-0.el8.x86_64.rpm 11 MB/s | 369 kB 00:00 2024-04-25T02:07:48.130 INFO:teuthology.orchestra.run.smithi195.stdout:(21/127): librgw2-16.2.15-0.el8.x86_64.rpm 11 MB/s | 3.8 MB 00:00 2024-04-25T02:07:48.156 INFO:teuthology.orchestra.run.smithi195.stdout:(22/127): python3-rgw-16.2.15-0.el8.x86_64.rpm 1.1 MB/s | 114 kB 00:00 2024-04-25T02:07:48.181 INFO:teuthology.orchestra.run.smithi195.stdout:(23/127): rbd-fuse-16.2.15-0.el8.x86_64.rpm 1.7 MB/s | 88 kB 00:00 2024-04-25T02:07:48.215 INFO:teuthology.orchestra.run.smithi195.stdout:(24/127): rbd-nbd-16.2.15-0.el8.x86_64.rpm 5.2 MB/s | 175 kB 00:00 2024-04-25T02:07:48.224 INFO:teuthology.orchestra.run.smithi078.stdout:(15/127): ceph-osd-16.2.15-0.el8.x86_64.rpm 18 MB/s | 19 MB 00:01 2024-04-25T02:07:48.240 INFO:teuthology.orchestra.run.smithi195.stdout:(25/127): ceph-grafana-dashboards-16.2.15-0.el8 978 kB/s | 24 kB 00:00 2024-04-25T02:07:48.249 INFO:teuthology.orchestra.run.smithi078.stdout:(16/127): python3-ceph-argparse-16.2.15-0.el8.x 1.8 MB/s | 45 kB 00:00 2024-04-25T02:07:48.275 INFO:teuthology.orchestra.run.smithi078.stdout:(17/127): python3-ceph-common-16.2.15-0.el8.x86 3.9 MB/s | 99 kB 00:00 2024-04-25T02:07:48.300 INFO:teuthology.orchestra.run.smithi078.stdout:(18/127): python3-cephfs-16.2.15-0.el8.x86_64.r 8.3 MB/s | 215 kB 00:00 2024-04-25T02:07:48.324 INFO:teuthology.orchestra.run.smithi195.stdout:(26/127): rbd-mirror-16.2.15-0.el8.x86_64.rpm 22 MB/s | 3.7 MB 00:00 2024-04-25T02:07:48.334 INFO:teuthology.orchestra.run.smithi078.stdout:(19/127): python3-rados-16.2.15-0.el8.x86_64.rp 11 MB/s | 389 kB 00:00 2024-04-25T02:07:48.367 INFO:teuthology.orchestra.run.smithi078.stdout:(20/127): python3-rbd-16.2.15-0.el8.x86_64.rpm 11 MB/s | 369 kB 00:00 2024-04-25T02:07:48.382 INFO:teuthology.orchestra.run.smithi195.stdout:(27/127): ceph-mgr-dashboard-16.2.15-0.el8.noar 22 MB/s | 3.1 MB 00:00 2024-04-25T02:07:48.393 INFO:teuthology.orchestra.run.smithi078.stdout:(21/127): python3-rgw-16.2.15-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2024-04-25T02:07:48.416 INFO:teuthology.orchestra.run.smithi195.stdout:(28/127): ceph-mgr-modules-core-16.2.15-0.el8.n 7.2 MB/s | 245 kB 00:00 2024-04-25T02:07:48.418 INFO:teuthology.orchestra.run.smithi078.stdout:(22/127): rbd-fuse-16.2.15-0.el8.x86_64.rpm 3.5 MB/s | 88 kB 00:00 2024-04-25T02:07:48.441 INFO:teuthology.orchestra.run.smithi195.stdout:(29/127): ceph-mgr-rook-16.2.15-0.el8.noarch.rp 1.1 MB/s | 27 kB 00:00 2024-04-25T02:07:48.466 INFO:teuthology.orchestra.run.smithi195.stdout:(30/127): ceph-prometheus-alerts-16.2.15-0.el8. 597 kB/s | 15 kB 00:00 2024-04-25T02:07:48.485 INFO:teuthology.orchestra.run.smithi078.stdout:(23/127): librgw2-16.2.15-0.el8.x86_64.rpm 8.0 MB/s | 3.8 MB 00:00 2024-04-25T02:07:48.519 INFO:teuthology.orchestra.run.smithi078.stdout:(24/127): rbd-nbd-16.2.15-0.el8.x86_64.rpm 5.1 MB/s | 175 kB 00:00 2024-04-25T02:07:48.544 INFO:teuthology.orchestra.run.smithi078.stdout:(25/127): ceph-grafana-dashboards-16.2.15-0.el8 982 kB/s | 24 kB 00:00 2024-04-25T02:07:48.617 INFO:teuthology.orchestra.run.smithi195.stdout:(31/127): ceph-mgr-diskprediction-local-16.2.15 29 MB/s | 8.6 MB 00:00 2024-04-25T02:07:48.628 INFO:teuthology.orchestra.run.smithi078.stdout:(26/127): rbd-mirror-16.2.15-0.el8.x86_64.rpm 18 MB/s | 3.7 MB 00:00 2024-04-25T02:07:48.701 INFO:teuthology.orchestra.run.smithi195.stdout:(32/127): bison-3.0.4-10.el8.x86_64.rpm 2.9 MB/s | 688 kB 00:00 2024-04-25T02:07:48.707 INFO:teuthology.orchestra.run.smithi078.stdout:(27/127): ceph-mgr-dashboard-16.2.15-0.el8.noar 19 MB/s | 3.1 MB 00:00 2024-04-25T02:07:48.744 INFO:teuthology.orchestra.run.smithi078.stdout:(28/127): ceph-mgr-modules-core-16.2.15-0.el8.n 6.5 MB/s | 245 kB 00:00 2024-04-25T02:07:48.751 INFO:teuthology.orchestra.run.smithi195.stdout:(33/127): jq-1.6-8.el8.x86_64.rpm 4.0 MB/s | 203 kB 00:00 2024-04-25T02:07:48.776 INFO:teuthology.orchestra.run.smithi195.stdout:(34/127): flex-2.6.1-9.el8.x86_64.rpm 2.0 MB/s | 320 kB 00:00 2024-04-25T02:07:48.778 INFO:teuthology.orchestra.run.smithi078.stdout:(29/127): ceph-mgr-rook-16.2.15-0.el8.noarch.rp 822 kB/s | 27 kB 00:00 2024-04-25T02:07:48.804 INFO:teuthology.orchestra.run.smithi078.stdout:(30/127): ceph-prometheus-alerts-16.2.15-0.el8. 593 kB/s | 15 kB 00:00 2024-04-25T02:07:48.810 INFO:teuthology.orchestra.run.smithi195.stdout:(35/127): librdkafka-1.6.1-1.el8.x86_64.rpm 11 MB/s | 677 kB 00:00 2024-04-25T02:07:48.835 INFO:teuthology.orchestra.run.smithi195.stdout:(36/127): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2024-04-25T02:07:48.860 INFO:teuthology.orchestra.run.smithi195.stdout:(37/127): oniguruma-6.8.2-3.el8.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T02:07:48.969 INFO:teuthology.orchestra.run.smithi078.stdout:(31/127): ceph-mgr-diskprediction-local-16.2.15 25 MB/s | 8.6 MB 00:00 2024-04-25T02:07:49.009 INFO:teuthology.orchestra.run.smithi195.stdout:(38/127): openblas-0.3.15-4.el8.x86_64.rpm 27 MB/s | 4.7 MB 00:00 2024-04-25T02:07:49.054 INFO:teuthology.orchestra.run.smithi078.stdout:(32/127): bison-3.0.4-10.el8.x86_64.rpm 2.7 MB/s | 688 kB 00:00 2024-04-25T02:07:49.097 INFO:teuthology.orchestra.run.smithi078.stdout:(33/127): jq-1.6-8.el8.x86_64.rpm 4.8 MB/s | 203 kB 00:00 2024-04-25T02:07:49.121 INFO:teuthology.orchestra.run.smithi078.stdout:(34/127): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2024-04-25T02:07:49.155 INFO:teuthology.orchestra.run.smithi078.stdout:(35/127): librdkafka-1.6.1-1.el8.x86_64.rpm 11 MB/s | 677 kB 00:00 2024-04-25T02:07:49.180 INFO:teuthology.orchestra.run.smithi078.stdout:(36/127): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2024-04-25T02:07:49.231 INFO:teuthology.orchestra.run.smithi078.stdout:(37/127): oniguruma-6.8.2-3.el8.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-25T02:07:49.339 INFO:teuthology.orchestra.run.smithi078.stdout:(38/127): openblas-0.3.15-4.el8.x86_64.rpm 30 MB/s | 4.7 MB 00:00 2024-04-25T02:07:49.381 INFO:teuthology.orchestra.run.smithi078.stdout:(39/127): python3-jsonpatch-1.21-2.el8.noarch.r 639 kB/s | 27 kB 00:00 2024-04-25T02:07:49.457 INFO:teuthology.orchestra.run.smithi078.stdout:(40/127): openblas-threads-0.3.15-4.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2024-04-25T02:07:49.503 INFO:teuthology.orchestra.run.smithi195.stdout:(39/127): ceph-test-16.2.15-0.el8.x86_64.rpm 25 MB/s | 52 MB 00:02 2024-04-25T02:07:49.507 INFO:teuthology.orchestra.run.smithi078.stdout:(41/127): python3-jsonpointer-1.10-11.el8.noarc 159 kB/s | 20 kB 00:00 2024-04-25T02:07:49.524 INFO:teuthology.orchestra.run.smithi078.stdout:(42/127): python3-mako-1.0.6-14.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2024-04-25T02:07:49.528 INFO:teuthology.orchestra.run.smithi195.stdout:(40/127): python3-jsonpatch-1.21-2.el8.noarch.r 51 kB/s | 27 kB 00:00 2024-04-25T02:07:49.549 INFO:teuthology.orchestra.run.smithi078.stdout:(43/127): python3-markupsafe-0.23-19.el8.x86_64 923 kB/s | 39 kB 00:00 2024-04-25T02:07:49.620 INFO:teuthology.orchestra.run.smithi195.stdout:(41/127): openblas-threads-0.3.15-4.el8.x86_64. 6.4 MB/s | 4.9 MB 00:00 2024-04-25T02:07:49.645 INFO:teuthology.orchestra.run.smithi195.stdout:(42/127): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2024-04-25T02:07:49.671 INFO:teuthology.orchestra.run.smithi195.stdout:(43/127): python3-markupsafe-0.23-19.el8.x86_64 776 kB/s | 39 kB 00:00 2024-04-25T02:07:49.696 INFO:teuthology.orchestra.run.smithi195.stdout:(44/127): python3-jsonpointer-1.10-11.el8.noarc 104 kB/s | 20 kB 00:00 2024-04-25T02:07:49.721 INFO:teuthology.orchestra.run.smithi195.stdout:(45/127): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2024-04-25T02:07:49.755 INFO:teuthology.orchestra.run.smithi195.stdout:(46/127): python3-prettytable-0.7.2-14.el8.noar 747 kB/s | 44 kB 00:00 2024-04-25T02:07:49.780 INFO:teuthology.orchestra.run.smithi195.stdout:(47/127): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2024-04-25T02:07:49.839 INFO:teuthology.orchestra.run.smithi195.stdout:(48/127): python3-numpy-1.14.3-10.el8.x86_64.rp 19 MB/s | 3.7 MB 00:00 2024-04-25T02:07:49.864 INFO:teuthology.orchestra.run.smithi195.stdout:(49/127): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2024-04-25T02:07:49.914 INFO:teuthology.orchestra.run.smithi195.stdout:(50/127): python3-pyasn1-modules-0.3.7-6.el8.no 822 kB/s | 110 kB 00:00 2024-04-25T02:07:49.931 INFO:teuthology.orchestra.run.smithi195.stdout:(51/127): python3-pytz-2017.2-11.el8.noarch.rpm 619 kB/s | 57 kB 00:00 2024-04-25T02:07:49.973 INFO:teuthology.orchestra.run.smithi195.stdout:(52/127): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2024-04-25T02:07:49.999 INFO:teuthology.orchestra.run.smithi195.stdout:(53/127): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2024-04-25T02:07:50.024 INFO:teuthology.orchestra.run.smithi195.stdout:(54/127): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-04-25T02:07:50.117 INFO:teuthology.orchestra.run.smithi078.stdout:(44/127): ceph-test-16.2.15-0.el8.x86_64.rpm 21 MB/s | 52 MB 00:02 2024-04-25T02:07:50.142 INFO:teuthology.orchestra.run.smithi078.stdout:(45/127): python3-numpy-f2py-1.14.3-10.el8.x86_ 380 kB/s | 225 kB 00:00 2024-04-25T02:07:50.209 INFO:teuthology.orchestra.run.smithi078.stdout:(46/127): python3-numpy-1.14.3-10.el8.x86_64.rp 5.4 MB/s | 3.7 MB 00:00 2024-04-25T02:07:50.234 INFO:teuthology.orchestra.run.smithi078.stdout:(47/127): python3-prettytable-0.7.2-14.el8.noar 375 kB/s | 44 kB 00:00 2024-04-25T02:07:50.258 INFO:teuthology.orchestra.run.smithi195.stdout:(55/127): python3-scipy-1.0.0-21.module_el8+762 36 MB/s | 14 MB 00:00 2024-04-25T02:07:50.268 INFO:teuthology.orchestra.run.smithi078.stdout:(48/127): python3-pyOpenSSL-19.0.0-1.el8.noarch 824 kB/s | 103 kB 00:00 2024-04-25T02:07:50.283 INFO:teuthology.orchestra.run.smithi195.stdout:(56/127): elfutils-libelf-devel-0.190-2.el8.x86 219 kB/s | 62 kB 00:00 2024-04-25T02:07:50.293 INFO:teuthology.orchestra.run.smithi078.stdout:(49/127): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.5 MB/s | 126 kB 00:00 2024-04-25T02:07:50.308 INFO:teuthology.orchestra.run.smithi195.stdout:(57/127): fuse-2.9.7-19.el8.x86_64.rpm 293 kB/s | 83 kB 00:00 2024-04-25T02:07:50.318 INFO:teuthology.orchestra.run.smithi078.stdout:(50/127): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2024-04-25T02:07:50.344 INFO:teuthology.orchestra.run.smithi078.stdout:(51/127): python3-pytz-2017.2-11.el8.noarch.rpm 756 kB/s | 57 kB 00:00 2024-04-25T02:07:50.384 INFO:teuthology.orchestra.run.smithi195.stdout:(58/127): libcom_err-devel-1.45.6-5.el8.x86_64. 516 kB/s | 39 kB 00:00 2024-04-25T02:07:50.409 INFO:teuthology.orchestra.run.smithi195.stdout:(59/127): keyutils-libs-devel-1.5.10-9.el8.x86_ 319 kB/s | 48 kB 00:00 2024-04-25T02:07:50.410 INFO:teuthology.orchestra.run.smithi078.stdout:(52/127): python3-werkzeug-0.12.2-4.el8.noarch. 4.9 MB/s | 457 kB 00:00 2024-04-25T02:07:50.435 INFO:teuthology.orchestra.run.smithi078.stdout:(53/127): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2024-04-25T02:07:50.451 INFO:teuthology.orchestra.run.smithi195.stdout:(60/127): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.3 MB/s | 561 kB 00:00 2024-04-25T02:07:50.461 INFO:teuthology.orchestra.run.smithi078.stdout:(54/127): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-04-25T02:07:50.518 INFO:teuthology.orchestra.run.smithi195.stdout:(61/127): libquadmath-8.5.0-21.el8.x86_64.rpm 1.6 MB/s | 172 kB 00:00 2024-04-25T02:07:50.543 INFO:teuthology.orchestra.run.smithi195.stdout:(62/127): librabbitmq-0.9.0-5.el8.x86_64.rpm 512 kB/s | 47 kB 00:00 2024-04-25T02:07:50.568 INFO:teuthology.orchestra.run.smithi195.stdout:(63/127): libgfortran-8.5.0-21.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2024-04-25T02:07:50.627 INFO:teuthology.orchestra.run.smithi195.stdout:(64/127): libselinux-devel-2.9-8.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2024-04-25T02:07:50.652 INFO:teuthology.orchestra.run.smithi195.stdout:(65/127): libverto-devel-0.3.2-2.el8.x86_64.rpm 216 kB/s | 18 kB 00:00 2024-04-25T02:07:50.677 INFO:teuthology.orchestra.run.smithi195.stdout:(66/127): libsepol-devel-2.9-3.el8.x86_64.rpm 649 kB/s | 87 kB 00:00 2024-04-25T02:07:50.695 INFO:teuthology.orchestra.run.smithi078.stdout:(55/127): python3-scipy-1.0.0-21.module_el8+762 35 MB/s | 14 MB 00:00 2024-04-25T02:07:50.711 INFO:teuthology.orchestra.run.smithi195.stdout:(67/127): libzstd-devel-1.4.4-1.el8.x86_64.rpm 523 kB/s | 44 kB 00:00 2024-04-25T02:07:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:(56/127): elfutils-libelf-devel-0.190-2.el8.x86 219 kB/s | 62 kB 00:00 2024-04-25T02:07:50.737 INFO:teuthology.orchestra.run.smithi078.stdout:(57/127): fuse-2.9.7-19.el8.x86_64.rpm 302 kB/s | 83 kB 00:00 2024-04-25T02:07:50.811 INFO:teuthology.orchestra.run.smithi195.stdout:(68/127): pcre2-devel-10.32-3.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2024-04-25T02:07:50.820 INFO:teuthology.orchestra.run.smithi078.stdout:(58/127): libcom_err-devel-1.45.6-5.el8.x86_64. 464 kB/s | 39 kB 00:00 2024-04-25T02:07:50.836 INFO:teuthology.orchestra.run.smithi195.stdout:(69/127): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2024-04-25T02:07:50.845 INFO:teuthology.orchestra.run.smithi078.stdout:(59/127): keyutils-libs-devel-1.5.10-9.el8.x86_ 319 kB/s | 48 kB 00:00 2024-04-25T02:07:50.888 INFO:teuthology.orchestra.run.smithi078.stdout:(60/127): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.3 MB/s | 561 kB 00:00 2024-04-25T02:07:50.912 INFO:teuthology.orchestra.run.smithi195.stdout:(70/127): openssl-devel-1.1.1k-12.el8.x86_64.rp 12 MB/s | 3.2 MB 00:00 2024-04-25T02:07:50.937 INFO:teuthology.orchestra.run.smithi195.stdout:(71/127): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2024-04-25T02:07:50.954 INFO:teuthology.orchestra.run.smithi078.stdout:(61/127): libquadmath-8.5.0-21.el8.x86_64.rpm 1.6 MB/s | 172 kB 00:00 2024-04-25T02:07:50.962 INFO:teuthology.orchestra.run.smithi195.stdout:(72/127): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2024-04-25T02:07:50.980 INFO:teuthology.orchestra.run.smithi078.stdout:(62/127): librabbitmq-0.9.0-5.el8.x86_64.rpm 511 kB/s | 47 kB 00:00 2024-04-25T02:07:51.013 INFO:teuthology.orchestra.run.smithi078.stdout:(63/127): libgfortran-8.5.0-21.el8.x86_64.rpm 3.3 MB/s | 645 kB 00:00 2024-04-25T02:07:51.021 INFO:teuthology.orchestra.run.smithi195.stdout:(73/127): python3-jwt-1.6.1-2.el8.noarch.rpm 510 kB/s | 43 kB 00:00 2024-04-25T02:07:51.046 INFO:teuthology.orchestra.run.smithi195.stdout:(74/127): python3-cryptography-3.2.1-7.el8.x86_ 4.7 MB/s | 641 kB 00:00 2024-04-25T02:07:51.055 INFO:teuthology.orchestra.run.smithi078.stdout:(64/127): libselinux-devel-2.9-8.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2024-04-25T02:07:51.081 INFO:teuthology.orchestra.run.smithi078.stdout:(65/127): libsepol-devel-2.9-3.el8.x86_64.rpm 865 kB/s | 87 kB 00:00 2024-04-25T02:07:51.097 INFO:teuthology.orchestra.run.smithi195.stdout:(75/127): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2024-04-25T02:07:51.106 INFO:teuthology.orchestra.run.smithi078.stdout:(66/127): libverto-devel-0.3.2-2.el8.x86_64.rpm 196 kB/s | 18 kB 00:00 2024-04-25T02:07:51.130 INFO:teuthology.orchestra.run.smithi195.stdout:(76/127): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2024-04-25T02:07:51.140 INFO:teuthology.orchestra.run.smithi078.stdout:(67/127): libzstd-devel-1.4.4-1.el8.x86_64.rpm 522 kB/s | 44 kB 00:00 2024-04-25T02:07:51.155 INFO:teuthology.orchestra.run.smithi195.stdout:(77/127): python3-requests-oauthlib-1.0.0-1.el8 391 kB/s | 43 kB 00:00 2024-04-25T02:07:51.189 INFO:teuthology.orchestra.run.smithi195.stdout:(78/127): zlib-devel-1.2.11-21.el8.x86_64.rpm 631 kB/s | 58 kB 00:00 2024-04-25T02:07:51.240 INFO:teuthology.orchestra.run.smithi078.stdout:(68/127): pcre2-devel-10.32-3.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2024-04-25T02:07:51.265 INFO:teuthology.orchestra.run.smithi078.stdout:(69/127): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2024-04-25T02:07:51.332 INFO:teuthology.orchestra.run.smithi078.stdout:(70/127): openssl-devel-1.1.1k-12.el8.x86_64.rp 13 MB/s | 3.2 MB 00:00 2024-04-25T02:07:51.356 INFO:teuthology.orchestra.run.smithi195.stdout:(79/127): liboath-2.6.2-3.el8.x86_64.rpm 353 kB/s | 59 kB 00:00 2024-04-25T02:07:51.357 INFO:teuthology.orchestra.run.smithi078.stdout:(71/127): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2024-04-25T02:07:51.382 INFO:teuthology.orchestra.run.smithi078.stdout:(72/127): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2024-04-25T02:07:51.390 INFO:teuthology.orchestra.run.smithi195.stdout:(80/127): leveldb-1.22-1.el8.x86_64.rpm 773 kB/s | 181 kB 00:00 2024-04-25T02:07:51.423 INFO:teuthology.orchestra.run.smithi195.stdout:(81/127): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2024-04-25T02:07:51.449 INFO:teuthology.orchestra.run.smithi195.stdout:(82/127): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 743 kB/s | 44 kB 00:00 2024-04-25T02:07:51.466 INFO:teuthology.orchestra.run.smithi078.stdout:(73/127): python3-jwt-1.6.1-2.el8.noarch.rpm 392 kB/s | 43 kB 00:00 2024-04-25T02:07:51.474 INFO:teuthology.orchestra.run.smithi195.stdout:(83/127): libunwind-1.3.1-3.el8.x86_64.rpm 638 kB/s | 75 kB 00:00 2024-04-25T02:07:51.491 INFO:teuthology.orchestra.run.smithi078.stdout:(74/127): python3-oauthlib-2.1.0-1.el8.noarch.r 1.4 MB/s | 155 kB 00:00 2024-04-25T02:07:51.499 INFO:teuthology.orchestra.run.smithi195.stdout:(84/127): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2024-04-25T02:07:51.525 INFO:teuthology.orchestra.run.smithi078.stdout:(75/127): python3-cryptography-3.2.1-7.el8.x86_ 3.3 MB/s | 641 kB 00:00 2024-04-25T02:07:51.533 INFO:teuthology.orchestra.run.smithi195.stdout:(85/127): python3-cachetools-3.1.1-4.el8.noarch 393 kB/s | 33 kB 00:00 2024-04-25T02:07:51.558 INFO:teuthology.orchestra.run.smithi195.stdout:(86/127): python3-certifi-2018.10.15-7.el8.noar 194 kB/s | 16 kB 00:00 2024-04-25T02:07:51.559 INFO:teuthology.orchestra.run.smithi078.stdout:(76/127): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2024-04-25T02:07:51.583 INFO:teuthology.orchestra.run.smithi195.stdout:(87/127): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2024-04-25T02:07:51.584 INFO:teuthology.orchestra.run.smithi078.stdout:(77/127): python3-requests-oauthlib-1.0.0-1.el8 461 kB/s | 43 kB 00:00 2024-04-25T02:07:51.617 INFO:teuthology.orchestra.run.smithi195.stdout:(88/127): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2024-04-25T02:07:51.618 INFO:teuthology.orchestra.run.smithi078.stdout:(78/127): zlib-devel-1.2.11-21.el8.x86_64.rpm 631 kB/s | 58 kB 00:00 2024-04-25T02:07:51.661 INFO:teuthology.orchestra.run.smithi195.stdout:(89/127): python3-jaraco-6.2-6.el8.noarch.rpm 144 kB/s | 11 kB 00:00 2024-04-25T02:07:51.693 INFO:teuthology.orchestra.run.smithi195.stdout:(90/127): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2024-04-25T02:07:51.718 INFO:teuthology.orchestra.run.smithi195.stdout:(91/127): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2024-04-25T02:07:51.760 INFO:teuthology.orchestra.run.smithi195.stdout:(92/127): python3-logutils-0.3.5-11.el8.noarch. 728 kB/s | 49 kB 00:00 2024-04-25T02:07:51.786 INFO:teuthology.orchestra.run.smithi195.stdout:(93/127): python3-more-itertools-7.2.0-3.el8.no 875 kB/s | 59 kB 00:00 2024-04-25T02:07:51.827 INFO:teuthology.orchestra.run.smithi195.stdout:(94/127): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2024-04-25T02:07:51.853 INFO:teuthology.orchestra.run.smithi195.stdout:(95/127): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2024-04-25T02:07:51.878 INFO:teuthology.orchestra.run.smithi195.stdout:(96/127): python3-pecan-1.3.2-9.el8.noarch.rpm 2.3 MB/s | 283 kB 00:00 2024-04-25T02:07:51.903 INFO:teuthology.orchestra.run.smithi195.stdout:(97/127): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2024-04-25T02:07:51.937 INFO:teuthology.orchestra.run.smithi195.stdout:(98/127): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2024-04-25T02:07:51.960 INFO:teuthology.orchestra.run.smithi078.stdout:(79/127): liboath-2.6.2-3.el8.x86_64.rpm 172 kB/s | 59 kB 00:00 2024-04-25T02:07:51.962 INFO:teuthology.orchestra.run.smithi195.stdout:(99/127): python3-simplegeneric-0.8.1-17.el8.no 319 kB/s | 19 kB 00:00 2024-04-25T02:07:51.987 INFO:teuthology.orchestra.run.smithi195.stdout:(100/127): python3-rsa-4.9-2.el8.noarch.rpm 589 kB/s | 64 kB 00:00 2024-04-25T02:07:51.993 INFO:teuthology.orchestra.run.smithi078.stdout:(80/127): leveldb-1.22-1.el8.x86_64.rpm 442 kB/s | 181 kB 00:00 2024-04-25T02:07:52.013 INFO:teuthology.orchestra.run.smithi195.stdout:(101/127): python3-singledispatch-3.4.0.3-18.el 317 kB/s | 24 kB 00:00 2024-04-25T02:07:52.038 INFO:teuthology.orchestra.run.smithi195.stdout:(102/127): python3-tempora-1.14.1-5.el8.noarch. 386 kB/s | 29 kB 00:00 2024-04-25T02:07:52.060 INFO:teuthology.orchestra.run.smithi078.stdout:(81/127): gperftools-libs-2.7-9.el8.x86_64.rpm 611 kB/s | 306 kB 00:00 2024-04-25T02:07:52.063 INFO:teuthology.orchestra.run.smithi195.stdout:(103/127): python3-trustme-0.6.0-4.el8.noarch.r 363 kB/s | 27 kB 00:00 2024-04-25T02:07:52.085 INFO:teuthology.orchestra.run.smithi078.stdout:(82/127): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 474 kB/s | 44 kB 00:00 2024-04-25T02:07:52.119 INFO:teuthology.orchestra.run.smithi078.stdout:(83/127): libunwind-1.3.1-3.el8.x86_64.rpm 474 kB/s | 75 kB 00:00 2024-04-25T02:07:52.124 INFO:teuthology.orchestra.run.smithi195.stdout:(104/127): python3-waitress-1.4.3-1.el8.noarch. 2.2 MB/s | 255 kB 00:00 2024-04-25T02:07:52.147 INFO:teuthology.orchestra.run.smithi195.stdout:(105/127): python3-websocket-client-0.56.0-5.el 731 kB/s | 61 kB 00:00 2024-04-25T02:07:52.161 INFO:teuthology.orchestra.run.smithi078.stdout:(84/127): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2024-04-25T02:07:52.173 INFO:teuthology.orchestra.run.smithi195.stdout:(106/127): python3-webob-1.8.5-1.el8.1.noarch.r 1.8 MB/s | 251 kB 00:00 2024-04-25T02:07:52.186 INFO:teuthology.orchestra.run.smithi078.stdout:(85/127): python3-cachetools-3.1.1-4.el8.noarch 328 kB/s | 33 kB 00:00 2024-04-25T02:07:52.198 INFO:teuthology.orchestra.run.smithi195.stdout:(107/127): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2024-04-25T02:07:52.215 INFO:teuthology.orchestra.run.smithi195.stdout:(108/127): python3-zc-lockfile-2.0-2.el8.noarch 341 kB/s | 23 kB 00:00 2024-04-25T02:07:52.236 INFO:teuthology.orchestra.run.smithi078.stdout:(86/127): python3-certifi-2018.10.15-7.el8.noar 139 kB/s | 16 kB 00:00 2024-04-25T02:07:52.262 INFO:teuthology.orchestra.run.smithi078.stdout:(87/127): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2024-04-25T02:07:52.299 INFO:teuthology.orchestra.run.smithi195.stdout:(109/127): librados2-16.2.15-0.el8.x86_64.rpm 30 MB/s | 3.7 MB 00:00 2024-04-25T02:07:52.329 INFO:teuthology.orchestra.run.smithi078.stdout:(88/127): python3-google-auth-1.1.1-10.el8.noar 883 kB/s | 81 kB 00:00 2024-04-25T02:07:52.354 INFO:teuthology.orchestra.run.smithi078.stdout:(89/127): python3-cherrypy-18.4.0-1.el8.noarch. 2.2 MB/s | 384 kB 00:00 2024-04-25T02:07:52.374 INFO:teuthology.orchestra.run.smithi195.stdout:(110/127): librbd1-16.2.15-0.el8.x86_64.rpm 24 MB/s | 4.2 MB 00:00 2024-04-25T02:07:52.379 INFO:teuthology.orchestra.run.smithi078.stdout:(90/127): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2024-04-25T02:07:52.421 INFO:teuthology.orchestra.run.smithi078.stdout:(91/127): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2024-04-25T02:07:52.483 INFO:teuthology.orchestra.run.smithi195.stdout:(111/127): NetworkManager-1.40.16-15.el8.x86_64 8.6 MB/s | 2.3 MB 00:00 2024-04-25T02:07:52.505 INFO:teuthology.orchestra.run.smithi078.stdout:(92/127): python3-logutils-0.3.5-11.el8.noarch. 389 kB/s | 49 kB 00:00 2024-04-25T02:07:52.525 INFO:teuthology.orchestra.run.smithi195.stdout:(112/127): NetworkManager-team-1.40.16-15.el8.x 1.0 MB/s | 161 kB 00:00 2024-04-25T02:07:52.530 INFO:teuthology.orchestra.run.smithi078.stdout:(93/127): python3-more-itertools-7.2.0-3.el8.no 540 kB/s | 59 kB 00:00 2024-04-25T02:07:52.592 INFO:teuthology.orchestra.run.smithi195.stdout:(113/127): NetworkManager-libnm-1.40.16-15.el8. 6.5 MB/s | 1.9 MB 00:00 2024-04-25T02:07:52.605 INFO:teuthology.orchestra.run.smithi078.stdout:(94/127): python3-kubernetes-11.0.0-6.el8.noarc 4.6 MB/s | 1.2 MB 00:00 2024-04-25T02:07:52.617 INFO:teuthology.orchestra.run.smithi195.stdout:(114/127): elfutils-debuginfod-client-0.190-2.e 836 kB/s | 77 kB 00:00 2024-04-25T02:07:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:(95/127): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2024-04-25T02:07:52.642 INFO:teuthology.orchestra.run.smithi195.stdout:(115/127): NetworkManager-tui-1.40.16-15.el8.x8 2.2 MB/s | 356 kB 00:00 2024-04-25T02:07:52.664 INFO:teuthology.orchestra.run.smithi078.stdout:(96/127): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2024-04-25T02:07:52.698 INFO:teuthology.orchestra.run.smithi078.stdout:(97/127): python3-repoze-lru-0.7-6.el8.noarch.r 365 kB/s | 34 kB 00:00 2024-04-25T02:07:52.709 INFO:teuthology.orchestra.run.smithi195.stdout:(116/127): elfutils-libelf-0.190-2.el8.x86_64.r 1.9 MB/s | 233 kB 00:00 2024-04-25T02:07:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:(117/127): elfutils-libs-0.190-2.el8.x86_64.rpm 2.5 MB/s | 305 kB 00:00 2024-04-25T02:07:52.765 INFO:teuthology.orchestra.run.smithi078.stdout:(98/127): python3-rsa-4.9-2.el8.noarch.rpm 641 kB/s | 64 kB 00:00 2024-04-25T02:07:52.768 INFO:teuthology.orchestra.run.smithi195.stdout:(118/127): iproute-6.2.0-5.el8.x86_64.rpm 6.7 MB/s | 854 kB 00:00 2024-04-25T02:07:52.790 INFO:teuthology.orchestra.run.smithi078.stdout:(99/127): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2024-04-25T02:07:52.815 INFO:teuthology.orchestra.run.smithi078.stdout:(100/127): python3-routes-2.4.1-12.el8.noarch.r 1.0 MB/s | 196 kB 00:00 2024-04-25T02:07:52.827 INFO:teuthology.orchestra.run.smithi195.stdout:(119/127): libblkid-2.32.1-46.el8.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-04-25T02:07:52.852 INFO:teuthology.orchestra.run.smithi195.stdout:(120/127): libfdisk-2.32.1-46.el8.x86_64.rpm 2.1 MB/s | 254 kB 00:00 2024-04-25T02:07:52.857 INFO:teuthology.orchestra.run.smithi078.stdout:(101/127): python3-singledispatch-3.4.0.3-18.el 259 kB/s | 24 kB 00:00 2024-04-25T02:07:52.883 INFO:teuthology.orchestra.run.smithi078.stdout:(102/127): python3-tempora-1.14.1-5.el8.noarch. 317 kB/s | 29 kB 00:00 2024-04-25T02:07:52.885 INFO:teuthology.orchestra.run.smithi195.stdout:(121/127): libmount-2.32.1-46.el8.x86_64.rpm 2.0 MB/s | 237 kB 00:00 2024-04-25T02:07:52.916 INFO:teuthology.orchestra.run.smithi078.stdout:(103/127): python3-trustme-0.6.0-4.el8.noarch.r 274 kB/s | 27 kB 00:00 2024-04-25T02:07:52.919 INFO:teuthology.orchestra.run.smithi195.stdout:(122/127): libsmartcols-2.32.1-46.el8.x86_64.rp 1.9 MB/s | 180 kB 00:00 2024-04-25T02:07:52.944 INFO:teuthology.orchestra.run.smithi195.stdout:(123/127): libuuid-2.32.1-46.el8.x86_64.rpm 1.1 MB/s | 99 kB 00:00 2024-04-25T02:07:52.991 INFO:teuthology.orchestra.run.smithi078.stdout:(104/127): python3-waitress-1.4.3-1.el8.noarch. 1.9 MB/s | 255 kB 00:00 2024-04-25T02:07:53.025 INFO:teuthology.orchestra.run.smithi078.stdout:(105/127): python3-websocket-client-0.56.0-5.el 563 kB/s | 61 kB 00:00 2024-04-25T02:07:53.028 INFO:teuthology.orchestra.run.smithi195.stdout:(124/127): openssl-1.1.1k-12.el8.x86_64.rpm 5.1 MB/s | 738 kB 00:00 2024-04-25T02:07:53.059 INFO:teuthology.orchestra.run.smithi078.stdout:(106/127): python3-webob-1.8.5-1.el8.1.noarch.r 1.4 MB/s | 251 kB 00:00 2024-04-25T02:07:53.084 INFO:teuthology.orchestra.run.smithi078.stdout:(107/127): python3-webtest-2.0.33-1.el8.noarch. 921 kB/s | 85 kB 00:00 2024-04-25T02:07:53.103 INFO:teuthology.orchestra.run.smithi195.stdout:(125/127): openssl-libs-1.1.1k-12.el8.x86_64.rp 8.0 MB/s | 1.5 MB 00:00 2024-04-25T02:07:53.126 INFO:teuthology.orchestra.run.smithi078.stdout:(108/127): python3-zc-lockfile-2.0-2.el8.noarch 228 kB/s | 23 kB 00:00 2024-04-25T02:07:53.128 INFO:teuthology.orchestra.run.smithi195.stdout:(126/127): util-linux-user-2.32.1-46.el8.x86_64 1.0 MB/s | 103 kB 00:00 2024-04-25T02:07:53.185 INFO:teuthology.orchestra.run.smithi078.stdout:(109/127): librados2-16.2.15-0.el8.x86_64.rpm 30 MB/s | 3.7 MB 00:00 2024-04-25T02:07:53.187 INFO:teuthology.orchestra.run.smithi195.stdout:(127/127): util-linux-2.32.1-46.el8.x86_64.rpm 11 MB/s | 2.6 MB 00:00 2024-04-25T02:07:53.190 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:07:53.190 INFO:teuthology.orchestra.run.smithi195.stdout:Total 30 MB/s | 209 MB 00:06 2024-04-25T02:07:53.285 INFO:teuthology.orchestra.run.smithi078.stdout:(110/127): librbd1-16.2.15-0.el8.x86_64.rpm 21 MB/s | 4.2 MB 00:00 2024-04-25T02:07:53.402 INFO:teuthology.orchestra.run.smithi078.stdout:(111/127): NetworkManager-1.40.16-15.el8.x86_64 8.3 MB/s | 2.3 MB 00:00 2024-04-25T02:07:53.452 INFO:teuthology.orchestra.run.smithi078.stdout:(112/127): NetworkManager-libnm-1.40.16-15.el8. 7.1 MB/s | 1.9 MB 00:00 2024-04-25T02:07:53.528 INFO:teuthology.orchestra.run.smithi078.stdout:(113/127): NetworkManager-team-1.40.16-15.el8.x 664 kB/s | 161 kB 00:00 2024-04-25T02:07:53.545 INFO:teuthology.orchestra.run.smithi078.stdout:(114/127): elfutils-debuginfod-client-0.190-2.e 836 kB/s | 77 kB 00:00 2024-04-25T02:07:53.570 INFO:teuthology.orchestra.run.smithi078.stdout:(115/127): NetworkManager-tui-1.40.16-15.el8.x8 2.1 MB/s | 356 kB 00:00 2024-04-25T02:07:53.628 INFO:teuthology.orchestra.run.smithi078.stdout:(116/127): elfutils-libelf-0.190-2.el8.x86_64.r 2.3 MB/s | 233 kB 00:00 2024-04-25T02:07:53.662 INFO:teuthology.orchestra.run.smithi078.stdout:(117/127): elfutils-libs-0.190-2.el8.x86_64.rpm 2.5 MB/s | 305 kB 00:00 2024-04-25T02:07:53.696 INFO:teuthology.orchestra.run.smithi078.stdout:(118/127): iproute-6.2.0-5.el8.x86_64.rpm 6.6 MB/s | 854 kB 00:00 2024-04-25T02:07:53.768 INFO:teuthology.orchestra.run.smithi078.stdout:(119/127): libblkid-2.32.1-46.el8.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-04-25T02:07:53.804 INFO:teuthology.orchestra.run.smithi078.stdout:(120/127): libfdisk-2.32.1-46.el8.x86_64.rpm 1.7 MB/s | 254 kB 00:00 2024-04-25T02:07:53.830 INFO:teuthology.orchestra.run.smithi078.stdout:(121/127): libmount-2.32.1-46.el8.x86_64.rpm 1.7 MB/s | 237 kB 00:00 2024-04-25T02:07:53.872 INFO:teuthology.orchestra.run.smithi078.stdout:(122/127): libsmartcols-2.32.1-46.el8.x86_64.rp 1.7 MB/s | 180 kB 00:00 2024-04-25T02:07:53.888 INFO:teuthology.orchestra.run.smithi078.stdout:(123/127): libuuid-2.32.1-46.el8.x86_64.rpm 1.2 MB/s | 99 kB 00:00 2024-04-25T02:07:53.964 INFO:teuthology.orchestra.run.smithi078.stdout:(124/127): openssl-1.1.1k-12.el8.x86_64.rpm 5.4 MB/s | 738 kB 00:00 2024-04-25T02:07:53.980 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-25T02:07:54.056 INFO:teuthology.orchestra.run.smithi078.stdout:(125/127): openssl-libs-1.1.1k-12.el8.x86_64.rp 8.0 MB/s | 1.5 MB 00:00 2024-04-25T02:07:54.081 INFO:teuthology.orchestra.run.smithi078.stdout:(126/127): util-linux-user-2.32.1-46.el8.x86_64 882 kB/s | 103 kB 00:00 2024-04-25T02:07:54.123 INFO:teuthology.orchestra.run.smithi078.stdout:(127/127): util-linux-2.32.1-46.el8.x86_64.rpm 11 MB/s | 2.6 MB 00:00 2024-04-25T02:07:54.125 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:07:54.125 INFO:teuthology.orchestra.run.smithi078.stdout:Total 28 MB/s | 209 MB 00:07 2024-04-25T02:07:54.241 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-25T02:07:54.241 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-25T02:07:54.920 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-04-25T02:07:55.183 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-04-25T02:07:55.184 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-04-25T02:07:55.743 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-25T02:07:55.746 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-25T02:07:56.587 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-04-25T02:07:56.591 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-04-25T02:08:00.668 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-25T02:08:00.836 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-25T02:08:01.053 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/146 2024-04-25T02:08:01.123 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/146 2024-04-25T02:08:01.319 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/146 2024-04-25T02:08:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/146 2024-04-25T02:08:01.751 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 4/146 2024-04-25T02:08:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 5/146 2024-04-25T02:08:02.037 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-04-25T02:08:02.146 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 6/146 2024-04-25T02:08:02.209 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-25T02:08:02.221 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 6/146 2024-04-25T02:08:02.418 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/146 2024-04-25T02:08:02.446 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 7/146 2024-04-25T02:08:02.493 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/146 2024-04-25T02:08:02.539 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 7/146 2024-04-25T02:08:02.711 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/146 2024-04-25T02:08:02.758 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 8/146 2024-04-25T02:08:02.937 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/146 2024-04-25T02:08:02.987 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/146 2024-04-25T02:08:03.191 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 4/146 2024-04-25T02:08:03.329 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/146 2024-04-25T02:08:03.352 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 5/146 2024-04-25T02:08:03.529 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:16.2.15-0.el8.x86_64 10/146 2024-04-25T02:08:03.535 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 6/146 2024-04-25T02:08:03.601 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 6/146 2024-04-25T02:08:03.836 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 7/146 2024-04-25T02:08:03.948 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.15-0.el8.x86_64 10/146 2024-04-25T02:08:03.957 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 7/146 2024-04-25T02:08:04.145 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:16.2.15-0.el8.x86_64 11/146 2024-04-25T02:08:04.223 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 8/146 2024-04-25T02:08:04.266 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.15-0.el8.x86_64 11/146 2024-04-25T02:08:04.435 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/146 2024-04-25T02:08:04.454 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:16.2.15-0.el8.x86_64 12/146 2024-04-25T02:08:04.817 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:16.2.15-0.el8.x86_64 12/146 2024-04-25T02:08:04.829 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/146 2024-04-25T02:08:05.012 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:16.2.15-0.el8.x86_64 13/146 2024-04-25T02:08:05.052 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:16.2.15-0.el8.x86_64 10/146 2024-04-25T02:08:05.089 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:16.2.15-0.el8.x86_64 13/146 2024-04-25T02:08:05.282 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:16.2.15-0.el8.x86_64 14/146 2024-04-25T02:08:05.464 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.15-0.el8.x86_64 10/146 2024-04-25T02:08:05.566 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/146 2024-04-25T02:08:05.636 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:16.2.15-0.el8.x86_64 11/146 2024-04-25T02:08:05.776 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/146 2024-04-25T02:08:05.788 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.15-0.el8.x86_64 11/146 2024-04-25T02:08:05.944 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:16.2.15-0.el8.x86_64 12/146 2024-04-25T02:08:05.953 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:16.2.15-0.el8.x86_64 17/146 2024-04-25T02:08:06.058 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:16.2.15-0.el8.x86_64 17/146 2024-04-25T02:08:06.187 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:16.2.15-0.el8.x86_64 18/146 2024-04-25T02:08:06.329 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:16.2.15-0.el8.x86_64 12/146 2024-04-25T02:08:06.518 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:16.2.15-0.el8.x86_64 13/146 2024-04-25T02:08:06.555 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:16.2.15-0.el8.x86_64 18/146 2024-04-25T02:08:06.603 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:16.2.15-0.el8.x86_64 13/146 2024-04-25T02:08:06.812 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 19/146 2024-04-25T02:08:06.822 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:16.2.15-0.el8.x86_64 14/146 2024-04-25T02:08:06.871 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 19/146 2024-04-25T02:08:07.082 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/146 2024-04-25T02:08:07.111 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 20/146 2024-04-25T02:08:07.317 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/146 2024-04-25T02:08:07.402 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 20/146 2024-04-25T02:08:07.477 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:16.2.15-0.el8.x86_64 17/146 2024-04-25T02:08:07.629 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:16.2.15-0.el8.x86_64 17/146 2024-04-25T02:08:07.791 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 20/146 2024-04-25T02:08:07.827 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:16.2.15-0.el8.x86_64 18/146 2024-04-25T02:08:07.984 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 21/146 2024-04-25T02:08:08.156 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:16.2.15-0.el8.x86_64 18/146 2024-04-25T02:08:08.192 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 22/146 2024-04-25T02:08:08.345 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 23/146 2024-04-25T02:08:08.452 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 19/146 2024-04-25T02:08:08.485 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 23/146 2024-04-25T02:08:08.517 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 19/146 2024-04-25T02:08:08.687 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 24/146 2024-04-25T02:08:08.768 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 20/146 2024-04-25T02:08:09.084 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 20/146 2024-04-25T02:08:09.263 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 24/146 2024-04-25T02:08:09.470 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.15-4.el8.x86_64 25/146 2024-04-25T02:08:09.492 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 20/146 2024-04-25T02:08:09.724 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 21/146 2024-04-25T02:08:09.882 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 22/146 2024-04-25T02:08:10.060 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 23/146 2024-04-25T02:08:10.090 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 25/146 2024-04-25T02:08:10.210 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 23/146 2024-04-25T02:08:10.278 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 26/146 2024-04-25T02:08:10.385 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 24/146 2024-04-25T02:08:11.002 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 26/146 2024-04-25T02:08:11.010 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 24/146 2024-04-25T02:08:11.210 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.15-4.el8.x86_64 25/146 2024-04-25T02:08:11.537 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 27/146 2024-04-25T02:08:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 28/146 2024-04-25T02:08:11.829 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 25/146 2024-04-25T02:08:12.025 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:16.2.15-0.el8.x86_64 29/146 2024-04-25T02:08:12.051 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 26/146 2024-04-25T02:08:12.233 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 30/146 2024-04-25T02:08:12.456 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:16.2.15-0.el8.x86_64 31/146 2024-04-25T02:08:12.661 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/146 2024-04-25T02:08:12.739 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 26/146 2024-04-25T02:08:13.044 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 27/146 2024-04-25T02:08:13.246 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 28/146 2024-04-25T02:08:13.523 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:16.2.15-0.el8.x86_64 29/146 2024-04-25T02:08:13.673 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 30/146 2024-04-25T02:08:13.923 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:16.2.15-0.el8.x86_64 31/146 2024-04-25T02:08:14.126 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/146 2024-04-25T02:08:14.418 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/146 2024-04-25T02:08:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 33/146 2024-04-25T02:08:14.927 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 34/146 2024-04-25T02:08:15.161 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el8.noarch 35/146 2024-04-25T02:08:15.363 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:16.2.15-0.el8.x86_64 36/146 2024-04-25T02:08:15.550 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:16.2.15-0.el8.x86_64 37/146 2024-04-25T02:08:15.780 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:16.2.15-0.el8.x86_64 38/146 2024-04-25T02:08:15.901 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/146 2024-04-25T02:08:15.932 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/146 2024-04-25T02:08:16.091 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/146 2024-04-25T02:08:16.352 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 41/146 2024-04-25T02:08:16.397 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 33/146 2024-04-25T02:08:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 41/146 2024-04-25T02:08:16.586 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 34/146 2024-04-25T02:08:16.602 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 42/146 2024-04-25T02:08:16.813 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 42/146 2024-04-25T02:08:16.843 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el8.noarch 35/146 2024-04-25T02:08:17.029 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:16.2.15-0.el8.x86_64 36/146 2024-04-25T02:08:17.231 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:16.2.15-0.el8.x86_64 37/146 2024-04-25T02:08:17.364 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 43/146 2024-04-25T02:08:17.438 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:16.2.15-0.el8.x86_64 38/146 2024-04-25T02:08:17.549 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 44/146 2024-04-25T02:08:17.606 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/146 2024-04-25T02:08:17.822 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/146 2024-04-25T02:08:18.101 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 41/146 2024-04-25T02:08:18.135 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 44/146 2024-04-25T02:08:18.167 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 41/146 2024-04-25T02:08:18.385 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 45/146 2024-04-25T02:08:18.392 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 42/146 2024-04-25T02:08:18.399 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 45/146 2024-04-25T02:08:18.583 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 42/146 2024-04-25T02:08:18.612 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 46/146 2024-04-25T02:08:18.821 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 43/146 2024-04-25T02:08:18.851 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 47/146 2024-04-25T02:08:19.069 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 44/146 2024-04-25T02:08:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 48/146 2024-04-25T02:08:19.297 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/146 2024-04-25T02:08:19.478 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/146 2024-04-25T02:08:19.563 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 44/146 2024-04-25T02:08:19.650 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/146 2024-04-25T02:08:19.844 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/146 2024-04-25T02:08:19.876 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 45/146 2024-04-25T02:08:19.890 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 45/146 2024-04-25T02:08:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/146 2024-04-25T02:08:20.103 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 46/146 2024-04-25T02:08:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/146 2024-04-25T02:08:20.350 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/146 2024-04-25T02:08:20.367 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 47/146 2024-04-25T02:08:20.533 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 56/146 2024-04-25T02:08:20.593 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 48/146 2024-04-25T02:08:20.758 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 57/146 2024-04-25T02:08:20.763 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/146 2024-04-25T02:08:20.952 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/146 2024-04-25T02:08:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 58/146 2024-04-25T02:08:21.176 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/146 2024-04-25T02:08:21.211 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 59/146 2024-04-25T02:08:21.402 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/146 2024-04-25T02:08:21.444 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 60/146 2024-04-25T02:08:21.595 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/146 2024-04-25T02:08:21.648 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 61/146 2024-04-25T02:08:21.884 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 62/146 2024-04-25T02:08:22.098 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 63/146 2024-04-25T02:08:22.247 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/146 2024-04-25T02:08:22.433 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/146 2024-04-25T02:08:22.463 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 64/146 2024-04-25T02:08:22.616 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 56/146 2024-04-25T02:08:22.771 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 65/146 2024-04-25T02:08:22.866 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 57/146 2024-04-25T02:08:22.978 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 66/146 2024-04-25T02:08:23.114 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 58/146 2024-04-25T02:08:23.245 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 67/146 2024-04-25T02:08:23.318 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 59/146 2024-04-25T02:08:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 68/146 2024-04-25T02:08:23.543 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 60/146 2024-04-25T02:08:23.785 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 61/146 2024-04-25T02:08:23.989 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 62/146 2024-04-25T02:08:24.213 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 63/146 2024-04-25T02:08:24.518 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 69/146 2024-04-25T02:08:24.613 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 64/146 2024-04-25T02:08:24.725 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 70/146 2024-04-25T02:08:24.861 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 65/146 2024-04-25T02:08:24.949 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/146 2024-04-25T02:08:25.093 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 66/146 2024-04-25T02:08:25.168 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/146 2024-04-25T02:08:25.362 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 67/146 2024-04-25T02:08:25.436 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 73/146 2024-04-25T02:08:25.613 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 68/146 2024-04-25T02:08:25.620 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 74/146 2024-04-25T02:08:25.929 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 75/146 2024-04-25T02:08:26.105 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 76/146 2024-04-25T02:08:26.269 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 77/146 2024-04-25T02:08:26.437 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 78/146 2024-04-25T02:08:26.672 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 69/146 2024-04-25T02:08:26.803 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 79/146 2024-04-25T02:08:26.925 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 70/146 2024-04-25T02:08:27.012 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 80/146 2024-04-25T02:08:27.167 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/146 2024-04-25T02:08:27.178 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 81/146 2024-04-25T02:08:27.396 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 82/146 2024-04-25T02:08:27.476 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/146 2024-04-25T02:08:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 83/146 2024-04-25T02:08:27.744 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 73/146 2024-04-25T02:08:27.884 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.7-19.el8.x86_64 84/146 2024-04-25T02:08:27.969 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 74/146 2024-04-25T02:08:28.114 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 85/146 2024-04-25T02:08:28.245 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 75/146 2024-04-25T02:08:28.270 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 86/146 2024-04-25T02:08:28.438 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 76/146 2024-04-25T02:08:28.506 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 87/146 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 77/146 2024-04-25T02:08:28.762 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-2.6-1.el8.noarch 88/146 2024-04-25T02:08:28.763 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 78/146 2024-04-25T02:08:29.051 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/146 2024-04-25T02:08:29.101 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 79/146 2024-04-25T02:08:29.201 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 90/146 2024-04-25T02:08:29.387 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 80/146 2024-04-25T02:08:29.579 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 81/146 2024-04-25T02:08:29.790 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 82/146 2024-04-25T02:08:30.009 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 83/146 2024-04-25T02:08:30.242 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.7-19.el8.x86_64 84/146 2024-04-25T02:08:30.506 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 85/146 2024-04-25T02:08:30.677 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 86/146 2024-04-25T02:08:30.938 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 87/146 2024-04-25T02:08:31.241 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-2.6-1.el8.noarch 88/146 2024-04-25T02:08:31.532 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/146 2024-04-25T02:08:31.706 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 91/146 2024-04-25T02:08:31.716 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 90/146 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:16.2.15-0.el8.x86_64 91/146 2024-04-25T02:08:32.615 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 91/146 2024-04-25T02:08:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:16.2.15-0.el8.x86_64 92/146 2024-04-25T02:08:33.070 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64 92/146 2024-04-25T02:08:33.216 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:16.2.15-0.el8.x86_64 93/146 2024-04-25T02:08:34.261 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 91/146 2024-04-25T02:08:34.524 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:16.2.15-0.el8.x86_64 91/146 2024-04-25T02:08:35.230 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 91/146 2024-04-25T02:08:35.589 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:16.2.15-0.el8.x86_64 92/146 2024-04-25T02:08:35.705 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64 92/146 2024-04-25T02:08:35.873 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:16.2.15-0.el8.x86_64 93/146 2024-04-25T02:08:52.733 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:16.2.15-0.el8.x86_64 93/146 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /run 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2024-04-25T02:08:52.734 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:08:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:16.2.15-0.el8.x86_64 94/146 2024-04-25T02:08:53.565 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64 94/146 2024-04-25T02:08:53.772 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:16.2.15-0.el8.x86_64 95/146 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:16.2.15-0.el8.x86_64 93/146 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /run 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2024-04-25T02:08:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2024-04-25T02:08:55.147 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:08:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64 95/146 2024-04-25T02:08:55.513 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:16.2.15-0.el8.x86_64 96/146 2024-04-25T02:08:55.548 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64 96/146 2024-04-25T02:08:55.588 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:16.2.15-0.el8.x86_64 94/146 2024-04-25T02:08:55.764 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 97/146 2024-04-25T02:08:56.030 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64 94/146 2024-04-25T02:08:56.102 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 98/146 2024-04-25T02:08:56.221 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:16.2.15-0.el8.x86_64 95/146 2024-04-25T02:08:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/146 2024-04-25T02:08:56.604 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/146 2024-04-25T02:08:56.799 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/146 2024-04-25T02:08:56.954 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 102/146 2024-04-25T02:08:57.036 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 102/146 2024-04-25T02:08:57.232 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-8.el8.x86_64 103/146 2024-04-25T02:08:57.395 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 104/146 2024-04-25T02:08:57.734 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64 95/146 2024-04-25T02:08:57.946 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:16.2.15-0.el8.x86_64 96/146 2024-04-25T02:08:57.979 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64 96/146 2024-04-25T02:08:58.238 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 97/146 2024-04-25T02:08:58.462 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 105/146 2024-04-25T02:08:58.561 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 98/146 2024-04-25T02:08:58.769 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 106/146 2024-04-25T02:08:58.818 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/146 2024-04-25T02:08:59.223 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/146 2024-04-25T02:08:59.440 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/146 2024-04-25T02:08:59.604 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 102/146 2024-04-25T02:08:59.689 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 102/146 2024-04-25T02:08:59.805 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 106/146 2024-04-25T02:08:59.923 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jq-1.6-8.el8.x86_64 103/146 2024-04-25T02:09:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.no 107/146 2024-04-25T02:09:00.077 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 104/146 2024-04-25T02:09:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.no 107/146 2024-04-25T02:09:00.557 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 108/146 2024-04-25T02:09:00.770 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:16.2.15-0.el8.x86_64 109/146 2024-04-25T02:09:00.795 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64 109/146 2024-04-25T02:09:00.979 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:16.2.15-0.el8.noarch 110/146 2024-04-25T02:09:00.989 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.15-0.el8.noarch 110/146 2024-04-25T02:09:01.137 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 105/146 2024-04-25T02:09:01.427 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 106/146 2024-04-25T02:09:02.465 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 106/146 2024-04-25T02:09:02.678 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.no 107/146 2024-04-25T02:09:02.768 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.no 107/146 2024-04-25T02:09:03.153 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 108/146 2024-04-25T02:09:03.370 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:16.2.15-0.el8.x86_64 109/146 2024-04-25T02:09:03.395 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64 109/146 2024-04-25T02:09:03.561 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:16.2.15-0.el8.noarch 110/146 2024-04-25T02:09:03.572 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.15-0.el8.noarch 110/146 2024-04-25T02:09:05.656 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:16.2.15-0.el8.x86_64 111/146 2024-04-25T02:09:06.897 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:16.2.15-0.el8.x86_64 112/146 2024-04-25T02:09:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:16.2.15-0.el8.x86_64 113/146 2024-04-25T02:09:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64 113/146 2024-04-25T02:09:07.736 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:16.2.15-0.el8.x86_64 114/146 2024-04-25T02:09:07.829 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64 114/146 2024-04-25T02:09:08.258 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:16.2.15-0.el8.x86_64 111/146 2024-04-25T02:09:08.698 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:16.2.15-0.el8.x86_64 115/146 2024-04-25T02:09:08.982 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 116/146 2024-04-25T02:09:09.133 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 117/146 2024-04-25T02:09:09.323 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 118/146 2024-04-25T02:09:09.455 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:16.2.15-0.el8.x86_64 112/146 2024-04-25T02:09:09.498 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:16.2.15-0.el8.x86_64 119/146 2024-04-25T02:09:09.681 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 120/146 2024-04-25T02:09:09.702 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:16.2.15-0.el8.x86_64 113/146 2024-04-25T02:09:09.869 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 121/146 2024-04-25T02:09:10.085 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:16.2.15-0.el8.x86_64 122/146 2024-04-25T02:09:10.104 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64 113/146 2024-04-25T02:09:10.269 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:16.2.15-0.el8.x86_64 114/146 2024-04-25T02:09:10.363 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64 114/146 2024-04-25T02:09:10.406 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:16.2.15-0.el8.x86_64 123/146 2024-04-25T02:09:10.719 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 124/146 2024-04-25T02:09:10.958 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 125/146 2024-04-25T02:09:11.227 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.1-9.el8.x86_64 126/146 2024-04-25T02:09:11.236 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:16.2.15-0.el8.x86_64 115/146 2024-04-25T02:09:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 126/146 2024-04-25T02:09:11.524 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 116/146 2024-04-25T02:09:11.627 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.0.4-10.el8.x86_64 127/146 2024-04-25T02:09:11.639 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 127/146 2024-04-25T02:09:11.724 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 117/146 2024-04-25T02:09:11.778 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 128/146 2024-04-25T02:09:11.939 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 118/146 2024-04-25T02:09:11.970 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 129/146 2024-04-25T02:09:12.114 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:16.2.15-0.el8.x86_64 119/146 2024-04-25T02:09:12.121 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 130/146 2024-04-25T02:09:12.323 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 120/146 2024-04-25T02:09:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 131/146 2024-04-25T02:09:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/146 2024-04-25T02:09:12.543 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 121/146 2024-04-25T02:09:12.580 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/146 2024-04-25T02:09:12.580 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/146 2024-04-25T02:09:12.793 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:16.2.15-0.el8.x86_64 122/146 2024-04-25T02:09:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/146 2024-04-25T02:09:12.995 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 134/146 2024-04-25T02:09:13.090 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:16.2.15-0.el8.x86_64 123/146 2024-04-25T02:09:13.128 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 135/146 2024-04-25T02:09:13.362 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 136/146 2024-04-25T02:09:13.362 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 137/146 2024-04-25T02:09:13.451 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 124/146 2024-04-25T02:09:13.546 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 137/146 2024-04-25T02:09:13.546 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 138/146 2024-04-25T02:09:13.749 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 125/146 2024-04-25T02:09:13.755 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 138/146 2024-04-25T02:09:13.755 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 139/146 2024-04-25T02:09:13.973 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 139/146 2024-04-25T02:09:14.026 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.1-9.el8.x86_64 126/146 2024-04-25T02:09:14.121 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 140/146 2024-04-25T02:09:14.124 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 126/146 2024-04-25T02:09:14.135 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 141/146 2024-04-25T02:09:14.136 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 141/146 2024-04-25T02:09:14.410 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.0.4-10.el8.x86_64 127/146 2024-04-25T02:09:14.423 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 127/146 2024-04-25T02:09:14.570 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 141/146 2024-04-25T02:09:14.571 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 142/146 2024-04-25T02:09:14.637 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 128/146 2024-04-25T02:09:14.804 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 142/146 2024-04-25T02:09:14.804 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 143/146 2024-04-25T02:09:14.849 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 129/146 2024-04-25T02:09:14.987 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 143/146 2024-04-25T02:09:14.987 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 144/146 2024-04-25T02:09:15.021 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 130/146 2024-04-25T02:09:15.195 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 144/146 2024-04-25T02:09:15.229 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 131/146 2024-04-25T02:09:15.229 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/146 2024-04-25T02:09:15.379 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 145/146 2024-04-25T02:09:15.380 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 146/146 2024-04-25T02:09:15.480 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/146 2024-04-25T02:09:15.480 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/146 2024-04-25T02:09:15.758 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/146 2024-04-25T02:09:15.970 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 134/146 2024-04-25T02:09:16.145 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 135/146 2024-04-25T02:09:16.265 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 146/146 2024-04-25T02:09:16.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:16.2.15-0.el8.x86_64 1/146 2024-04-25T02:09:16.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:16.2.15-0.el8.x86_64 2/146 2024-04-25T02:09:16.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:16.2.15-0.el8.x86_64 3/146 2024-04-25T02:09:16.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:16.2.15-0.el8.x86_64 4/146 2024-04-25T02:09:16.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:16.2.15-0.el8.x86_64 5/146 2024-04-25T02:09:16.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:16.2.15-0.el8.x86_64 6/146 2024-04-25T02:09:16.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:16.2.15-0.el8.x86_64 7/146 2024-04-25T02:09:16.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:16.2.15-0.el8.x86_64 8/146 2024-04-25T02:09:16.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:16.2.15-0.el8.x86_64 9/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:16.2.15-0.el8.x86_64 10/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:16.2.15-0.el8.x86_64 11/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:16.2.15-0.el8.x86_64 12/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:16.2.15-0.el8.x86_64 13/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:16.2.15-0.el8.x86_64 14/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:16.2.15-0.el8.x86_64 15/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:16.2.15-0.el8.x86_64 16/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:16.2.15-0.el8.x86_64 17/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 18/146 2024-04-25T02:09:16.267 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:16.2.15-0.el8.x86_64 19/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:16.2.15-0.el8.x86_64 20/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:16.2.15-0.el8.x86_64 21/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:16.2.15-0.el8.x86_64 22/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:16.2.15-0.el8.x86_64 23/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:16.2.15-0.el8.x86_64 24/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:16.2.15-0.el8.x86_64 25/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:16.2.15-0.el8.x86_64 26/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 27/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 28/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.no 29/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 30/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:16.2.15-0.el8.noarch 31/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 32/146 2024-04-25T02:09:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-8.el8.x86_64 35/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 36/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 38/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/146 2024-04-25T02:09:16.269 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 52/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 56/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 57/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/146 2024-04-25T02:09:16.270 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 61/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 62/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 63/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 68/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 73/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/146 2024-04-25T02:09:16.271 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/146 2024-04-25T02:09:16.272 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/146 2024-04-25T02:09:16.273 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.15-0.el8.x86_64 109/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.15-0.el8.x86_64 111/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 113/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 114/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 115/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 116/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 117/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 118/146 2024-04-25T02:09:16.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 119/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 120/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 121/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 122/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 123/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 124/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 125/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 126/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 127/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 128/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 129/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 130/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 131/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 132/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 133/146 2024-04-25T02:09:16.275 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 134/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 135/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 136/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 137/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 138/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 139/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 140/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 141/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 142/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 143/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 144/146 2024-04-25T02:09:16.276 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 145/146 2024-04-25T02:09:16.395 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 136/146 2024-04-25T02:09:16.396 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 137/146 2024-04-25T02:09:16.704 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 137/146 2024-04-25T02:09:16.704 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 138/146 2024-04-25T02:09:16.943 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 138/146 2024-04-25T02:09:16.943 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 139/146 2024-04-25T02:09:17.155 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 139/146 2024-04-25T02:09:17.329 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 140/146 2024-04-25T02:09:17.345 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 141/146 2024-04-25T02:09:17.345 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 141/146 2024-04-25T02:09:17.846 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 141/146 2024-04-25T02:09:17.846 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 142/146 2024-04-25T02:09:18.060 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 146/146 2024-04-25T02:09:18.061 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:18.061 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-04-25T02:09:18.061 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-04-25T02:09:18.061 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-04-25T02:09:18.061 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-04-25T02:09:18.061 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-04-25T02:09:18.061 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-25T02:09:18.061 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-25T02:09:18.061 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: iproute-6.2.0-5.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.0.4-10.el8.x86_64 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.065 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.065 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.065 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.065 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 2024-04-25T02:09:18.065 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.065 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:16.2.15-0.el8.noarch 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-25T02:09:18.066 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.1-9.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: jq-1.6-8.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: leveldb-1.22-1.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-25T02:09:18.069 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-25T02:09:18.069 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-25T02:09:18.069 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-25T02:09:18.069 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-25T02:09:18.069 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-25T02:09:18.069 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-25T02:09:18.069 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-25T02:09:18.069 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-2.6-1.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.072 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-25T02:09:18.073 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-25T02:09:18.074 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.074 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.074 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:18.074 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-25T02:09:18.074 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-25T02:09:18.074 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-25T02:09:18.074 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:18.075 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-25T02:09:18.120 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 142/146 2024-04-25T02:09:18.120 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 143/146 2024-04-25T02:09:18.255 DEBUG:teuthology.parallel:result is None 2024-04-25T02:09:18.379 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 143/146 2024-04-25T02:09:18.379 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 144/146 2024-04-25T02:09:18.578 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 144/146 2024-04-25T02:09:18.746 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 145/146 2024-04-25T02:09:18.746 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 146/146 2024-04-25T02:09:19.628 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 146/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:16.2.15-0.el8.x86_64 1/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:16.2.15-0.el8.x86_64 2/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:16.2.15-0.el8.x86_64 3/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:16.2.15-0.el8.x86_64 4/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:16.2.15-0.el8.x86_64 5/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:16.2.15-0.el8.x86_64 6/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:16.2.15-0.el8.x86_64 7/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:16.2.15-0.el8.x86_64 8/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:16.2.15-0.el8.x86_64 9/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:16.2.15-0.el8.x86_64 10/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:16.2.15-0.el8.x86_64 11/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:16.2.15-0.el8.x86_64 12/146 2024-04-25T02:09:19.629 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:16.2.15-0.el8.x86_64 13/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:16.2.15-0.el8.x86_64 14/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:16.2.15-0.el8.x86_64 15/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:16.2.15-0.el8.x86_64 16/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:16.2.15-0.el8.x86_64 17/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 18/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:16.2.15-0.el8.x86_64 19/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:16.2.15-0.el8.x86_64 20/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:16.2.15-0.el8.x86_64 21/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:16.2.15-0.el8.x86_64 22/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:16.2.15-0.el8.x86_64 23/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:16.2.15-0.el8.x86_64 24/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:16.2.15-0.el8.x86_64 25/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:16.2.15-0.el8.x86_64 26/146 2024-04-25T02:09:19.630 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 27/146 2024-04-25T02:09:19.631 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 28/146 2024-04-25T02:09:19.631 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.no 29/146 2024-04-25T02:09:19.641 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 30/146 2024-04-25T02:09:19.641 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:16.2.15-0.el8.noarch 31/146 2024-04-25T02:09:19.641 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 32/146 2024-04-25T02:09:19.641 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/146 2024-04-25T02:09:19.641 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/146 2024-04-25T02:09:19.641 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jq-1.6-8.el8.x86_64 35/146 2024-04-25T02:09:19.641 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 36/146 2024-04-25T02:09:19.641 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/146 2024-04-25T02:09:19.641 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 38/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/146 2024-04-25T02:09:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 52/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 56/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 57/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 61/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 62/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 63/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/146 2024-04-25T02:09:19.643 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 68/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 73/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/146 2024-04-25T02:09:19.644 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/146 2024-04-25T02:09:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.15-0.el8.x86_64 109/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/146 2024-04-25T02:09:19.646 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.15-0.el8.x86_64 111/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 113/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 114/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 115/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 116/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 117/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 118/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 119/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 120/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 121/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 122/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 123/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 124/146 2024-04-25T02:09:19.647 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 125/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 126/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 127/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 128/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 129/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 130/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 131/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 132/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 133/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 134/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 135/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 136/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 137/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 138/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 139/146 2024-04-25T02:09:19.648 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 140/146 2024-04-25T02:09:19.649 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 141/146 2024-04-25T02:09:19.649 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 142/146 2024-04-25T02:09:19.649 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 143/146 2024-04-25T02:09:19.649 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 144/146 2024-04-25T02:09:19.649 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 145/146 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 146/146 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: iproute-6.2.0-5.el8.x86_64 2024-04-25T02:09:21.579 INFO:teuthology.orchestra.run.smithi078.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.0.4-10.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.580 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:16.2.15-0.el8.noarch 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-25T02:09:21.581 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.1-9.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: jq-1.6-8.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: leveldb-1.22-1.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.582 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-25T02:09:21.583 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-25T02:09:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-2.6-1.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-25T02:09:21.585 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-25T02:09:21.586 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:16.2.15-0.el8.x86_64 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-25T02:09:21.587 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-25T02:09:21.588 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-25T02:09:21.588 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:21.588 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-04-25T02:09:21.791 DEBUG:teuthology.parallel:result is None 2024-04-25T02:09:21.792 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:09:21.792 INFO:teuthology.packaging:ref: None 2024-04-25T02:09:21.792 INFO:teuthology.packaging:tag: None 2024-04-25T02:09:21.792 INFO:teuthology.packaging:branch: pacific 2024-04-25T02:09:21.792 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:09:21.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-04-25T02:09:21.991 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:09:22.015 INFO:teuthology.orchestra.run.smithi078.stdout:16.2.15-0.el8 2024-04-25T02:09:22.016 INFO:teuthology.packaging:The installed version of ceph is 16.2.15-0.el8 2024-04-25T02:09:22.016 INFO:teuthology.task.install:The correct ceph version 16.2.15-0 is installed. 2024-04-25T02:09:22.018 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:09:22.018 INFO:teuthology.packaging:ref: None 2024-04-25T02:09:22.018 INFO:teuthology.packaging:tag: None 2024-04-25T02:09:22.018 INFO:teuthology.packaging:branch: pacific 2024-04-25T02:09:22.018 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:09:22.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-04-25T02:09:22.215 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:09:22.243 INFO:teuthology.orchestra.run.smithi195.stdout:16.2.15-0.el8 2024-04-25T02:09:22.243 INFO:teuthology.packaging:The installed version of ceph is 16.2.15-0.el8 2024-04-25T02:09:22.243 INFO:teuthology.task.install:The correct ceph version 16.2.15-0 is installed. 2024-04-25T02:09:22.245 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T02:09:22.245 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:22.245 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:09:22.275 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:09:22.275 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:09:22.318 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T02:09:22.319 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:22.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:09:22.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:09:22.412 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:09:22.412 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:09:22.442 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:09:22.510 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T02:09:22.511 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:22.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:09:22.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:09:22.604 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:09:22.604 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:09:22.631 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:09:22.699 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T02:09:22.699 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:22.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:09:22.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:09:22.792 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:09:22.792 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:09:22.819 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:09:22.886 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:09:22.895 INFO:teuthology.task.print:**** done installing pacific 2024-04-25T02:09:22.895 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T02:09:22.991 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T02:09:22.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-04-25T02:09:22.993 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-04-25T02:09:23.019 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T02:09:23.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:09:23.059 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:09:23.085 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T02:09:23.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:09:23.127 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:09:23.162 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T02:09:23.162 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T02:09:23.163 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371', 'branch': 'squid', 'description': 'fs/upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/blogbench}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672371', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.dir_split']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbpCV1bgL7ue9D583Nfcg23/xDW5nEmlm3PWRffZ9YkyTXr+rI/BCPoJgvh1+jeg8CAPoV0B/zPgCDYsPHhx/s=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF3jPYSXHtG3jFz7pYyhb4zwF8aH3kncdjLXJxfDrIi/0D/tPz0XG7R4vJdaCQr1WiOKRQCpcgAN+L+ZEQzZhoU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'flavor': 'default', 'fs': 'xfs', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': {'branch': 'reef'}}}, {'print': '**** done install.upgrade on client.0'}, {'ceph.healthy': None}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['suites/blogbench.sh']}}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T02:09:23.163 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:09:23.193 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:09:23.211 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:09:23.250 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:09:23.278 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:23.278 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:09:23.331 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:09:23.331 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-04-25T02:09:23.388 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:09:23.388 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:09:23.389 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 168363 Links: 1 2024-04-25T02:09:23.389 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:09:23.389 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:09:23.389 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-04-25 02:09:19.274988415 +0000 2024-04-25T02:09:23.389 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-04-25 02:06:48.575302209 +0000 2024-04-25T02:09:23.389 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-04-25 02:06:48.575302209 +0000 2024-04-25T02:09:23.389 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-04-25T02:09:23.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:09:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-04-25T02:09:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-04-25T02:09:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000232638 s, 2.2 MB/s 2024-04-25T02:09:23.456 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:09:23.515 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-04-25T02:09:23.572 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:09:23.572 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:09:23.572 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 166739 Links: 1 2024-04-25T02:09:23.573 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:09:23.573 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:09:23.573 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-04-25 02:09:19.274988415 +0000 2024-04-25T02:09:23.573 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-04-25 02:06:48.902297513 +0000 2024-04-25T02:09:23.573 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-04-25 02:06:48.902297513 +0000 2024-04-25T02:09:23.573 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-04-25T02:09:23.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:09:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-04-25T02:09:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-04-25T02:09:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000206013 s, 2.5 MB/s 2024-04-25T02:09:23.638 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:09:23.696 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-04-25T02:09:23.753 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:09:23.754 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:09:23.754 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 169224 Links: 1 2024-04-25T02:09:23.754 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:09:23.754 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:09:23.754 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-04-25 02:09:19.274988415 +0000 2024-04-25T02:09:23.754 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-04-25 02:06:49.281292070 +0000 2024-04-25T02:09:23.754 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-04-25 02:06:49.281292070 +0000 2024-04-25T02:09:23.754 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-04-25T02:09:23.754 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:09:23.819 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-04-25T02:09:23.819 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-04-25T02:09:23.819 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000156162 s, 3.3 MB/s 2024-04-25T02:09:23.820 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:09:23.878 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-04-25T02:09:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:09:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:09:23.938 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 166860 Links: 1 2024-04-25T02:09:23.938 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:09:23.938 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:09:23.938 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-04-25 02:09:19.274988415 +0000 2024-04-25T02:09:23.938 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-04-25 02:06:49.623287159 +0000 2024-04-25T02:09:23.938 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-04-25 02:06:49.623287159 +0000 2024-04-25T02:09:23.938 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-04-25T02:09:23.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:09:24.003 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-04-25T02:09:24.003 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-04-25T02:09:24.003 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000207015 s, 2.5 MB/s 2024-04-25T02:09:24.004 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:09:24.062 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:09:24.062 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:09:24.062 INFO:tasks.ceph:Generating config... 2024-04-25T02:09:24.063 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-04-25T02:09:24.064 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-04-25T02:09:24.064 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-04-25T02:09:24.064 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T02:09:24.064 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T02:09:24.064 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T02:09:24.064 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T02:09:24.064 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T02:09:24.064 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T02:09:24.064 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T02:09:24.064 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T02:09:24.064 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T02:09:24.064 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T02:09:24.064 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T02:09:24.064 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T02:09:24.065 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T02:09:24.065 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T02:09:24.065 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T02:09:24.065 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T02:09:24.065 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T02:09:24.066 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T02:09:24.067 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T02:09:24.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T02:09:24.303 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T02:09:24.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T02:09:24.346 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:09:24.413 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]'), ('mon.c', '[v2:172.21.15.78:3302,v1:172.21.15.78:6791]')] 2024-04-25T02:09:24.413 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],[v2:172.21.15.78:3302,v1:172.21.15.78:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T02:09:24.414 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:24.414 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:09:24.471 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --addv b '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]' --addv c '[v2:172.21.15.78:3302,v1:172.21.15.78:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:09:24.554 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid c7765ec7-39fd-490f-9c17-2b734a0c4de0 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:fsid c7765ec7-39fd-490f-9c17-2b734a0c4de0 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2024-04-25T02:09:24.548408+0000 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-04-25T02:09:24.548408+0000 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 0 (unknown) 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.b 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] mon.c 2024-04-25T02:09:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T02:09:24.556 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:09:24.613 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c7765ec7-39fd-490f-9c17-2b734a0c4de0... 2024-04-25T02:09:24.614 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:09:24.657 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:09:24.698 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-04-25T02:09:24.698 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.699 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-04-25T02:09:24.700 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],[v2:172.21.15.78:3302,v1:172.21.15.78:6791]" 2024-04-25T02:09:24.701 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on pool no app = False 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: ms bind msgr2 = False 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn min per osd = 0 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = c7765ec7-39fd-490f-9c17-2b734a0c4de0 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-04-25T02:09:24.702 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-04-25T02:09:24.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2024-04-25T02:09:24.704 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-04-25T02:09:24.705 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.706 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: mon down mkfs grace = 300 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:24.707 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-04-25T02:09:24.708 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-04-25T02:09:24.709 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-04-25T02:09:24.710 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-04-25T02:09:24.711 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.712 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],[v2:172.21.15.78:3302,v1:172.21.15.78:6791]" 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on pool no app = False 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: ms bind msgr2 = False 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn min per osd = 0 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = c7765ec7-39fd-490f-9c17-2b734a0c4de0 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:09:24.713 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-04-25T02:09:24.714 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore allocator = bitmap 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 1/20 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 1/20 2024-04-25T02:09:24.715 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 4/10 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:09:24.716 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.717 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: mon down mkfs grace = 300 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-04-25T02:09:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-04-25T02:09:24.719 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-25T02:09:24.720 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-25T02:09:24.722 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T02:09:24.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T02:09:24.811 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T02:09:24.812 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:24.812 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T02:09:24.829 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:24.829 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T02:09:24.887 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:09:24.887 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:24.887 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:09:24.887 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:09:24.963 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:24.963 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:09:25.020 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T02:09:25.020 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:09:25.020 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:09:25.020 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:09:25.063 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:09:25.063 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:09:25.124 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T02:09:25.124 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T02:09:25.124 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:09:25.173 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:09:25.175 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T02:09:25.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:09:25.222 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:09:25.224 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T02:09:25.250 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T02:09:25.251 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T02:09:25.369 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T02:09:25.383 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T02:09:25.383 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:09:25.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T02:09:25.410 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:09:25.410 INFO:tasks.ceph:role: osd.0 2024-04-25T02:09:25.410 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:09:25.410 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:09:25.484 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:09:25.916 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-04-25T02:09:25.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-04-25T02:09:25.917 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T02:09:26.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T02:09:26.128 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T02:09:26.195 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:09:26.196 INFO:tasks.ceph:role: osd.1 2024-04-25T02:09:26.196 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:09:26.196 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T02:09:26.270 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:09:26.270 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:09:26.271 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:09:26.271 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:09:26.271 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:09:26.271 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:09:26.271 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:09:26.271 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:09:26.271 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:09:26.271 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:09:26.704 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-04-25T02:09:26.706 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-04-25T02:09:26.706 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T02:09:26.809 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T02:09:26.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T02:09:26.906 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:09:26.906 INFO:tasks.ceph:role: osd.2 2024-04-25T02:09:26.906 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:09:26.906 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T02:09:26.979 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:09:26.979 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:09:27.431 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-04-25T02:09:27.433 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-04-25T02:09:27.433 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T02:09:27.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T02:09:27.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T02:09:27.706 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:09:27.706 INFO:tasks.ceph:role: osd.3 2024-04-25T02:09:27.706 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:09:27.706 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T02:09:27.780 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:09:27.780 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:09:27.780 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:09:27.780 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:09:27.780 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:09:27.781 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:09:27.781 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:09:27.781 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:09:27.781 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:09:27.781 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:09:28.224 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-04-25T02:09:28.225 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-04-25T02:09:28.225 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T02:09:28.393 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T02:09:28.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:09:28.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:28.516+0000 7f226a8a6380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T02:09:28.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:28.516+0000 7f226a8a6380 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T02:09:28.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:28.517+0000 7f226a8a6380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:09:28.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:28.517+0000 7f226a8a6380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:09:28.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:28.517+0000 7f226a8a6380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:09:28.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:28.517+0000 7f226a8a6380 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T02:09:31.381 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T02:09:31.413 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:31.496+0000 7f1de8dcf380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:31.497+0000 7f1de8dcf380 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:31.497+0000 7f1de8dcf380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:31.497+0000 7f1de8dcf380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:09:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:31.497+0000 7f1de8dcf380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:09:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:31.497+0000 7f1de8dcf380 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T02:09:34.347 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T02:09:34.379 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:09:34.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:34.462+0000 7f5535512380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T02:09:34.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:34.462+0000 7f5535512380 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T02:09:34.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:34.462+0000 7f5535512380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:09:34.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:34.462+0000 7f5535512380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:09:34.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:34.462+0000 7f5535512380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:09:34.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:34.463+0000 7f5535512380 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T02:09:37.336 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T02:09:37.365 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:09:37.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:37.470+0000 7f780d1ed380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T02:09:37.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:37.470+0000 7f780d1ed380 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T02:09:37.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:37.470+0000 7f780d1ed380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:09:37.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:37.470+0000 7f780d1ed380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:09:37.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:37.470+0000 7f780d1ed380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:09:37.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:37.471+0000 7f780d1ed380 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T02:09:40.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T02:09:40.363 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T02:09:40.363 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:40.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T02:09:40.436 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:40.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T02:09:40.508 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:40.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T02:09:40.581 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:40.581 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T02:09:40.654 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:40.654 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T02:09:40.726 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:40.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T02:09:40.797 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:09:40.797 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T02:09:40.819 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T02:09:40.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T02:09:40.868 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2024-04-25T02:09:40.868 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBVuylmvsLzCRAAbEJ06FbivmmwqZdx5NZLIQ== 2024-04-25T02:09:40.868 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-04-25T02:09:40.868 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBVuylm3FnqDBAAiC1ujNqItrBSMEuKNyFmYA== 2024-04-25T02:09:40.868 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2024-04-25T02:09:40.868 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBYuylm9QjeHhAApUNZgduDSQTxf99LkGnjlQ== 2024-04-25T02:09:40.868 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2024-04-25T02:09:40.868 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBbuylm1WavHRAAjeHpLYgoHxB/YyXH/VWIuw== 2024-04-25T02:09:40.869 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2024-04-25T02:09:40.869 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBeuylmqjaeGxAAnD5EdexQsTP+0zrBPBQ+LQ== 2024-04-25T02:09:40.869 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2024-04-25T02:09:40.869 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBhuylm3o4aHBAAvmh1hUbGoZ1GoYopxC0imw== 2024-04-25T02:09:40.869 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-04-25T02:09:40.869 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBVuylmfnmqFRAARcBHjOb17tu/7YtJnq4zwA== 2024-04-25T02:09:40.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:09:40.967 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:09:41.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:09:41.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:09:41.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:09:41.194 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:09:41.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:09:41.294 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T02:09:41.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T02:09:41.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:09:41.413 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T02:09:41.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T02:09:41.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:09:41.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T02:09:41.627 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T02:09:41.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:09:41.785 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T02:09:41.812 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:09:41.870 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T02:09:41.870 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T02:09:41.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T02:09:41.912 INFO:tasks.ceph.mon.a:Started 2024-04-25T02:09:41.913 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T02:09:41.913 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T02:09:41.915 INFO:tasks.ceph.mon.b:Started 2024-04-25T02:09:41.915 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T02:09:41.915 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T02:09:41.916 INFO:tasks.ceph.mon.c:Started 2024-04-25T02:09:41.917 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T02:09:41.917 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T02:09:41.917 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T02:09:41.919 INFO:tasks.ceph.mgr.x:Started 2024-04-25T02:09:41.919 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T02:09:41.919 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T02:09:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.055+0000 7ff97d440700 1 Processor -- start 2024-04-25T02:09:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.055+0000 7ff97d440700 1 -- start start 2024-04-25T02:09:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff97d440700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff97d440700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff97d440700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9780931b0 con 0x7ff978097750 2024-04-25T02:09:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff97d440700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff978097b30 con 0x7ff978096710 2024-04-25T02:09:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff97d440700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff978092640 con 0x7ff978090d40 2024-04-25T02:09:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9767fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9777fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff976ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff978097750 0x7ff978095b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38458/0 (socket says 172.21.15.78:38458) 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff976ffd700 1 -- 172.21.15.78:0/2837087476 learned_addr learned my addr 172.21.15.78:0/2837087476 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9777fe700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff978132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9777fe700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff978132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 msgr2=0x7ff978096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 msgr2=0x7ff978096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:09:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.056+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:09:42.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:42.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:42.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9777fe700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff978132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T02:09:42.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9777fe700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff978132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:42.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 msgr2=0x7ff978096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:09:42.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 msgr2=0x7ff978096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:42.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:42.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:42.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:09:42.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.257+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:09:42.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:42.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:42.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 msgr2=0x7ff978096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T02:09:42.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 msgr2=0x7ff978096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:42.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9777fe700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff978132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:09:42.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9777fe700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff978132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:42.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:42.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:42.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2024-04-25T02:09:42.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:42.658+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 msgr2=0x7ff978096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 msgr2=0x7ff978096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9777fe700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff978132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9777fe700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff978132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:43.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:43.459+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2024-04-25T02:09:45.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff974ff9700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 msgr2=0x7ff978096220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:09:45.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff974ff9700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff978090d40 0x7ff978096220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:45.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff974ff9700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff978132390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:09:45.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff974ff9700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff978132390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:45.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff974ff9700 1 -- 172.21.15.78:0/2837087476 >> v1:172.21.15.78:6789/0 conn(0x7ff978097750 legacy=0x7ff978095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff974ff9700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:45.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff974ff9700 1 -- 172.21.15.78:0/2837087476 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff978097b30 con 0x7ff9640035a0 2024-04-25T02:09:45.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:45.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff976ffd700 1 -- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 msgr2=0x7ff964005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:09:45.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff976ffd700 1 -- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 msgr2=0x7ff964005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:45.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:45.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.056+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:09:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.257+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.257+0000 7ff976ffd700 1 -- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 msgr2=0x7ff964005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:09:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.257+0000 7ff976ffd700 1 -- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 msgr2=0x7ff964005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.257+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.257+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:09:45.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.658+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:45.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.658+0000 7ff976ffd700 1 -- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 msgr2=0x7ff964005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:09:45.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.658+0000 7ff976ffd700 1 -- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 msgr2=0x7ff964005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:45.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.658+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:45.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:45.658+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2024-04-25T02:09:46.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:46.459+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:46.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:46.459+0000 7ff976ffd700 1 -- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 msgr2=0x7ff964005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:09:46.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:46.459+0000 7ff976ffd700 1 -- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 msgr2=0x7ff964005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:09:46.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:46.459+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:09:46.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:46.459+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2024-04-25T02:09:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff974ff9700 1 -- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 msgr2=0x7ff964005a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:09:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff974ff9700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff974ff9700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff964008260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff974ff9700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964008750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff974ff9700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff96400ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff974ff9700 1 -- 172.21.15.78:0/2837087476 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff978097b30 con 0x7ff9640035a0 2024-04-25T02:09:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff974ff9700 1 -- 172.21.15.78:0/2837087476 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff978092640 con 0x7ff978096710 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff974ff9700 1 -- 172.21.15.78:0/2837087476 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff96400b140 con 0x7ff964005a80 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> v2:172.21.15.78:3300/0 conn(0x7ff9640035a0 0x7ff964008750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff964008260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.056+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff96400ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 msgr2=0x7ff96400ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff96400ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff964008260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff964008260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff9767fc700 1 -- 172.21.15.78:0/2837087476 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97805ed80 con 0x7ff9640035a0 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff96400ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff964008260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 0x7ff964008750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff978065ad0 tx=0x7ff96c008040).ready entity=mon.0 client_cookie=f36f2c3f41cb14b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff975ffb700 1 -- 172.21.15.78:0/2837087476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c011450 con 0x7ff9640035a0 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff975ffb700 1 -- 172.21.15.78:0/2837087476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c015490 con 0x7ff9640035a0 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.057+0000 7ff975ffb700 1 -- 172.21.15.78:0/2837087476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c015810 con 0x7ff9640035a0 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.058+0000 7ff97d440700 1 -- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 msgr2=0x7ff964008750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.058+0000 7ff97d440700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 0x7ff964008750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff978065ad0 tx=0x7ff96c008040).stop 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.058+0000 7ff97d440700 1 -- 172.21.15.78:0/2837087476 shutdown_connections 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.058+0000 7ff97d440700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff964008260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.058+0000 7ff97d440700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff96400ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.058+0000 7ff97d440700 1 --2- 172.21.15.78:0/2837087476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 0x7ff964008750 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.058+0000 7ff97d440700 1 -- 172.21.15.78:0/2837087476 >> 172.21.15.78:0/2837087476 conn(0x7ff97809abf0 msgr2=0x7ff978096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.058+0000 7ff97d440700 1 -- 172.21.15.78:0/2837087476 shutdown_connections 2024-04-25T02:09:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.058+0000 7ff97d440700 1 -- 172.21.15.78:0/2837087476 wait complete. 2024-04-25T02:09:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff97d440700 1 Processor -- start 2024-04-25T02:09:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff97d440700 1 -- start start 2024-04-25T02:09:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff97d440700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 0x7ff97808f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff97d440700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff97808b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff97d440700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff97808b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff97d440700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97808e760 con 0x7ff9640035a0 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff97d440700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97808cdf0 con 0x7ff978096710 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff97d440700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff978098b90 con 0x7ff964005a80 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff9767fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff97808b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff9777fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff97808b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff9767fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff97808b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:39094/0 (socket says 172.21.15.78:39094) 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff976ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 0x7ff97808f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.060+0000 7ff9767fc700 1 -- 172.21.15.78:0/2382066910 learned_addr learned my addr 172.21.15.78:0/2382066910 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff9777fe700 1 -- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 msgr2=0x7ff97808b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff97808b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff9777fe700 1 -- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 msgr2=0x7ff97808f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 0x7ff97808f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff9777fe700 1 -- 172.21.15.78:0/2382066910 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96800e040 con 0x7ff978096710 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff976ffd700 1 --2- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 0x7ff97808f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff9767fc700 1 --2- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff97808b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff9777fe700 1 --2- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff97808b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff968006db0 tx=0x7ff968008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff95f7fe700 1 -- 172.21.15.78:0/2382066910 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968011e20 con 0x7ff978096710 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff95f7fe700 1 -- 172.21.15.78:0/2382066910 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff968014a50 con 0x7ff978096710 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff97d440700 1 -- 172.21.15.78:0/2382066910 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97000f040 con 0x7ff978096710 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff95f7fe700 1 -- 172.21.15.78:0/2382066910 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968014bc0 con 0x7ff978096710 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff97d440700 1 -- 172.21.15.78:0/2382066910 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c00e040 con 0x7ff978096710 2024-04-25T02:09:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff95f7fe700 1 -- 172.21.15.78:0/2382066910 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff96801d020 con 0x7ff978096710 2024-04-25T02:09:48.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.061+0000 7ff95f7fe700 1 -- 172.21.15.78:0/2382066910 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff968020770 con 0x7ff978096710 2024-04-25T02:09:48.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.062+0000 7ff97d440700 1 -- 172.21.15.78:0/2382066910 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97806c550 con 0x7ff978096710 2024-04-25T02:09:48.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.065+0000 7ff95f7fe700 1 -- 172.21.15.78:0/2382066910 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7ff968017880 con 0x7ff978096710 2024-04-25T02:09:48.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.137+0000 7ff97d440700 1 -- 172.21.15.78:0/2382066910 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff978046ce0 con 0x7ff978096710 2024-04-25T02:09:48.146 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:48.138+0000 7f16572de680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:09:48.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.143+0000 7ff95f7fe700 1 -- 172.21.15.78:0/2382066910 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff968017a20 con 0x7ff978096710 2024-04-25T02:09:48.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.144+0000 7ff97d440700 1 -- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 msgr2=0x7ff97808b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.144+0000 7ff97d440700 1 --2- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff97808b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff968006db0 tx=0x7ff968008040).stop 2024-04-25T02:09:48.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.144+0000 7ff97d440700 1 -- 172.21.15.78:0/2382066910 shutdown_connections 2024-04-25T02:09:48.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.144+0000 7ff97d440700 1 --2- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff978096710 0x7ff97808b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.144+0000 7ff97d440700 1 --2- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9640035a0 0x7ff97808f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.144+0000 7ff97d440700 1 --2- 172.21.15.78:0/2382066910 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff964005a80 0x7ff97808b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.144+0000 7ff97d440700 1 -- 172.21.15.78:0/2382066910 >> 172.21.15.78:0/2382066910 conn(0x7ff97809abf0 msgr2=0x7ff978094a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.144+0000 7ff97d440700 1 -- 172.21.15.78:0/2382066910 shutdown_connections 2024-04-25T02:09:48.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.144+0000 7ff97d440700 1 -- 172.21.15.78:0/2382066910 wait complete. 2024-04-25T02:09:48.153 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-04-25T02:09:48.163 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T02:09:48.163 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T02:09:48.163 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:48.163 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T02:09:48.190 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:48.190 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T02:09:48.222 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:48.215+0000 7f16572de680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:09:48.248 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:48.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T02:09:48.310 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:48.303+0000 7f16572de680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:09:48.315 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-04-25T02:09:48.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T02:09:48.381 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 7fc6c0a8-450e-4322-a503-465f74e096d8 0 2024-04-25T02:09:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d83842700 1 Processor -- start 2024-04-25T02:09:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d83842700 1 -- start start 2024-04-25T02:09:48.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d83842700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2d7c062860 0x7f2d7c12af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d83842700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c12b480 0x7f2d7c0958a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d83842700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c091a10 con 0x7f2d7c12ab00 2024-04-25T02:09:48.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d83842700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c062c40 con 0x7f2d7c062860 2024-04-25T02:09:48.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d83842700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c0922e0 con 0x7f2d7c12b480 2024-04-25T02:09:48.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d815de700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2d7c062860 0x7f2d7c12af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d81ddf700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c12b480 0x7f2d7c0958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d81ddf700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c12b480 0x7f2d7c0958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:39108/0 (socket says 172.21.15.78:39108) 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d815de700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2d7c062860 0x7f2d7c12af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58894/0 (socket says 172.21.15.78:58894) 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d80ddd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2d7c12ab00 0x7f2d7c095190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43000/0 (socket says 172.21.15.78:43000) 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.528+0000 7f2d81ddf700 1 -- 172.21.15.78:0/3438788004 learned_addr learned my addr 172.21.15.78:0/3438788004 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d81ddf700 1 -- 172.21.15.78:0/3438788004 >> v2:172.21.15.78:3300/0 conn(0x7f2d7c062860 msgr2=0x7f2d7c12af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d81ddf700 1 --2- 172.21.15.78:0/3438788004 >> v2:172.21.15.78:3300/0 conn(0x7f2d7c062860 0x7f2d7c12af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d81ddf700 1 -- 172.21.15.78:0/3438788004 >> v1:172.21.15.78:6789/0 conn(0x7f2d7c12ab00 legacy=0x7f2d7c095190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d81ddf700 1 -- 172.21.15.78:0/3438788004 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c091cb0 con 0x7f2d7c12b480 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d73fff700 1 -- 172.21.15.78:0/3438788004 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536661878 0 0) 0x7f2d7c091a10 con 0x7f2d7c12ab00 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d815de700 1 --2- 172.21.15.78:0/3438788004 >> v2:172.21.15.78:3300/0 conn(0x7f2d7c062860 0x7f2d7c12af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d81ddf700 1 --2- 172.21.15.78:0/3438788004 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c12b480 0x7f2d7c0958a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2d74009f50 tx=0x7f2d74009840).ready entity=mon.2 client_cookie=36fdf01a5745b2de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d73fff700 1 -- 172.21.15.78:0/3438788004 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400e070 con 0x7f2d7c12b480 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d73fff700 1 -- 172.21.15.78:0/3438788004 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7400b9c0 con 0x7f2d7c12b480 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.529+0000 7f2d73fff700 1 -- 172.21.15.78:0/3438788004 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400bd40 con 0x7f2d7c12b480 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.530+0000 7f2d83842700 1 -- 172.21.15.78:0/3438788004 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c12b480 msgr2=0x7f2d7c0958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.530+0000 7f2d83842700 1 --2- 172.21.15.78:0/3438788004 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c12b480 0x7f2d7c0958a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2d74009f50 tx=0x7f2d74009840).stop 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.530+0000 7f2d83842700 1 -- 172.21.15.78:0/3438788004 shutdown_connections 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.530+0000 7f2d83842700 1 --2- 172.21.15.78:0/3438788004 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c12b480 0x7f2d7c0958a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.530+0000 7f2d83842700 1 --2- 172.21.15.78:0/3438788004 >> v2:172.21.15.78:3300/0 conn(0x7f2d7c062860 0x7f2d7c12af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.530+0000 7f2d83842700 1 -- 172.21.15.78:0/3438788004 >> 172.21.15.78:0/3438788004 conn(0x7f2d7c09a970 msgr2=0x7f2d7c09ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.530+0000 7f2d83842700 1 -- 172.21.15.78:0/3438788004 shutdown_connections 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.530+0000 7f2d83842700 1 -- 172.21.15.78:0/3438788004 wait complete. 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d83842700 1 Processor -- start 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d83842700 1 -- start start 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d83842700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c062860 0x7f2d7c124c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d83842700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c12b480 0x7f2d7c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d83842700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d7c125120 0x7f2d7c069090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d83842700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c117240 con 0x7f2d7c12b480 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d83842700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c115e70 con 0x7f2d7c125120 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d83842700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c116f80 con 0x7f2d7c062860 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d80ddd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c12b480 0x7f2d7c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d81ddf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d7c125120 0x7f2d7c069090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d80ddd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c12b480 0x7f2d7c068ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58900/0 (socket says 172.21.15.78:58900) 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d815de700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c062860 0x7f2d7c124c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d80ddd700 1 -- 172.21.15.78:0/358161594 learned_addr learned my addr 172.21.15.78:0/358161594 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d80ddd700 1 -- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c062860 msgr2=0x7f2d7c124c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.531+0000 7f2d80ddd700 1 --2- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c062860 0x7f2d7c124c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d80ddd700 1 -- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d7c125120 msgr2=0x7f2d7c069090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d80ddd700 1 --2- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d7c125120 0x7f2d7c069090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d80ddd700 1 -- 172.21.15.78:0/358161594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d780092a0 con 0x7f2d7c12b480 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d81ddf700 1 --2- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d7c125120 0x7f2d7c069090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d80ddd700 1 --2- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c12b480 0x7f2d7c068ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2d6c00c4c0 tx=0x7f2d6c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d71ffb700 1 -- 172.21.15.78:0/358161594 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00ce30 con 0x7f2d7c12b480 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d71ffb700 1 -- 172.21.15.78:0/358161594 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c0072e0 con 0x7f2d7c12b480 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d83842700 1 -- 172.21.15.78:0/358161594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d74009ae0 con 0x7f2d7c12b480 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d71ffb700 1 -- 172.21.15.78:0/358161594 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0056e0 con 0x7f2d7c12b480 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d83842700 1 -- 172.21.15.78:0/358161594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c117dc0 con 0x7f2d7c12b480 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d71ffb700 1 -- 172.21.15.78:0/358161594 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2d6c005cf0 con 0x7f2d7c12b480 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.532+0000 7f2d71ffb700 1 -- 172.21.15.78:0/358161594 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2d6c013c90 con 0x7f2d7c12b480 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.533+0000 7f2d83842700 1 -- 172.21.15.78:0/358161594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c117480 con 0x7f2d7c12b480 2024-04-25T02:09:48.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.535+0000 7f2d71ffb700 1 -- 172.21.15.78:0/358161594 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f2d7c117dc0 con 0x7f2d7c12b480 2024-04-25T02:09:48.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.613+0000 7f2d83842700 1 -- 172.21.15.78:0/358161594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7fc6c0a8-450e-4322-a503-465f74e096d8", "id": 0} v 0) v1 -- 0x7f2d7c09b490 con 0x7f2d7c12b480 2024-04-25T02:09:48.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.624+0000 7f2d71ffb700 1 -- 172.21.15.78:0/358161594 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7fc6c0a8-450e-4322-a503-465f74e096d8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d6c018070 con 0x7f2d7c12b480 2024-04-25T02:09:48.632 INFO:teuthology.orchestra.run.smithi078.stdout:0 2024-04-25T02:09:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.625+0000 7f2d83842700 1 -- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c12b480 msgr2=0x7f2d7c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.625+0000 7f2d83842700 1 --2- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c12b480 0x7f2d7c068ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2d6c00c4c0 tx=0x7f2d6c007c10).stop 2024-04-25T02:09:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.625+0000 7f2d83842700 1 -- 172.21.15.78:0/358161594 shutdown_connections 2024-04-25T02:09:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.625+0000 7f2d83842700 1 --2- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2d7c125120 0x7f2d7c069090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.625+0000 7f2d83842700 1 --2- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2d7c062860 0x7f2d7c124c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.625+0000 7f2d83842700 1 --2- 172.21.15.78:0/358161594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d7c12b480 0x7f2d7c068ba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.625+0000 7f2d83842700 1 -- 172.21.15.78:0/358161594 >> 172.21.15.78:0/358161594 conn(0x7f2d7c09a970 msgr2=0x7f2d7c094560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.625+0000 7f2d83842700 1 -- 172.21.15.78:0/358161594 shutdown_connections 2024-04-25T02:09:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.625+0000 7f2d83842700 1 -- 172.21.15.78:0/358161594 wait complete. 2024-04-25T02:09:48.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe 1 2024-04-25T02:09:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.752+0000 7f001409c700 1 Processor -- start 2024-04-25T02:09:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.752+0000 7f001409c700 1 -- start start 2024-04-25T02:09:48.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f001409c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12bba0 0x7f000c12df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f001409c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12e480 0x7f000c130870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f001409c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0684c0 con 0x7f000c128d20 2024-04-25T02:09:48.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f001409c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c128880 con 0x7f000c12e480 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f001409c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f000c128b20 con 0x7f000c12bba0 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0011637700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12bba0 0x7f000c12df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0012639700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12e480 0x7f000c130870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0011637700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12bba0 0x7f000c12df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:39116/0 (socket says 172.21.15.78:39116) 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0011e38700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f000c128d20 0x7f000c129100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43002/0 (socket says 172.21.15.78:43002) 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0011637700 1 -- 172.21.15.78:0/746530275 learned_addr learned my addr 172.21.15.78:0/746530275 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0010e36700 1 -- 172.21.15.78:0/746530275 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663417781 0 0) 0x7f000c0684c0 con 0x7f000c128d20 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0010e36700 1 -- 172.21.15.78:0/746530275 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff80033f0 con 0x7f000c128d20 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0011637700 1 -- 172.21.15.78:0/746530275 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12e480 msgr2=0x7f000c130870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0011637700 1 --2- 172.21.15.78:0/746530275 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12e480 0x7f000c130870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0011637700 1 -- 172.21.15.78:0/746530275 >> v1:172.21.15.78:6789/0 conn(0x7f000c128d20 legacy=0x7f000c129100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0011637700 1 -- 172.21.15.78:0/746530275 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c05ed80 con 0x7f000c12bba0 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0012639700 1 --2- 172.21.15.78:0/746530275 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12e480 0x7f000c130870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.753+0000 7f0011637700 1 --2- 172.21.15.78:0/746530275 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12bba0 0x7f000c12df90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f000800dc50 tx=0x7f000800d5b0).ready entity=mon.2 client_cookie=256c8335d882f7a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f0010e36700 1 -- 172.21.15.78:0/746530275 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008012070 con 0x7f000c12bba0 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f0010e36700 1 -- 172.21.15.78:0/746530275 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000800d2e0 con 0x7f000c12bba0 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f0010e36700 1 -- 172.21.15.78:0/746530275 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800f8a0 con 0x7f000c12bba0 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f001409c700 1 -- 172.21.15.78:0/746530275 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12bba0 msgr2=0x7f000c12df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f001409c700 1 --2- 172.21.15.78:0/746530275 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12bba0 0x7f000c12df90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f000800dc50 tx=0x7f000800d5b0).stop 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f001409c700 1 -- 172.21.15.78:0/746530275 shutdown_connections 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f001409c700 1 --2- 172.21.15.78:0/746530275 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12e480 0x7f000c130870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f001409c700 1 --2- 172.21.15.78:0/746530275 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12bba0 0x7f000c12df90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f001409c700 1 -- 172.21.15.78:0/746530275 >> 172.21.15.78:0/746530275 conn(0x7f000c09abf0 msgr2=0x7f000c096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f001409c700 1 -- 172.21.15.78:0/746530275 shutdown_connections 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.754+0000 7f001409c700 1 -- 172.21.15.78:0/746530275 wait complete. 2024-04-25T02:09:48.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.755+0000 7f001409c700 1 Processor -- start 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.755+0000 7f001409c700 1 -- start start 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f001409c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f000c128d20 0x7f000c120090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f001409c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12bba0 0x7f000c091710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f001409c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12e480 0x7f000c091c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f001409c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c097a50 con 0x7f000c128d20 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f001409c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c093840 con 0x7f000c12bba0 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f001409c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f000c126160 con 0x7f000c12e480 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0012639700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12e480 0x7f000c091c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0011637700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12bba0 0x7f000c091710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0012639700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12e480 0x7f000c091c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:39132/0 (socket says 172.21.15.78:39132) 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0012639700 1 -- 172.21.15.78:0/363512850 learned_addr learned my addr 172.21.15.78:0/363512850 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0011e38700 1 --2- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f000c128d20 0x7f000c120090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0012639700 1 -- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12bba0 msgr2=0x7f000c091710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0012639700 1 --2- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12bba0 0x7f000c091710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0012639700 1 -- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f000c128d20 msgr2=0x7f000c120090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0012639700 1 --2- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f000c128d20 0x7f000c120090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0012639700 1 -- 172.21.15.78:0/363512850 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004009a20 con 0x7f000c12e480 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f0012639700 1 --2- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12e480 0x7f000c091c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0004009f60 tx=0x7f000400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f00027fc700 1 -- 172.21.15.78:0/363512850 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000400cb70 con 0x7f000c12e480 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f00027fc700 1 -- 172.21.15.78:0/363512850 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000400f040 con 0x7f000c12e480 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f001409c700 1 -- 172.21.15.78:0/363512850 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000800d810 con 0x7f000c12e480 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f00027fc700 1 -- 172.21.15.78:0/363512850 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004013400 con 0x7f000c12e480 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.756+0000 7f001409c700 1 -- 172.21.15.78:0/363512850 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c05f7b0 con 0x7f000c12e480 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.757+0000 7f00027fc700 1 -- 172.21.15.78:0/363512850 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f0004013a10 con 0x7f000c12e480 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.757+0000 7f00027fc700 1 -- 172.21.15.78:0/363512850 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f000401dac0 con 0x7f000c12e480 2024-04-25T02:09:48.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.757+0000 7f001409c700 1 -- 172.21.15.78:0/363512850 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000c06c550 con 0x7f000c12e480 2024-04-25T02:09:48.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.760+0000 7f00027fc700 1 -- 172.21.15.78:0/363512850 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f000401dd50 con 0x7f000c12e480 2024-04-25T02:09:48.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.839+0000 7f001409c700 1 -- 172.21.15.78:0/363512850 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd new", "uuid": "dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe", "id": 1} v 0) v1 -- 0x7f000c092510 con 0x7f000c12e480 2024-04-25T02:09:48.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.847+0000 7f00027fc700 1 -- 172.21.15.78:0/363512850 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0004027430 con 0x7f000c12e480 2024-04-25T02:09:48.855 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-04-25T02:09:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.848+0000 7f001409c700 1 -- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12e480 msgr2=0x7f000c091c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.848+0000 7f001409c700 1 --2- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12e480 0x7f000c091c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0004009f60 tx=0x7f000400b040).stop 2024-04-25T02:09:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.848+0000 7f001409c700 1 -- 172.21.15.78:0/363512850 shutdown_connections 2024-04-25T02:09:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.848+0000 7f001409c700 1 --2- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f000c12e480 0x7f000c091c00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.848+0000 7f001409c700 1 --2- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f000c128d20 0x7f000c120090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.848+0000 7f001409c700 1 --2- 172.21.15.78:0/363512850 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f000c12bba0 0x7f000c091710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.848+0000 7f001409c700 1 -- 172.21.15.78:0/363512850 >> 172.21.15.78:0/363512850 conn(0x7f000c09abf0 msgr2=0x7f000c126e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.848+0000 7f001409c700 1 -- 172.21.15.78:0/363512850 shutdown_connections 2024-04-25T02:09:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.848+0000 7f001409c700 1 -- 172.21.15.78:0/363512850 wait complete. 2024-04-25T02:09:48.867 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 459db897-8690-47e4-ad90-743b2b35f006 2 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.986+0000 7f07df56e700 1 Processor -- start 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.986+0000 7f07df56e700 1 -- start start 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07df56e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07d8092500 0x7f07d8092940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07df56e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 0x7f07d813f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07df56e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d80828b0 con 0x7f07d8091a10 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07df56e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d8094cd0 con 0x7f07d8092500 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07df56e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8082ae0 con 0x7f07d813cdf0 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07dd30a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f07d8091a10 0x7f07d8091df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43012/0 (socket says 172.21.15.78:43012) 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07dd30a700 1 -- 172.21.15.78:0/1150669539 learned_addr learned my addr 172.21.15.78:0/1150669539 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07dcb09700 1 --2- 172.21.15.78:0/1150669539 >> v2:172.21.15.78:3300/0 conn(0x7f07d8092500 0x7f07d8092940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07ddb0b700 1 --2- 172.21.15.78:0/1150669539 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 0x7f07d813f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:48.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07dcb09700 1 -- 172.21.15.78:0/1150669539 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 msgr2=0x7f07d813f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:48.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07dcb09700 1 --2- 172.21.15.78:0/1150669539 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 0x7f07d813f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07dcb09700 1 -- 172.21.15.78:0/1150669539 >> v1:172.21.15.78:6789/0 conn(0x7f07d8091a10 legacy=0x7f07d8091df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.987+0000 7f07dcb09700 1 -- 172.21.15.78:0/1150669539 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d80941e0 con 0x7f07d8092500 2024-04-25T02:09:48.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.988+0000 7f07dcb09700 1 --2- 172.21.15.78:0/1150669539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8092500 0x7f07d8092940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f07d400b0e0 tx=0x7f07d40094b0).ready entity=mon.0 client_cookie=979a9a706fba9d12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.988+0000 7f07cffff700 1 -- 172.21.15.78:0/1150669539 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400be00 con 0x7f07d8092500 2024-04-25T02:09:48.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.988+0000 7f07cffff700 1 -- 172.21.15.78:0/1150669539 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4011400 con 0x7f07d8092500 2024-04-25T02:09:48.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.988+0000 7f07cffff700 1 -- 172.21.15.78:0/1150669539 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4011780 con 0x7f07d8092500 2024-04-25T02:09:48.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.989+0000 7f07df56e700 1 -- 172.21.15.78:0/1150669539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8092500 msgr2=0x7f07d8092940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.989+0000 7f07df56e700 1 --2- 172.21.15.78:0/1150669539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8092500 0x7f07d8092940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f07d400b0e0 tx=0x7f07d40094b0).stop 2024-04-25T02:09:48.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.989+0000 7f07df56e700 1 -- 172.21.15.78:0/1150669539 shutdown_connections 2024-04-25T02:09:48.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.989+0000 7f07df56e700 1 --2- 172.21.15.78:0/1150669539 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 0x7f07d813f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.989+0000 7f07df56e700 1 --2- 172.21.15.78:0/1150669539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8092500 0x7f07d8092940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:48.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.989+0000 7f07df56e700 1 -- 172.21.15.78:0/1150669539 >> 172.21.15.78:0/1150669539 conn(0x7f07d8099690 msgr2=0x7f07d8099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.989+0000 7f07df56e700 1 -- 172.21.15.78:0/1150669539 shutdown_connections 2024-04-25T02:09:48.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.989+0000 7f07df56e700 1 -- 172.21.15.78:0/1150669539 wait complete. 2024-04-25T02:09:48.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.990+0000 7f07df56e700 1 Processor -- start 2024-04-25T02:09:48.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.990+0000 7f07df56e700 1 -- start start 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07df56e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8091a10 0x7f07d81441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07df56e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07d8092500 0x7f07d8141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07df56e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 0x7f07d8080370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07df56e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8081b40 con 0x7f07d8091a10 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07df56e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8143740 con 0x7f07d8092500 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07df56e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07d80697d0 con 0x7f07d813cdf0 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07dd30a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8091a10 0x7f07d81441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07dd30a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8091a10 0x7f07d81441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58934/0 (socket says 172.21.15.78:58934) 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07dd30a700 1 -- 172.21.15.78:0/3150075259 learned_addr learned my addr 172.21.15.78:0/3150075259 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07ddb0b700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 0x7f07d8080370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07dd30a700 1 -- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 msgr2=0x7f07d8080370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07dd30a700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 0x7f07d8080370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07dd30a700 1 -- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07d8092500 msgr2=0x7f07d8141210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07dcb09700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07d8092500 0x7f07d8141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07dd30a700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07d8092500 0x7f07d8141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.991+0000 7f07dd30a700 1 -- 172.21.15.78:0/3150075259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d4009060 con 0x7f07d8091a10 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.992+0000 7f07dcb09700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07d8092500 0x7f07d8141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.992+0000 7f07dd30a700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8091a10 0x7f07d81441e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f07d000c840 tx=0x7f07d0001610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.992+0000 7f07cdffb700 1 -- 172.21.15.78:0/3150075259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0005d30 con 0x7f07d8091a10 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.992+0000 7f07cdffb700 1 -- 172.21.15.78:0/3150075259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0005e90 con 0x7f07d8091a10 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.992+0000 7f07df56e700 1 -- 172.21.15.78:0/3150075259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d8094410 con 0x7f07d8091a10 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.992+0000 7f07cdffb700 1 -- 172.21.15.78:0/3150075259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0007320 con 0x7f07d8091a10 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.992+0000 7f07df56e700 1 -- 172.21.15.78:0/3150075259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d8141dd0 con 0x7f07d8091a10 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.993+0000 7f07cdffb700 1 -- 172.21.15.78:0/3150075259 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f07d001d440 con 0x7f07d8091a10 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.993+0000 7f07cdffb700 1 -- 172.21.15.78:0/3150075259 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f07d0007970 con 0x7f07d8091a10 2024-04-25T02:09:49.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.993+0000 7f07df56e700 1 -- 172.21.15.78:0/3150075259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d8063870 con 0x7f07d8091a10 2024-04-25T02:09:49.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:48.997+0000 7f07cdffb700 1 -- 172.21.15.78:0/3150075259 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f07d001d920 con 0x7f07d8091a10 2024-04-25T02:09:49.052 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:49.044+0000 7f16572de680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.090+0000 7f07df56e700 1 -- 172.21.15.78:0/3150075259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "459db897-8690-47e4-ad90-743b2b35f006", "id": 2} v 0) v1 -- 0x7f07d8093ce0 con 0x7f07d8091a10 2024-04-25T02:09:49.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.097+0000 7f07cdffb700 1 -- 172.21.15.78:0/3150075259 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "459db897-8690-47e4-ad90-743b2b35f006", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f07d001db40 con 0x7f07d8091a10 2024-04-25T02:09:49.105 INFO:teuthology.orchestra.run.smithi078.stdout:2 2024-04-25T02:09:49.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.098+0000 7f07df56e700 1 -- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8091a10 msgr2=0x7f07d81441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.098+0000 7f07df56e700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8091a10 0x7f07d81441e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f07d000c840 tx=0x7f07d0001610).stop 2024-04-25T02:09:49.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.098+0000 7f07df56e700 1 -- 172.21.15.78:0/3150075259 shutdown_connections 2024-04-25T02:09:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.098+0000 7f07df56e700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07d813cdf0 0x7f07d8080370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.098+0000 7f07df56e700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07d8091a10 0x7f07d81441e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.098+0000 7f07df56e700 1 --2- 172.21.15.78:0/3150075259 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07d8092500 0x7f07d8141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.098+0000 7f07df56e700 1 -- 172.21.15.78:0/3150075259 >> 172.21.15.78:0/3150075259 conn(0x7f07d8099690 msgr2=0x7f07d8145db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.098+0000 7f07df56e700 1 -- 172.21.15.78:0/3150075259 shutdown_connections 2024-04-25T02:09:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.098+0000 7f07df56e700 1 -- 172.21.15.78:0/3150075259 wait complete. 2024-04-25T02:09:49.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new b0d12360-a3a8-4fde-bf7a-e5a2514abe27 3 2024-04-25T02:09:49.163 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:49.156+0000 7f16572de680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:09:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.225+0000 7f860380b700 1 Processor -- start 2024-04-25T02:09:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f860380b700 1 -- start start 2024-04-25T02:09:49.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f860380b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc062860 0x7f85fc12af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f860380b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85fc12ab00 0x7f85fc12b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f860380b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc095190 0x7f85fc095640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f860380b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85fc062c40 con 0x7f85fc12ab00 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f860380b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc0922e0 con 0x7f85fc095190 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f860380b700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc091a10 con 0x7f85fc062860 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f8600da6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85fc12ab00 0x7f85fc12b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f86015a7700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc062860 0x7f85fc12af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f8600da6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85fc12ab00 0x7f85fc12b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58948/0 (socket says 172.21.15.78:58948) 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f86015a7700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc062860 0x7f85fc12af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:39168/0 (socket says 172.21.15.78:39168) 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f8600da6700 1 -- 172.21.15.78:0/1157728830 learned_addr learned my addr 172.21.15.78:0/1157728830 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.226+0000 7f8601da8700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc095190 0x7f85fc095640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f8600da6700 1 -- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc062860 msgr2=0x7f85fc12af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f8600da6700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc062860 0x7f85fc12af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f8600da6700 1 -- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc095190 msgr2=0x7f85fc095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f8600da6700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc095190 0x7f85fc095640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f8600da6700 1 -- 172.21.15.78:0/1157728830 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc12b970 con 0x7f85fc12ab00 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f86015a7700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc062860 0x7f85fc12af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f8601da8700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc095190 0x7f85fc095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f8600da6700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc12ab00 0x7f85fc12b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f85ec006fd0 tx=0x7f85ec0090f0).ready entity=mon.0 client_cookie=f14c681b595ff419 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f85f3fff700 1 -- 172.21.15.78:0/1157728830 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec00f510 con 0x7f85fc12ab00 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f85f3fff700 1 -- 172.21.15.78:0/1157728830 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec00f670 con 0x7f85fc12ab00 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f85f3fff700 1 -- 172.21.15.78:0/1157728830 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec00f9f0 con 0x7f85fc12ab00 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f860380b700 1 -- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc12ab00 msgr2=0x7f85fc12b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f860380b700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc12ab00 0x7f85fc12b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f85ec006fd0 tx=0x7f85ec0090f0).stop 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f860380b700 1 -- 172.21.15.78:0/1157728830 shutdown_connections 2024-04-25T02:09:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f860380b700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc095190 0x7f85fc095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f860380b700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc062860 0x7f85fc12af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f860380b700 1 --2- 172.21.15.78:0/1157728830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc12ab00 0x7f85fc12b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.227+0000 7f860380b700 1 -- 172.21.15.78:0/1157728830 >> 172.21.15.78:0/1157728830 conn(0x7f85fc09a970 msgr2=0x7f85fc09ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.228+0000 7f860380b700 1 -- 172.21.15.78:0/1157728830 shutdown_connections 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.228+0000 7f860380b700 1 -- 172.21.15.78:0/1157728830 wait complete. 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.228+0000 7f860380b700 1 Processor -- start 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.228+0000 7f860380b700 1 -- start start 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f860380b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc062860 0x7f85fc0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f860380b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc095190 0x7f85fc115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f860380b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc115770 0x7f85fc115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f860380b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc116fa0 con 0x7f85fc095190 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f860380b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc096c60 con 0x7f85fc062860 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f860380b700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc117190 con 0x7f85fc115770 2024-04-25T02:09:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f86015a7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc062860 0x7f85fc0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f86015a7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc062860 0x7f85fc0690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:54618/0 (socket says 172.21.15.78:54618) 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f8601da8700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc115770 0x7f85fc115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f86015a7700 1 -- 172.21.15.78:0/2780927562 learned_addr learned my addr 172.21.15.78:0/2780927562 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f8600da6700 1 --2- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc095190 0x7f85fc115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f86015a7700 1 -- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc115770 msgr2=0x7f85fc115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f86015a7700 1 --2- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc115770 0x7f85fc115bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f86015a7700 1 -- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc095190 msgr2=0x7f85fc115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f86015a7700 1 --2- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc095190 0x7f85fc115280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f86015a7700 1 -- 172.21.15.78:0/2780927562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80092a0 con 0x7f85fc062860 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.229+0000 7f86015a7700 1 --2- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc062860 0x7f85fc0690c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f85f800ea20 tx=0x7f85f8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.230+0000 7f85f1ffb700 1 -- 172.21.15.78:0/2780927562 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8009600 con 0x7f85fc062860 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.230+0000 7f85f1ffb700 1 -- 172.21.15.78:0/2780927562 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f800c850 con 0x7f85fc062860 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.230+0000 7f85f1ffb700 1 -- 172.21.15.78:0/2780927562 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800cbd0 con 0x7f85fc062860 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.230+0000 7f860380b700 1 -- 172.21.15.78:0/2780927562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f4009a20 con 0x7f85fc062860 2024-04-25T02:09:49.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.230+0000 7f85f1ffb700 1 -- 172.21.15.78:0/2780927562 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f85f801b660 con 0x7f85fc062860 2024-04-25T02:09:49.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.230+0000 7f860380b700 1 -- 172.21.15.78:0/2780927562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec009370 con 0x7f85fc062860 2024-04-25T02:09:49.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.230+0000 7f85f1ffb700 1 -- 172.21.15.78:0/2780927562 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f85f801bb40 con 0x7f85fc062860 2024-04-25T02:09:49.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.231+0000 7f860380b700 1 -- 172.21.15.78:0/2780927562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85fc09b490 con 0x7f85fc062860 2024-04-25T02:09:49.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.233+0000 7f85f1ffb700 1 -- 172.21.15.78:0/2780927562 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f85f803ae50 con 0x7f85fc062860 2024-04-25T02:09:49.302 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:49.295+0000 7f16572de680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:09:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.312+0000 7f860380b700 1 -- 172.21.15.78:0/2780927562 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b0d12360-a3a8-4fde-bf7a-e5a2514abe27", "id": 3} v 0) v1 -- 0x7f85fc046ce0 con 0x7f85fc062860 2024-04-25T02:09:49.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.320+0000 7f85f1ffb700 1 -- 172.21.15.78:0/2780927562 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0d12360-a3a8-4fde-bf7a-e5a2514abe27", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f85f8029030 con 0x7f85fc062860 2024-04-25T02:09:49.328 INFO:teuthology.orchestra.run.smithi078.stdout:3 2024-04-25T02:09:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.321+0000 7f860380b700 1 -- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc062860 msgr2=0x7f85fc0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.321+0000 7f860380b700 1 --2- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc062860 0x7f85fc0690c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f85f800ea20 tx=0x7f85f8009060).stop 2024-04-25T02:09:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.321+0000 7f860380b700 1 -- 172.21.15.78:0/2780927562 shutdown_connections 2024-04-25T02:09:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.321+0000 7f860380b700 1 --2- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85fc115770 0x7f85fc115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.321+0000 7f860380b700 1 --2- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85fc062860 0x7f85fc0690c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.321+0000 7f860380b700 1 --2- 172.21.15.78:0/2780927562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc095190 0x7f85fc115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.321+0000 7f860380b700 1 -- 172.21.15.78:0/2780927562 >> 172.21.15.78:0/2780927562 conn(0x7f85fc09a970 msgr2=0x7f85fc0997a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.321+0000 7f860380b700 1 -- 172.21.15.78:0/2780927562 shutdown_connections 2024-04-25T02:09:49.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.321+0000 7f860380b700 1 -- 172.21.15.78:0/2780927562 wait complete. 2024-04-25T02:09:49.340 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T02:09:49.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T02:09:49.342 INFO:tasks.ceph.osd.0:Started 2024-04-25T02:09:49.342 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T02:09:49.342 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T02:09:49.344 INFO:tasks.ceph.osd.1:Started 2024-04-25T02:09:49.344 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T02:09:49.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T02:09:49.346 INFO:tasks.ceph.osd.2:Started 2024-04-25T02:09:49.346 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T02:09:49.346 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T02:09:49.348 INFO:tasks.ceph.osd.3:Started 2024-04-25T02:09:49.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:49.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.488+0000 7fe32fcc1700 1 Processor -- start 2024-04-25T02:09:49.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32fcc1700 1 -- start start 2024-04-25T02:09:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32fcc1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe328064ad0 0x7fe32812abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32fcc1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe32812a750 0x7fe32812b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32fcc1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe328065750 con 0x7fe328098530 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32fcc1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe328064eb0 con 0x7fe328064ad0 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32fcc1700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe328099930 con 0x7fe32812a750 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32da5d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe328064ad0 0x7fe32812abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32d25c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe32812a750 0x7fe32812b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32da5d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe328064ad0 0x7fe32812abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59014/0 (socket says 172.21.15.78:59014) 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32da5d700 1 -- 172.21.15.78:0/1909565848 learned_addr learned my addr 172.21.15.78:0/1909565848 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.489+0000 7fe32e25e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe328098530 0x7fe3280989e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43062/0 (socket says 172.21.15.78:43062) 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32d25c700 1 -- 172.21.15.78:0/1909565848 >> v2:172.21.15.78:3300/0 conn(0x7fe328064ad0 msgr2=0x7fe32812abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32d25c700 1 --2- 172.21.15.78:0/1909565848 >> v2:172.21.15.78:3300/0 conn(0x7fe328064ad0 0x7fe32812abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32d25c700 1 -- 172.21.15.78:0/1909565848 >> v1:172.21.15.78:6789/0 conn(0x7fe328098530 legacy=0x7fe3280989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32ca5b700 1 -- 172.21.15.78:0/1909565848 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283431669 0 0) 0x7fe328065750 con 0x7fe328098530 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32d25c700 1 -- 172.21.15.78:0/1909565848 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328065b40 con 0x7fe32812a750 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32da5d700 1 --2- 172.21.15.78:0/1909565848 >> v2:172.21.15.78:3300/0 conn(0x7fe328064ad0 0x7fe32812abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32d25c700 1 --2- 172.21.15.78:0/1909565848 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe32812a750 0x7fe32812b0d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe318009760 tx=0x7fe318009060).ready entity=mon.2 client_cookie=2e26a34b1cbb4751 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32ca5b700 1 -- 172.21.15.78:0/1909565848 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180090d0 con 0x7fe32812a750 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32ca5b700 1 -- 172.21.15.78:0/1909565848 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31800f510 con 0x7fe32812a750 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32ca5b700 1 -- 172.21.15.78:0/1909565848 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800f890 con 0x7fe32812a750 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1909565848 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe32812a750 msgr2=0x7fe32812b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32fcc1700 1 --2- 172.21.15.78:0/1909565848 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe32812a750 0x7fe32812b0d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fe318009760 tx=0x7fe318009060).stop 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1909565848 shutdown_connections 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32fcc1700 1 --2- 172.21.15.78:0/1909565848 >> v2:172.21.15.78:3300/0 conn(0x7fe328064ad0 0x7fe32812abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32fcc1700 1 --2- 172.21.15.78:0/1909565848 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe32812a750 0x7fe32812b0d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.490+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1909565848 >> 172.21.15.78:0/1909565848 conn(0x7fe32809a630 msgr2=0x7fe32809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.491+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1909565848 shutdown_connections 2024-04-25T02:09:49.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.491+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1909565848 wait complete. 2024-04-25T02:09:49.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32fcc1700 1 Processor -- start 2024-04-25T02:09:49.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32fcc1700 1 -- start start 2024-04-25T02:09:49.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32fcc1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe328064ad0 0x7fe32813a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32fcc1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328098530 0x7fe32813a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32fcc1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe32813aad0 0x7fe328114170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32fcc1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe328116bf0 con 0x7fe328098530 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32fcc1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe328117850 con 0x7fe32813aad0 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32fcc1700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe328116930 con 0x7fe328064ad0 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32da5d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe328064ad0 0x7fe32813a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32da5d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe328064ad0 0x7fe32813a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:39204/0 (socket says 172.21.15.78:39204) 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.492+0000 7fe32da5d700 1 -- 172.21.15.78:0/1504701220 learned_addr learned my addr 172.21.15.78:0/1504701220 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32d25c700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328098530 0x7fe32813a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32e25e700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe32813aad0 0x7fe328114170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32da5d700 1 -- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe32813aad0 msgr2=0x7fe328114170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32da5d700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe32813aad0 0x7fe328114170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32da5d700 1 -- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328098530 msgr2=0x7fe32813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32da5d700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328098530 0x7fe32813a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32da5d700 1 -- 172.21.15.78:0/1504701220 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324009370 con 0x7fe328064ad0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32d25c700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328098530 0x7fe32813a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32da5d700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe328064ad0 0x7fe32813a0f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fe32400ea20 tx=0x7fe3240090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe31e7fc700 1 -- 172.21.15.78:0/1504701220 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400ee60 con 0x7fe328064ad0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe31e7fc700 1 -- 172.21.15.78:0/1504701220 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32400c850 con 0x7fe328064ad0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1504701220 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3180092a0 con 0x7fe328064ad0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe31e7fc700 1 -- 172.21.15.78:0/1504701220 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400cbd0 con 0x7fe328064ad0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1504701220 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe328097220 con 0x7fe328064ad0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe31e7fc700 1 -- 172.21.15.78:0/1504701220 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fe32401b660 con 0x7fe328064ad0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.493+0000 7fe31e7fc700 1 -- 172.21.15.78:0/1504701220 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fe324012900 con 0x7fe328064ad0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.494+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1504701220 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32809d2f0 con 0x7fe328064ad0 2024-04-25T02:09:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.496+0000 7fe31e7fc700 1 -- 172.21.15.78:0/1504701220 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fe324016020 con 0x7fe328064ad0 2024-04-25T02:09:49.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.561+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1504701220 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe32809b150 con 0x7fe328064ad0 2024-04-25T02:09:49.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.562+0000 7fe31e7fc700 1 -- 172.21.15.78:0/1504701220 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fe32401bbb0 con 0x7fe328064ad0 2024-04-25T02:09:49.569 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:49.569 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:09:49.314637+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:49.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.563+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe328064ad0 msgr2=0x7fe32813a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.563+0000 7fe32fcc1700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe328064ad0 0x7fe32813a0f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fe32400ea20 tx=0x7fe3240090f0).stop 2024-04-25T02:09:49.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.563+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1504701220 shutdown_connections 2024-04-25T02:09:49.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.563+0000 7fe32fcc1700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe32813aad0 0x7fe328114170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.563+0000 7fe32fcc1700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe328064ad0 0x7fe32813a0f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.563+0000 7fe32fcc1700 1 --2- 172.21.15.78:0/1504701220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328098530 0x7fe32813a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:49.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.563+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1504701220 >> 172.21.15.78:0/1504701220 conn(0x7fe32809a630 msgr2=0x7fe32812db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.563+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1504701220 shutdown_connections 2024-04-25T02:09:49.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:49.563+0000 7fe32fcc1700 1 -- 172.21.15.78:0/1504701220 wait complete. 2024-04-25T02:09:49.581 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T02:09:49.581 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T02:09:49.767 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:49.759+0000 7f16572de680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:09:49.937 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:49.929+0000 7f16572de680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:09:49.959 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-04-25T02:09:49.951+0000 7f49f499c380 -1 Falling back to public interface 2024-04-25T02:09:49.959 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-04-25T02:09:49.952+0000 7f92ddce4380 -1 Falling back to public interface 2024-04-25T02:09:49.959 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-04-25T02:09:49.952+0000 7f92d7e8b700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6803/0: (98) Address already in use 2024-04-25T02:09:49.968 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-04-25T02:09:49.960+0000 7f61a3461380 -1 Falling back to public interface 2024-04-25T02:09:49.968 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-04-25T02:09:49.960+0000 7fb5257d4380 -1 Falling back to public interface 2024-04-25T02:09:49.983 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:50.010 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:50.003+0000 7f16572de680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:09:50.089 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:50.082+0000 7f16572de680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:09:50.090 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59bf20700 1 Processor -- start 2024-04-25T02:09:50.090 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59bf20700 1 -- start start 2024-04-25T02:09:50.092 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59bf20700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc594066d90 0x7fc594067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:50.092 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59bf20700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594067660 0x7fc594128b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:50.092 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59bf20700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941294a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:50.092 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59bf20700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc594129990 con 0x7fc594066d90 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59bf20700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940691f0 con 0x7fc594128ff0 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59bf20700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940943f0 con 0x7fc594067660 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc5994bb700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594067660 0x7fc594128b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59a4bd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941294a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc599cbc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc594066d90 0x7fc594067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59a4bd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941294a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:54676/0 (socket says 172.21.15.78:54676) 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc59a4bd700 1 -- 172.21.15.78:0/1803702630 learned_addr learned my addr 172.21.15.78:0/1803702630 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.083+0000 7fc5994bb700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594067660 0x7fc594128b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:39218/0 (socket says 172.21.15.78:39218) 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc59a4bd700 1 -- 172.21.15.78:0/1803702630 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594067660 msgr2=0x7fc594128b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc59a4bd700 1 --2- 172.21.15.78:0/1803702630 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594067660 0x7fc594128b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc59a4bd700 1 -- 172.21.15.78:0/1803702630 >> v2:172.21.15.78:3300/0 conn(0x7fc594066d90 msgr2=0x7fc594067170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc59a4bd700 1 --2- 172.21.15.78:0/1803702630 >> v2:172.21.15.78:3300/0 conn(0x7fc594066d90 0x7fc594067170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc59a4bd700 1 -- 172.21.15.78:0/1803702630 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5940694a0 con 0x7fc594128ff0 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc5994bb700 1 --2- 172.21.15.78:0/1803702630 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594067660 0x7fc594128b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:50.093 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc599cbc700 1 --2- 172.21.15.78:0/1803702630 >> v2:172.21.15.78:3300/0 conn(0x7fc594066d90 0x7fc594067170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc59a4bd700 1 --2- 172.21.15.78:0/1803702630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941294a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc58c00f4c0 tx=0x7fc58c00dc50).ready entity=mon.1 client_cookie=a6e482322caff0d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc598cba700 1 -- 172.21.15.78:0/1803702630 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c012070 con 0x7fc594128ff0 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc598cba700 1 -- 172.21.15.78:0/1803702630 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c00d0d0 con 0x7fc594128ff0 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc598cba700 1 -- 172.21.15.78:0/1803702630 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c00d450 con 0x7fc594128ff0 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc59bf20700 1 -- 172.21.15.78:0/1803702630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 msgr2=0x7fc5941294a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.084+0000 7fc59bf20700 1 --2- 172.21.15.78:0/1803702630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941294a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc58c00f4c0 tx=0x7fc58c00dc50).stop 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.085+0000 7fc59bf20700 1 -- 172.21.15.78:0/1803702630 shutdown_connections 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.085+0000 7fc59bf20700 1 --2- 172.21.15.78:0/1803702630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941294a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.085+0000 7fc59bf20700 1 --2- 172.21.15.78:0/1803702630 >> v2:172.21.15.78:3300/0 conn(0x7fc594066d90 0x7fc594067170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.085+0000 7fc59bf20700 1 --2- 172.21.15.78:0/1803702630 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594067660 0x7fc594128b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.085+0000 7fc59bf20700 1 -- 172.21.15.78:0/1803702630 >> 172.21.15.78:0/1803702630 conn(0x7fc594064ae0 msgr2=0x7fc59409a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:50.094 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.085+0000 7fc59bf20700 1 -- 172.21.15.78:0/1803702630 shutdown_connections 2024-04-25T02:09:50.095 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.085+0000 7fc59bf20700 1 -- 172.21.15.78:0/1803702630 wait complete. 2024-04-25T02:09:50.097 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.086+0000 7fc59bf20700 1 Processor -- start 2024-04-25T02:09:50.097 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.086+0000 7fc59bf20700 1 -- start start 2024-04-25T02:09:50.097 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.086+0000 7fc59bf20700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594066d90 0x7fc594127770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:50.097 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc59bf20700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594067660 0x7fc594127c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:50.097 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc59bf20700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941149d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:50.097 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc59bf20700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc594115ea0 con 0x7fc594067660 2024-04-25T02:09:50.097 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc59bf20700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5941170c0 con 0x7fc594128ff0 2024-04-25T02:09:50.097 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc59bf20700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc594119260 con 0x7fc594066d90 2024-04-25T02:09:50.097 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc599cbc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594066d90 0x7fc594127770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc59a4bd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941149d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc599cbc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594066d90 0x7fc594127770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:39224/0 (socket says 172.21.15.78:39224) 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc599cbc700 1 -- 172.21.15.78:0/706791821 learned_addr learned my addr 172.21.15.78:0/706791821 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc5994bb700 1 --2- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594067660 0x7fc594127c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc599cbc700 1 -- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 msgr2=0x7fc5941149d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc599cbc700 1 --2- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941149d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc599cbc700 1 -- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594067660 msgr2=0x7fc594127c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc599cbc700 1 --2- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594067660 0x7fc594127c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc599cbc700 1 -- 172.21.15.78:0/706791821 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900092a0 con 0x7fc594066d90 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc59a4bd700 1 --2- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941149d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc599cbc700 1 --2- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594066d90 0x7fc594127770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fc59000ea20 tx=0x7fc590009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:50.098 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc58a7fc700 1 -- 172.21.15.78:0/706791821 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000ee60 con 0x7fc594066d90 2024-04-25T02:09:50.099 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc58a7fc700 1 -- 172.21.15.78:0/706791821 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59000c850 con 0x7fc594066d90 2024-04-25T02:09:50.099 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc58a7fc700 1 -- 172.21.15.78:0/706791821 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000cbd0 con 0x7fc594066d90 2024-04-25T02:09:50.099 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc59bf20700 1 -- 172.21.15.78:0/706791821 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5840092a0 con 0x7fc594066d90 2024-04-25T02:09:50.099 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.087+0000 7fc59bf20700 1 -- 172.21.15.78:0/706791821 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c00f050 con 0x7fc594066d90 2024-04-25T02:09:50.099 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.088+0000 7fc58a7fc700 1 -- 172.21.15.78:0/706791821 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fc59001b660 con 0x7fc594066d90 2024-04-25T02:09:50.099 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.088+0000 7fc58a7fc700 1 -- 172.21.15.78:0/706791821 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc590012900 con 0x7fc594066d90 2024-04-25T02:09:50.099 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.088+0000 7fc59bf20700 1 -- 172.21.15.78:0/706791821 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59405fbd0 con 0x7fc594066d90 2024-04-25T02:09:50.099 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.091+0000 7fc58a7fc700 1 -- 172.21.15.78:0/706791821 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fc59003ae50 con 0x7fc594066d90 2024-04-25T02:09:50.161 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:50.153+0000 7f16572de680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:09:50.163 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.156+0000 7fc59bf20700 1 -- 172.21.15.78:0/706791821 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5941288e0 con 0x7fc594066d90 2024-04-25T02:09:50.164 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.157+0000 7fc58a7fc700 1 -- 172.21.15.78:0/706791821 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fc590029030 con 0x7fc594066d90 2024-04-25T02:09:50.164 INFO:teuthology.misc.health.smithi078.stdout: 2024-04-25T02:09:50.164 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":6,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:09:49.314637+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:50.165 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.158+0000 7fc59bf20700 1 -- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594066d90 msgr2=0x7fc594127770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.165 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.158+0000 7fc59bf20700 1 --2- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594066d90 0x7fc594127770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fc59000ea20 tx=0x7fc590009060).stop 2024-04-25T02:09:50.165 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.158+0000 7fc59bf20700 1 -- 172.21.15.78:0/706791821 shutdown_connections 2024-04-25T02:09:50.165 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.158+0000 7fc59bf20700 1 --2- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc594128ff0 0x7fc5941149d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.166 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.158+0000 7fc59bf20700 1 --2- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc594066d90 0x7fc594127770 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.166 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.158+0000 7fc59bf20700 1 --2- 172.21.15.78:0/706791821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc594067660 0x7fc594127c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:50.166 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.158+0000 7fc59bf20700 1 -- 172.21.15.78:0/706791821 >> 172.21.15.78:0/706791821 conn(0x7fc594064ae0 msgr2=0x7fc5940965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:50.166 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.158+0000 7fc59bf20700 1 -- 172.21.15.78:0/706791821 shutdown_connections 2024-04-25T02:09:50.166 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:50.158+0000 7fc59bf20700 1 -- 172.21.15.78:0/706791821 wait complete. 2024-04-25T02:09:50.175 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-25T02:09:50.508 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:50.500+0000 7f16572de680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:09:50.594 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:50.587+0000 7f16572de680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:09:51.228 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:51.220+0000 7f16572de680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:09:51.296 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:51.289+0000 7f16572de680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:09:51.375 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:51.368+0000 7f16572de680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:09:51.661 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:51.654+0000 7f16572de680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:09:51.732 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:51.725+0000 7f16572de680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:09:51.848 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:51.841+0000 7f16572de680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:09:51.966 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:51.958+0000 7f16572de680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:09:52.112 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:52.105+0000 7f16572de680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:09:52.183 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:52.175+0000 7f16572de680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:09:53.204 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:53.196+0000 7f160dd18700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T02:09:53.205 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-04-25T02:09:53.198+0000 7f160dd18700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T02:09:53.470 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-04-25T02:09:53.462+0000 7f92ddce4380 -1 osd.0 0 log_to_monitors {default=true} 2024-04-25T02:09:53.478 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-04-25T02:09:53.470+0000 7f49f499c380 -1 osd.1 0 log_to_monitors {default=true} 2024-04-25T02:09:53.485 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-04-25T02:09:53.477+0000 7fb5257d4380 -1 osd.3 0 log_to_monitors {default=true} 2024-04-25T02:09:53.500 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-04-25T02:09:53.493+0000 7f61a3461380 -1 osd.2 0 log_to_monitors {default=true} 2024-04-25T02:09:55.212 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-04-25T02:09:55.205+0000 7f49eb33c700 -1 osd.1 0 waiting for initial osdmap 2024-04-25T02:09:55.215 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-04-25T02:09:55.207+0000 7f92d4684700 -1 osd.0 0 waiting for initial osdmap 2024-04-25T02:09:55.215 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-04-25T02:09:55.208+0000 7f6199e01700 -1 osd.2 0 waiting for initial osdmap 2024-04-25T02:09:55.216 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-04-25T02:09:55.207+0000 7fb51c174700 -1 osd.3 0 waiting for initial osdmap 2024-04-25T02:09:55.217 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-04-25T02:09:55.209+0000 7f49e7ab8700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:09:55.219 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-04-25T02:09:55.211+0000 7fb5188f0700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:09:55.219 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-04-25T02:09:55.211+0000 7f92d0e00700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:09:55.219 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-04-25T02:09:55.212+0000 7f619657d700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:09:56.579 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:56.699 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.691+0000 7fb600061700 1 Processor -- start 2024-04-25T02:09:56.699 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.691+0000 7fb600061700 1 -- start start 2024-04-25T02:09:56.701 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb600061700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f8096510 0x7fb5f812caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:56.701 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb600061700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5f812cfe0 0x7fb5f812f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:56.701 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb600061700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f8092930 con 0x7fb5f80936a0 2024-04-25T02:09:56.701 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb600061700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f8093a80 con 0x7fb5f812cfe0 2024-04-25T02:09:56.701 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb600061700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8092be0 con 0x7fb5f8096510 2024-04-25T02:09:56.701 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fd5fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f8096510 0x7fb5f812caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:56.701 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fe5fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5f812cfe0 0x7fb5f812f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:56.701 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fd5fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f8096510 0x7fb5f812caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55382/0 (socket says 172.21.15.78:55382) 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fe5fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5f812cfe0 0x7fb5f812f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60956/0 (socket says 172.21.15.78:60956) 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fd5fc700 1 -- 172.21.15.78:0/3153718059 learned_addr learned my addr 172.21.15.78:0/3153718059 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fddfd700 1 --1- 172.21.15.78:0/3153718059 >> v1:172.21.15.78:6789/0 conn(0x7fb5f80936a0 0x7fb5f8124b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35364/0 (socket says 172.21.15.78:35364) 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fd5fc700 1 -- 172.21.15.78:0/3153718059 >> v2:172.21.15.78:3300/0 conn(0x7fb5f812cfe0 msgr2=0x7fb5f812f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fd5fc700 1 --2- 172.21.15.78:0/3153718059 >> v2:172.21.15.78:3300/0 conn(0x7fb5f812cfe0 0x7fb5f812f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fd5fc700 1 -- 172.21.15.78:0/3153718059 >> v1:172.21.15.78:6789/0 conn(0x7fb5f80936a0 legacy=0x7fb5f8124b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fd5fc700 1 -- 172.21.15.78:0/3153718059 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f8091bd0 con 0x7fb5f8096510 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fd5fc700 1 --2- 172.21.15.78:0/3153718059 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f8096510 0x7fb5f812caf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb5f4006fd0 tx=0x7fb5f40090f0).ready entity=mon.1 client_cookie=259ca44287562c9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.692+0000 7fb5fcdfb700 1 -- 172.21.15.78:0/3153718059 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400b580 con 0x7fb5f8096510 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb5fcdfb700 1 -- 172.21.15.78:0/3153718059 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f400b6e0 con 0x7fb5f8096510 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb5fcdfb700 1 -- 172.21.15.78:0/3153718059 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400ba60 con 0x7fb5f8096510 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb600061700 1 -- 172.21.15.78:0/3153718059 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f8096510 msgr2=0x7fb5f812caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.702 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb600061700 1 --2- 172.21.15.78:0/3153718059 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f8096510 0x7fb5f812caf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb5f4006fd0 tx=0x7fb5f40090f0).stop 2024-04-25T02:09:56.703 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb600061700 1 -- 172.21.15.78:0/3153718059 shutdown_connections 2024-04-25T02:09:56.703 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb600061700 1 --2- 172.21.15.78:0/3153718059 >> v2:172.21.15.78:3300/0 conn(0x7fb5f812cfe0 0x7fb5f812f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:56.703 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb600061700 1 --2- 172.21.15.78:0/3153718059 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f8096510 0x7fb5f812caf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:56.703 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb600061700 1 -- 172.21.15.78:0/3153718059 >> 172.21.15.78:0/3153718059 conn(0x7fb5f809b770 msgr2=0x7fb5f8097600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:56.703 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb600061700 1 -- 172.21.15.78:0/3153718059 shutdown_connections 2024-04-25T02:09:56.703 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.693+0000 7fb600061700 1 -- 172.21.15.78:0/3153718059 wait complete. 2024-04-25T02:09:56.705 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.694+0000 7fb600061700 1 Processor -- start 2024-04-25T02:09:56.705 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.694+0000 7fb600061700 1 -- start start 2024-04-25T02:09:56.705 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.694+0000 7fb600061700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5f8096510 0x7fb5f812a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:56.705 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb600061700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5f812cfe0 0x7fb5f812ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:56.705 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb600061700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f812b180 0x7fb5f813e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:56.705 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb600061700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f812bc70 con 0x7fb5f812cfe0 2024-04-25T02:09:56.705 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb600061700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8092630 con 0x7fb5f812b180 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb600061700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81127a0 con 0x7fb5f8096510 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fe5fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f812b180 0x7fb5f813e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fd5fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5f812cfe0 0x7fb5f812ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fe5fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f812b180 0x7fb5f813e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55396/0 (socket says 172.21.15.78:55396) 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fd5fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5f812cfe0 0x7fb5f812ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60970/0 (socket says 172.21.15.78:60970) 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fe5fe700 1 -- 172.21.15.78:0/1704570635 learned_addr learned my addr 172.21.15.78:0/1704570635 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fddfd700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5f8096510 0x7fb5f812a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fe5fe700 1 -- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5f8096510 msgr2=0x7fb5f812a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fe5fe700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5f8096510 0x7fb5f812a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fe5fe700 1 -- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5f812cfe0 msgr2=0x7fb5f812ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fe5fe700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5f812cfe0 0x7fb5f812ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fe5fe700 1 -- 172.21.15.78:0/1704570635 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4009370 con 0x7fb5f812b180 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fd5fc700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5f812cfe0 0x7fb5f812ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fddfd700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5f8096510 0x7fb5f812a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:56.706 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5fe5fe700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f812b180 0x7fb5f813e4a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb5f0009ec0 tx=0x7fb5f000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:56.707 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5ea7fc700 1 -- 172.21.15.78:0/1704570635 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0009c50 con 0x7fb5f812b180 2024-04-25T02:09:56.707 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5ea7fc700 1 -- 172.21.15.78:0/1704570635 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f000f040 con 0x7fb5f812b180 2024-04-25T02:09:56.707 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f812cde0 con 0x7fb5f812b180 2024-04-25T02:09:56.707 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb5ea7fc700 1 -- 172.21.15.78:0/1704570635 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f000cdc0 con 0x7fb5f812b180 2024-04-25T02:09:56.707 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.695+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f81124e0 con 0x7fb5f812b180 2024-04-25T02:09:56.707 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.696+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f805fbd0 con 0x7fb5f812b180 2024-04-25T02:09:56.707 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.697+0000 7fb5ea7fc700 1 -- 172.21.15.78:0/1704570635 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fb5f0013610 con 0x7fb5f812b180 2024-04-25T02:09:56.707 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.697+0000 7fb5ea7fc700 1 -- 172.21.15.78:0/1704570635 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7fb5f003bd10 con 0x7fb5f812b180 2024-04-25T02:09:56.709 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.701+0000 7fb5ea7fc700 1 -- 172.21.15.78:0/1704570635 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fb5f0012950 con 0x7fb5f812b180 2024-04-25T02:09:56.871 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.864+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5f812cde0 con 0x7fb5f812b180 2024-04-25T02:09:56.872 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.864+0000 7fb5ea7fc700 1 -- 172.21.15.78:0/1704570635 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4904 (secure 0 0 0) 0x7fb5f812cde0 con 0x7fb5f812b180 2024-04-25T02:09:56.872 INFO:teuthology.misc.health.smithi078.stdout: 2024-04-25T02:09:56.872 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":9,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:09:56.203305+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:56.874 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 >> v1:172.21.15.78:6816/46507 conn(0x7fb5dc02bd00 legacy=0x7fb5dc02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.875 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f812b180 msgr2=0x7fb5f813e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.875 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f812b180 0x7fb5f813e4a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb5f0009ec0 tx=0x7fb5f000b040).stop 2024-04-25T02:09:56.875 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 shutdown_connections 2024-04-25T02:09:56.875 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb5f812b180 0x7fb5f813e4a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:56.875 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5f8096510 0x7fb5f812a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:56.875 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 --2- 172.21.15.78:0/1704570635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5f812cfe0 0x7fb5f812ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:56.875 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 >> 172.21.15.78:0/1704570635 conn(0x7fb5f80936a0 msgr2=0x7fb5f8066630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:56.875 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 shutdown_connections 2024-04-25T02:09:56.875 INFO:teuthology.misc.health.smithi078.stderr:2024-04-25T02:09:56.866+0000 7fb600061700 1 -- 172.21.15.78:0/1704570635 wait complete. 2024-04-25T02:09:56.885 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-25T02:09:56.885 INFO:tasks.ceph:Creating RBD pool 2024-04-25T02:09:56.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T02:09:56.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.991+0000 7fcd62c75700 1 Processor -- start 2024-04-25T02:09:56.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.991+0000 7fcd62c75700 1 -- start start 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd62c75700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd5c095c80 0x7fcd5c12d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd62c75700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c12f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd62c75700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c094c70 con 0x7fcd5c095190 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd62c75700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c096060 con 0x7fcd5c095c80 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd62c75700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c096570 con 0x7fcd5c12d500 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd61212700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c12f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd5bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcd5c095c80 0x7fcd5c12d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd60a11700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcd5c095190 0x7fcd5c095570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35378/0 (socket says 172.21.15.78:35378) 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd61212700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c12f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43106/0 (socket says 172.21.15.78:43106) 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd60a11700 1 -- 172.21.15.78:0/813345757 learned_addr learned my addr 172.21.15.78:0/813345757 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd61212700 1 -- 172.21.15.78:0/813345757 >> v2:172.21.15.78:3300/0 conn(0x7fcd5c095c80 msgr2=0x7fcd5c12d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd61212700 1 --2- 172.21.15.78:0/813345757 >> v2:172.21.15.78:3300/0 conn(0x7fcd5c095c80 0x7fcd5c12d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd61212700 1 -- 172.21.15.78:0/813345757 >> v1:172.21.15.78:6789/0 conn(0x7fcd5c095190 legacy=0x7fcd5c095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:57.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd5b7fe700 1 -- 172.21.15.78:0/813345757 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922015317 0 0) 0x7fcd5c094c70 con 0x7fcd5c095190 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd61212700 1 -- 172.21.15.78:0/813345757 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c096da0 con 0x7fcd5c12d500 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.992+0000 7fcd5bfff700 1 --2- 172.21.15.78:0/813345757 >> v2:172.21.15.78:3300/0 conn(0x7fcd5c095c80 0x7fcd5c12d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd61212700 1 --2- 172.21.15.78:0/813345757 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c12f8f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fcd54009e60 tx=0x7fcd54009780).ready entity=mon.2 client_cookie=49453e299cd48640 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd5b7fe700 1 -- 172.21.15.78:0/813345757 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400e070 con 0x7fcd5c12d500 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd5b7fe700 1 -- 172.21.15.78:0/813345757 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5400bb60 con 0x7fcd5c12d500 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd5b7fe700 1 -- 172.21.15.78:0/813345757 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54012410 con 0x7fcd5c12d500 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd62c75700 1 -- 172.21.15.78:0/813345757 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 msgr2=0x7fcd5c12f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd62c75700 1 --2- 172.21.15.78:0/813345757 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c12f8f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fcd54009e60 tx=0x7fcd54009780).stop 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd62c75700 1 -- 172.21.15.78:0/813345757 shutdown_connections 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd62c75700 1 --2- 172.21.15.78:0/813345757 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c12f8f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd62c75700 1 --2- 172.21.15.78:0/813345757 >> v2:172.21.15.78:3300/0 conn(0x7fcd5c095c80 0x7fcd5c12d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd62c75700 1 -- 172.21.15.78:0/813345757 >> 172.21.15.78:0/813345757 conn(0x7fcd5c09a970 msgr2=0x7fcd5c09ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:57.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd62c75700 1 -- 172.21.15.78:0/813345757 shutdown_connections 2024-04-25T02:09:57.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.993+0000 7fcd62c75700 1 -- 172.21.15.78:0/813345757 wait complete. 2024-04-25T02:09:57.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.994+0000 7fcd62c75700 1 Processor -- start 2024-04-25T02:09:57.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.994+0000 7fcd62c75700 1 -- start start 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd62c75700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcd5c095190 0x7fcd5c135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd62c75700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd5c095c80 0x7fcd5c1361a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd62c75700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c136690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd62c75700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c136b80 con 0x7fcd5c095c80 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd62c75700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c119620 con 0x7fcd5c095190 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd62c75700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c064b50 con 0x7fcd5c12d500 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd5bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd5c095c80 0x7fcd5c1361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd60a11700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcd5c095190 0x7fcd5c135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd5bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd5c095c80 0x7fcd5c1361a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60992/0 (socket says 172.21.15.78:60992) 2024-04-25T02:09:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd5bfff700 1 -- 172.21.15.78:0/3092093791 learned_addr learned my addr 172.21.15.78:0/3092093791 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd61212700 1 --2- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c136690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd5bfff700 1 -- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 msgr2=0x7fcd5c136690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd5bfff700 1 --2- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c136690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd5bfff700 1 -- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcd5c095190 msgr2=0x7fcd5c135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd5bfff700 1 --2- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcd5c095190 0x7fcd5c135cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd5bfff700 1 -- 172.21.15.78:0/3092093791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd480092a0 con 0x7fcd5c095c80 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd60a11700 1 --2- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcd5c095190 0x7fcd5c135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd5bfff700 1 --2- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd5c095c80 0x7fcd5c1361a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcd4800ea20 tx=0x7fcd48009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd597fa700 1 -- 172.21.15.78:0/3092093791 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800ee60 con 0x7fcd5c095c80 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd597fa700 1 -- 172.21.15.78:0/3092093791 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4800c850 con 0x7fcd5c095c80 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd597fa700 1 -- 172.21.15.78:0/3092093791 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800cbd0 con 0x7fcd5c095c80 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd54009a20 con 0x7fcd5c095c80 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.995+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c119e50 con 0x7fcd5c095c80 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.996+0000 7fcd597fa700 1 -- 172.21.15.78:0/3092093791 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fcd4801b400 con 0x7fcd5c095c80 2024-04-25T02:09:57.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.996+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c092fb0 con 0x7fcd5c095c80 2024-04-25T02:09:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:56.996+0000 7fcd597fa700 1 -- 172.21.15.78:0/3092093791 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7fcd4803aee0 con 0x7fcd5c095c80 2024-04-25T02:09:57.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.001+0000 7fcd597fa700 1 -- 172.21.15.78:0/3092093791 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fcd48011b40 con 0x7fcd5c095c80 2024-04-25T02:09:57.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.160+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fcd5c119e50 con 0x7fcd5c095c80 2024-04-25T02:09:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.206+0000 7fcd597fa700 1 -- 172.21.15.78:0/3092093791 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7fcd5c119e50 con 0x7fcd5c095c80 2024-04-25T02:09:57.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 >> v1:172.21.15.78:6816/46507 conn(0x7fcd4002bd00 legacy=0x7fcd4002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:57.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd5c095c80 msgr2=0x7fcd5c1361a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:57.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 --2- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd5c095c80 0x7fcd5c1361a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcd4800ea20 tx=0x7fcd48009060).stop 2024-04-25T02:09:57.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 shutdown_connections 2024-04-25T02:09:57.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 --2- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcd5c12d500 0x7fcd5c136690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 --2- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcd5c095190 0x7fcd5c135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 --2- 172.21.15.78:0/3092093791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd5c095c80 0x7fcd5c1361a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 >> 172.21.15.78:0/3092093791 conn(0x7fcd5c09a970 msgr2=0x7fcd5c068760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:57.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 shutdown_connections 2024-04-25T02:09:57.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.209+0000 7fcd62c75700 1 -- 172.21.15.78:0/3092093791 wait complete. 2024-04-25T02:09:57.218 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'rbd' created 2024-04-25T02:09:57.230 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T02:09:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.339+0000 7fca27ea0700 1 Processor -- start 2024-04-25T02:09:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.339+0000 7fca27ea0700 1 -- start start 2024-04-25T02:09:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca27ea0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca20095190 0x7fca20095570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca27ea0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca20095a60 0x7fca2012c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca27ea0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca2012c4f0 0x7fca2012e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca27ea0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca20096570 con 0x7fca20095190 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca27ea0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca200923f0 con 0x7fca2012c4f0 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca27ea0700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca20094c70 con 0x7fca20095a60 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca2643d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca2012c4f0 0x7fca2012e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca25c3c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca20095190 0x7fca20095570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca2543b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca20095a60 0x7fca2012c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca25c3c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca20095190 0x7fca20095570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32772/0 (socket says 172.21.15.78:32772) 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca2643d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca2012c4f0 0x7fca2012e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55420/0 (socket says 172.21.15.78:55420) 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca2543b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca20095a60 0x7fca2012c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43118/0 (socket says 172.21.15.78:43118) 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca25c3c700 1 -- 172.21.15.78:0/1037251573 learned_addr learned my addr 172.21.15.78:0/1037251573 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca25c3c700 1 -- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca20095a60 msgr2=0x7fca2012c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca25c3c700 1 --2- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca20095a60 0x7fca2012c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca25c3c700 1 -- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca2012c4f0 msgr2=0x7fca2012e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca25c3c700 1 --2- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca2012c4f0 0x7fca2012e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca25c3c700 1 -- 172.21.15.78:0/1037251573 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20096da0 con 0x7fca20095190 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca2643d700 1 --2- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca2012c4f0 0x7fca2012e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca2543b700 1 --2- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca20095a60 0x7fca2012c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca25c3c700 1 --2- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 0x7fca20095570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fca10006fd0 tx=0x7fca100090f0).ready entity=mon.0 client_cookie=7a8e6c17ce7d4ce5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca24c3a700 1 -- 172.21.15.78:0/1037251573 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000f510 con 0x7fca20095190 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca24c3a700 1 -- 172.21.15.78:0/1037251573 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1000f670 con 0x7fca20095190 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.340+0000 7fca24c3a700 1 -- 172.21.15.78:0/1037251573 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000fa10 con 0x7fca20095190 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.341+0000 7fca27ea0700 1 -- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 msgr2=0x7fca20095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.341+0000 7fca27ea0700 1 --2- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 0x7fca20095570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fca10006fd0 tx=0x7fca100090f0).stop 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.341+0000 7fca27ea0700 1 -- 172.21.15.78:0/1037251573 shutdown_connections 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.341+0000 7fca27ea0700 1 --2- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca2012c4f0 0x7fca2012e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.341+0000 7fca27ea0700 1 --2- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 0x7fca20095570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.341+0000 7fca27ea0700 1 --2- 172.21.15.78:0/1037251573 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca20095a60 0x7fca2012c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.341+0000 7fca27ea0700 1 -- 172.21.15.78:0/1037251573 >> 172.21.15.78:0/1037251573 conn(0x7fca2009a970 msgr2=0x7fca2009ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.341+0000 7fca27ea0700 1 -- 172.21.15.78:0/1037251573 shutdown_connections 2024-04-25T02:09:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.341+0000 7fca27ea0700 1 -- 172.21.15.78:0/1037251573 wait complete. 2024-04-25T02:09:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca27ea0700 1 Processor -- start 2024-04-25T02:09:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca27ea0700 1 -- start start 2024-04-25T02:09:57.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca27ea0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 0x7fca2011a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca27ea0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca20095a60 0x7fca2011a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca27ea0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca2012c4f0 0x7fca2011acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca27ea0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2011b1e0 con 0x7fca20095190 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca27ea0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2011bf30 con 0x7fca20095a60 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca27ea0700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca2006a0b0 con 0x7fca2012c4f0 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca2543b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca20095a60 0x7fca2011a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca2543b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca20095a60 0x7fca2011a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55436/0 (socket says 172.21.15.78:55436) 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca2543b700 1 -- 172.21.15.78:0/458535283 learned_addr learned my addr 172.21.15.78:0/458535283 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca25c3c700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 0x7fca2011a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.342+0000 7fca2643d700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca2012c4f0 0x7fca2011acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca2543b700 1 -- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca2012c4f0 msgr2=0x7fca2011acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca2543b700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca2012c4f0 0x7fca2011acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca2543b700 1 -- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 msgr2=0x7fca2011a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca2543b700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 0x7fca2011a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca2543b700 1 -- 172.21.15.78:0/458535283 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c0092a0 con 0x7fca20095a60 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca25c3c700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 0x7fca2011a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca2543b700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca20095a60 0x7fca2011a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fca1c00e9d0 tx=0x7fca1c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca167fc700 1 -- 172.21.15.78:0/458535283 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c009600 con 0x7fca20095a60 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca167fc700 1 -- 172.21.15.78:0/458535283 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c00c6a0 con 0x7fca20095a60 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca18009a20 con 0x7fca20095a60 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca167fc700 1 -- 172.21.15.78:0/458535283 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00ca20 con 0x7fca20095a60 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.343+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca10009370 con 0x7fca20095a60 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.344+0000 7fca167fc700 1 -- 172.21.15.78:0/458535283 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fca1c00cd90 con 0x7fca20095a60 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.344+0000 7fca167fc700 1 -- 172.21.15.78:0/458535283 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2803+0+0 (secure 0 0 0) 0x7fca1c03b2f0 con 0x7fca20095a60 2024-04-25T02:09:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.344+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca20092fb0 con 0x7fca20095a60 2024-04-25T02:09:57.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.349+0000 7fca167fc700 1 -- 172.21.15.78:0/458535283 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fca1c016070 con 0x7fca20095a60 2024-04-25T02:09:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:57.511+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fca2009b490 con 0x7fca20095a60 2024-04-25T02:09:58.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.211+0000 7fca167fc700 1 -- 172.21.15.78:0/458535283 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7fca1c016020 con 0x7fca20095a60 2024-04-25T02:09:58.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.214+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 >> v1:172.21.15.78:6816/46507 conn(0x7fca0402bd30 legacy=0x7fca0402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.214+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca20095a60 msgr2=0x7fca2011a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.214+0000 7fca27ea0700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca20095a60 0x7fca2011a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fca1c00e9d0 tx=0x7fca1c009060).stop 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.215+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 shutdown_connections 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.215+0000 7fca27ea0700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fca2012c4f0 0x7fca2011acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.215+0000 7fca27ea0700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca20095190 0x7fca2011a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.215+0000 7fca27ea0700 1 --2- 172.21.15.78:0/458535283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca20095a60 0x7fca2011a800 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.215+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 >> 172.21.15.78:0/458535283 conn(0x7fca2009a970 msgr2=0x7fca20062860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.215+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 shutdown_connections 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.215+0000 7fca27ea0700 1 -- 172.21.15.78:0/458535283 wait complete. 2024-04-25T02:09:58.223 INFO:teuthology.orchestra.run.smithi078.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T02:09:58.239 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T02:09:58.240 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:09:58.240 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:09:58.242 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:09:58.242 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T02:09:58.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:58.321 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-04-25T02:09:58.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.359+0000 7fc635270700 1 Processor -- start 2024-04-25T02:09:58.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.359+0000 7fc635270700 1 -- start start 2024-04-25T02:09:58.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.359+0000 7fc635270700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc630064ad0 0x7fc63012abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.359+0000 7fc635270700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc63012a750 0x7fc63012b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.359+0000 7fc635270700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc6300989e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.359+0000 7fc635270700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc630064eb0 con 0x7fc63012a750 2024-04-25T02:09:58.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.359+0000 7fc635270700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc630099930 con 0x7fc630098530 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.359+0000 7fc635270700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc630065750 con 0x7fc630064ad0 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc6300989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62effd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc630064ad0 0x7fc63012abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62e7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc63012a750 0x7fc63012b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc6300989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55444/0 (socket says 172.21.15.78:55444) 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62effd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc630064ad0 0x7fc63012abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43160/0 (socket says 172.21.15.78:43160) 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62e7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc63012a750 0x7fc63012b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32778/0 (socket says 172.21.15.78:32778) 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62f7fe700 1 -- 172.21.15.78:0/2071115897 learned_addr learned my addr 172.21.15.78:0/2071115897 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62e7fc700 1 -- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc630064ad0 msgr2=0x7fc63012abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62e7fc700 1 --2- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc630064ad0 0x7fc63012abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62e7fc700 1 -- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 msgr2=0x7fc6300989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62e7fc700 1 --2- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc6300989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62e7fc700 1 -- 172.21.15.78:0/2071115897 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630065b40 con 0x7fc63012a750 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62f7fe700 1 --2- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc6300989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62effd700 1 --2- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc630064ad0 0x7fc63012abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62e7fc700 1 --2- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc63012a750 0x7fc63012b0d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc620009760 tx=0x7fc620009060).ready entity=mon.0 client_cookie=877b7190d4ce1bc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62dffb700 1 -- 172.21.15.78:0/2071115897 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200090d0 con 0x7fc63012a750 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62dffb700 1 -- 172.21.15.78:0/2071115897 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62000d4a0 con 0x7fc63012a750 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.360+0000 7fc62dffb700 1 -- 172.21.15.78:0/2071115897 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62000d820 con 0x7fc63012a750 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.361+0000 7fc635270700 1 -- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc63012a750 msgr2=0x7fc63012b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.361+0000 7fc635270700 1 --2- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc63012a750 0x7fc63012b0d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc620009760 tx=0x7fc620009060).stop 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.361+0000 7fc635270700 1 -- 172.21.15.78:0/2071115897 shutdown_connections 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.361+0000 7fc635270700 1 --2- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc6300989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.361+0000 7fc635270700 1 --2- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc630064ad0 0x7fc63012abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.361+0000 7fc635270700 1 --2- 172.21.15.78:0/2071115897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc63012a750 0x7fc63012b0d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.361+0000 7fc635270700 1 -- 172.21.15.78:0/2071115897 >> 172.21.15.78:0/2071115897 conn(0x7fc63009a630 msgr2=0x7fc63009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.361+0000 7fc635270700 1 -- 172.21.15.78:0/2071115897 shutdown_connections 2024-04-25T02:09:58.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.361+0000 7fc635270700 1 -- 172.21.15.78:0/2071115897 wait complete. 2024-04-25T02:09:58.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc635270700 1 Processor -- start 2024-04-25T02:09:58.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc635270700 1 -- start start 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc635270700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc630064ad0 0x7fc63013a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc635270700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc63013a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc635270700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc63013aa10 0x7fc630114170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc635270700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63013ae70 con 0x7fc630064ad0 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc635270700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63009d180 con 0x7fc630098530 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc635270700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc630099ab0 con 0x7fc63013aa10 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc62effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc630064ad0 0x7fc63013a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc62e7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc63013a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc62effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc630064ad0 0x7fc63013a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32790/0 (socket says 172.21.15.78:32790) 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc62effd700 1 -- 172.21.15.78:0/2458288115 learned_addr learned my addr 172.21.15.78:0/2458288115 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.362+0000 7fc62f7fe700 1 --2- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc63013aa10 0x7fc630114170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc62effd700 1 -- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc63013aa10 msgr2=0x7fc630114170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc62effd700 1 --2- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc63013aa10 0x7fc630114170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc62effd700 1 -- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 msgr2=0x7fc63013a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc62effd700 1 --2- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc63013a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc62effd700 1 -- 172.21.15.78:0/2458288115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240092a0 con 0x7fc630064ad0 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc62e7fc700 1 --2- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc63013a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc62effd700 1 --2- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc630064ad0 0x7fc63013a030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc62400ea50 tx=0x7fc624009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc6177fe700 1 -- 172.21.15.78:0/2458288115 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400ee90 con 0x7fc630064ad0 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc6177fe700 1 -- 172.21.15.78:0/2458288115 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62400c850 con 0x7fc630064ad0 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc6177fe700 1 -- 172.21.15.78:0/2458288115 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400cbd0 con 0x7fc630064ad0 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc628009ae0 con 0x7fc630064ad0 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6200092a0 con 0x7fc630064ad0 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.363+0000 7fc6177fe700 1 -- 172.21.15.78:0/2458288115 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fc62401b400 con 0x7fc630064ad0 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.364+0000 7fc6177fe700 1 -- 172.21.15.78:0/2458288115 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fc62403b3d0 con 0x7fc630064ad0 2024-04-25T02:09:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.364+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6301168b0 con 0x7fc630064ad0 2024-04-25T02:09:58.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.369+0000 7fc6177fe700 1 -- 172.21.15.78:0/2458288115 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fc6301168b0 con 0x7fc630064ad0 2024-04-25T02:09:58.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.526+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6301168b0 con 0x7fc630064ad0 2024-04-25T02:09:58.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.527+0000 7fc6177fe700 1 -- 172.21.15.78:0/2458288115 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8118 (secure 0 0 0) 0x7fc6301168b0 con 0x7fc630064ad0 2024-04-25T02:09:58.535 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:58.535 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":11,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:09:58.205615+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 >> v1:172.21.15.78:6816/46507 conn(0x7fc61c02bd30 legacy=0x7fc61c02e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc630064ad0 msgr2=0x7fc63013a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 --2- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc630064ad0 0x7fc63013a030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc62400ea50 tx=0x7fc624009060).stop 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 shutdown_connections 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 --2- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc63013aa10 0x7fc630114170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 --2- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc630064ad0 0x7fc63013a030 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 --2- 172.21.15.78:0/2458288115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc630098530 0x7fc63013a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 >> 172.21.15.78:0/2458288115 conn(0x7fc63009a630 msgr2=0x7fc63012dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 shutdown_connections 2024-04-25T02:09:58.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.529+0000 7fc635270700 1 -- 172.21.15.78:0/2458288115 wait complete. 2024-04-25T02:09:58.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-25T02:09:58.549 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:09:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.657+0000 7f36d6d90700 1 Processor -- start 2024-04-25T02:09:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d6d90700 1 -- start start 2024-04-25T02:09:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d6d90700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d00972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d6d90700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36d0127b70 0x7f36d012a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d6d90700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d00652a0 con 0x7f36d0127fb0 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d6d90700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d0066140 con 0x7f36d0127b70 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d6d90700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00649e0 con 0x7f36d0065d60 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d4b2c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d00972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36cffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36d0127b70 0x7f36d012a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d532d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f36d0127fb0 0x7f36d012ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35388/0 (socket says 172.21.15.78:35388) 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d532d700 1 -- 172.21.15.78:0/3597925848 learned_addr learned my addr 172.21.15.78:0/3597925848 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d4b2c700 1 -- 172.21.15.78:0/3597925848 >> v2:172.21.15.78:3300/0 conn(0x7f36d0127b70 msgr2=0x7f36d012a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d4b2c700 1 --2- 172.21.15.78:0/3597925848 >> v2:172.21.15.78:3300/0 conn(0x7f36d0127b70 0x7f36d012a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d4b2c700 1 -- 172.21.15.78:0/3597925848 >> v1:172.21.15.78:6789/0 conn(0x7f36d0127fb0 legacy=0x7f36d012ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36d4b2c700 1 -- 172.21.15.78:0/3597925848 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0097fb0 con 0x7f36d0065d60 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36cf7fe700 1 -- 172.21.15.78:0/3597925848 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128895046 0 0) 0x7f36d00652a0 con 0x7f36d0127fb0 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.658+0000 7f36cffff700 1 --2- 172.21.15.78:0/3597925848 >> v2:172.21.15.78:3300/0 conn(0x7f36d0127b70 0x7f36d012a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36d4b2c700 1 --2- 172.21.15.78:0/3597925848 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d00972f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f36c4009760 tx=0x7f36c4009060).ready entity=mon.1 client_cookie=ca4163cfecfdaa14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:58.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36cf7fe700 1 -- 172.21.15.78:0/3597925848 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c400f510 con 0x7f36d0065d60 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36cf7fe700 1 -- 172.21.15.78:0/3597925848 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c400f670 con 0x7f36d0065d60 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36cf7fe700 1 -- 172.21.15.78:0/3597925848 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c400f9f0 con 0x7f36d0065d60 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36d6d90700 1 -- 172.21.15.78:0/3597925848 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 msgr2=0x7f36d00972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36d6d90700 1 --2- 172.21.15.78:0/3597925848 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d00972f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f36c4009760 tx=0x7f36c4009060).stop 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36d6d90700 1 -- 172.21.15.78:0/3597925848 shutdown_connections 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36d6d90700 1 --2- 172.21.15.78:0/3597925848 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d00972f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36d6d90700 1 --2- 172.21.15.78:0/3597925848 >> v2:172.21.15.78:3300/0 conn(0x7f36d0127b70 0x7f36d012a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36d6d90700 1 -- 172.21.15.78:0/3597925848 >> 172.21.15.78:0/3597925848 conn(0x7f36d009ba80 msgr2=0x7f36d009be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36d6d90700 1 -- 172.21.15.78:0/3597925848 shutdown_connections 2024-04-25T02:09:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.659+0000 7f36d6d90700 1 -- 172.21.15.78:0/3597925848 wait complete. 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.660+0000 7f36d6d90700 1 Processor -- start 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.660+0000 7f36d6d90700 1 -- start start 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d6d90700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d0125890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d6d90700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f36d0127b70 0x7f36d0114810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d6d90700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d0127fb0 0x7f36d0114d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d6d90700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d0064c10 con 0x7f36d0127fb0 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d6d90700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d0118260 con 0x7f36d0065d60 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d6d90700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36d0126b10 con 0x7f36d0127b70 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d4b2c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d0125890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d532d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d0127fb0 0x7f36d0114d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d4b2c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d0125890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55458/0 (socket says 172.21.15.78:55458) 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36cffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f36d0127b70 0x7f36d0114810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.661+0000 7f36d4b2c700 1 -- 172.21.15.78:0/3701028319 learned_addr learned my addr 172.21.15.78:0/3701028319 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:58.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36d532d700 1 -- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f36d0127b70 msgr2=0x7f36d0114810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36d532d700 1 --2- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f36d0127b70 0x7f36d0114810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36d532d700 1 -- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 msgr2=0x7f36d0125890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36d532d700 1 --2- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d0125890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36d532d700 1 -- 172.21.15.78:0/3701028319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc0092a0 con 0x7f36d0127fb0 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36d4b2c700 1 --2- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d0125890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36cffff700 1 --2- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f36d0127b70 0x7f36d0114810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36d532d700 1 --2- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d0127fb0 0x7f36d0114d00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f36c8002230 tx=0x7f36c8007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36cd7fa700 1 -- 172.21.15.78:0/3701028319 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8005d30 con 0x7f36d0127fb0 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36cd7fa700 1 -- 172.21.15.78:0/3701028319 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c8005e90 con 0x7f36d0127fb0 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36cd7fa700 1 -- 172.21.15.78:0/3701028319 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8007360 con 0x7f36d0127fb0 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c40092a0 con 0x7f36d0127fb0 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.662+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d0118b00 con 0x7f36d0127fb0 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.663+0000 7f36cd7fa700 1 -- 172.21.15.78:0/3701028319 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f36c8007750 con 0x7f36d0127fb0 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.663+0000 7f36cd7fa700 1 -- 172.21.15.78:0/3701028319 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f36c803ac40 con 0x7f36d0127fb0 2024-04-25T02:09:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.663+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d0118b00 con 0x7f36d0127fb0 2024-04-25T02:09:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.667+0000 7f36cd7fa700 1 -- 172.21.15.78:0/3701028319 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f36d0118b00 con 0x7f36d0127fb0 2024-04-25T02:09:58.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.824+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f36d0118b00 con 0x7f36d0127fb0 2024-04-25T02:09:58.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.824+0000 7f36cd7fa700 1 -- 172.21.15.78:0/3701028319 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v11) v1 ==== 110+0+10 (secure 0 0 0) 0x7f36d0118b00 con 0x7f36d0127fb0 2024-04-25T02:09:58.832 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 >> v1:172.21.15.78:6816/46507 conn(0x7f36b402bd00 legacy=0x7f36b402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d0127fb0 msgr2=0x7f36d0114d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 --2- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d0127fb0 0x7f36d0114d00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f36c8002230 tx=0x7f36c8007eb0).stop 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 shutdown_connections 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 --2- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d0127fb0 0x7f36d0114d00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 --2- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d0065d60 0x7f36d0125890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 --2- 172.21.15.78:0/3701028319 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f36d0127b70 0x7f36d0114810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 >> 172.21.15.78:0/3701028319 conn(0x7f36d009ba80 msgr2=0x7f36d0069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 shutdown_connections 2024-04-25T02:09:58.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.826+0000 7f36d6d90700 1 -- 172.21.15.78:0/3701028319 wait complete. 2024-04-25T02:09:58.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:09:58.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.953+0000 7f12e3951700 1 Processor -- start 2024-04-25T02:09:58.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e3951700 1 -- start start 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e3951700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc092af0 0x7f12dc095b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e3951700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc130380 0x7f12dc132770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e3951700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12dc05ed80 con 0x7f12dc096000 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e3951700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc092ed0 con 0x7f12dc092af0 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e3951700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0931b0 con 0x7f12dc130380 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e1eee700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc130380 0x7f12dc132770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e0eec700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f12dc096000 0x7f12dc096400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35402/0 (socket says 172.21.15.78:35402) 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e16ed700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc092af0 0x7f12dc095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.954+0000 7f12e0eec700 1 -- 172.21.15.78:0/3998847077 learned_addr learned my addr 172.21.15.78:0/3998847077 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:09:58.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12d3fff700 1 -- 172.21.15.78:0/3998847077 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766433175 0 0) 0x7f12dc05ed80 con 0x7f12dc096000 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12e1eee700 1 -- 172.21.15.78:0/3998847077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc092af0 msgr2=0x7f12dc095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12e1eee700 1 --2- 172.21.15.78:0/3998847077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc092af0 0x7f12dc095b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12e1eee700 1 -- 172.21.15.78:0/3998847077 >> v1:172.21.15.78:6789/0 conn(0x7f12dc096000 legacy=0x7f12dc096400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12e1eee700 1 -- 172.21.15.78:0/3998847077 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc092640 con 0x7f12dc130380 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12e16ed700 1 --2- 172.21.15.78:0/3998847077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc092af0 0x7f12dc095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12e1eee700 1 --2- 172.21.15.78:0/3998847077 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc130380 0x7f12dc132770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f12d4009e90 tx=0x7f12d4009780).ready entity=mon.2 client_cookie=917a80ffbd6eaac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12d3fff700 1 -- 172.21.15.78:0/3998847077 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400e070 con 0x7f12dc130380 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12d3fff700 1 -- 172.21.15.78:0/3998847077 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d400bb60 con 0x7f12dc130380 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12d3fff700 1 -- 172.21.15.78:0/3998847077 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4012410 con 0x7f12dc130380 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12e3951700 1 -- 172.21.15.78:0/3998847077 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc130380 msgr2=0x7f12dc132770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.955+0000 7f12e3951700 1 --2- 172.21.15.78:0/3998847077 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc130380 0x7f12dc132770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f12d4009e90 tx=0x7f12d4009780).stop 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.956+0000 7f12e3951700 1 -- 172.21.15.78:0/3998847077 shutdown_connections 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.956+0000 7f12e3951700 1 --2- 172.21.15.78:0/3998847077 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc130380 0x7f12dc132770 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.956+0000 7f12e3951700 1 --2- 172.21.15.78:0/3998847077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc092af0 0x7f12dc095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.956+0000 7f12e3951700 1 -- 172.21.15.78:0/3998847077 >> 172.21.15.78:0/3998847077 conn(0x7f12dc09abf0 msgr2=0x7f12dc096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:58.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.956+0000 7f12e3951700 1 -- 172.21.15.78:0/3998847077 shutdown_connections 2024-04-25T02:09:58.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.956+0000 7f12e3951700 1 -- 172.21.15.78:0/3998847077 wait complete. 2024-04-25T02:09:58.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.957+0000 7f12e3951700 1 Processor -- start 2024-04-25T02:09:58.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.957+0000 7f12e3951700 1 -- start start 2024-04-25T02:09:58.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.957+0000 7f12e3951700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc092af0 0x7f12dc12f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.957+0000 7f12e3951700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12dc096000 0x7f12dc12f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.957+0000 7f12e3951700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc130380 0x7f12dc12fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.957+0000 7f12e3951700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc08e880 con 0x7f12dc096000 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.957+0000 7f12e3951700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc08ea60 con 0x7f12dc130380 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.957+0000 7f12e3951700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc090290 con 0x7f12dc092af0 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e16ed700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc092af0 0x7f12dc12f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e16ed700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc092af0 0x7f12dc12f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43200/0 (socket says 172.21.15.78:43200) 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e16ed700 1 -- 172.21.15.78:0/1966985464 learned_addr learned my addr 172.21.15.78:0/1966985464 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e0eec700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12dc096000 0x7f12dc12f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e1eee700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc130380 0x7f12dc12fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e16ed700 1 -- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc130380 msgr2=0x7f12dc12fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e16ed700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc130380 0x7f12dc12fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e16ed700 1 -- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12dc096000 msgr2=0x7f12dc12f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e16ed700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12dc096000 0x7f12dc12f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:58.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e16ed700 1 -- 172.21.15.78:0/1966985464 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc0092a0 con 0x7f12dc092af0 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e1eee700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc130380 0x7f12dc12fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e0eec700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12dc096000 0x7f12dc12f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e16ed700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc092af0 0x7f12dc12f390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f12cc00ea50 tx=0x7f12cc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12d1ffb700 1 -- 172.21.15.78:0/1966985464 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00ee90 con 0x7f12dc092af0 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12d1ffb700 1 -- 172.21.15.78:0/1966985464 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc00c850 con 0x7f12dc092af0 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d4009a20 con 0x7f12dc092af0 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12d1ffb700 1 -- 172.21.15.78:0/1966985464 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00cbd0 con 0x7f12dc092af0 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.958+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc06aa90 con 0x7f12dc092af0 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.959+0000 7f12d1ffb700 1 -- 172.21.15.78:0/1966985464 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f12cc01b400 con 0x7f12dc092af0 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.959+0000 7f12d1ffb700 1 -- 172.21.15.78:0/1966985464 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f12cc03b3d0 con 0x7f12dc092af0 2024-04-25T02:09:58.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.959+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc08cc10 con 0x7f12dc092af0 2024-04-25T02:09:58.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:58.964+0000 7f12d1ffb700 1 -- 172.21.15.78:0/1966985464 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f12cc0123f0 con 0x7f12dc092af0 2024-04-25T02:09:59.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.122+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12dc08f640 con 0x7f12dc092af0 2024-04-25T02:09:59.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.122+0000 7f12d1ffb700 1 -- 172.21.15.78:0/1966985464 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v11) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12cc011350 con 0x7f12dc092af0 2024-04-25T02:09:59.130 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:09:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 >> v1:172.21.15.78:6816/46507 conn(0x7f12c002bd00 legacy=0x7f12c002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc092af0 msgr2=0x7f12dc12f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc092af0 0x7f12dc12f390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f12cc00ea50 tx=0x7f12cc009060).stop 2024-04-25T02:09:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 shutdown_connections 2024-04-25T02:09:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12dc130380 0x7f12dc12fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12dc092af0 0x7f12dc12f390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 --2- 172.21.15.78:0/1966985464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12dc096000 0x7f12dc12f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 >> 172.21.15.78:0/1966985464 conn(0x7f12dc09abf0 msgr2=0x7f12dc099440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:59.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 shutdown_connections 2024-04-25T02:09:59.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.124+0000 7f12e3951700 1 -- 172.21.15.78:0/1966985464 wait complete. 2024-04-25T02:09:59.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.252+0000 7f798be00700 1 Processor -- start 2024-04-25T02:09:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.252+0000 7f798be00700 1 -- start start 2024-04-25T02:09:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798be00700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7984124000 0x7f79840961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798be00700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f79840937a0 0x7f79841243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798be00700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79841274e0 0x7f7984127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798be00700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7984096cf0 con 0x7f79840937a0 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798be00700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7984093ba0 con 0x7f79841274e0 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798be00700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7984092d00 con 0x7f7984124000 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f7989b9c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7984124000 0x7f79840961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798a39d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79841274e0 0x7f7984127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798a39d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79841274e0 0x7f7984127990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55482/0 (socket says 172.21.15.78:55482) 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f7989b9c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7984124000 0x7f79840961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43208/0 (socket says 172.21.15.78:43208) 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798a39d700 1 -- 172.21.15.78:0/995914902 learned_addr learned my addr 172.21.15.78:0/995914902 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798939b700 1 --2- 172.21.15.78:0/995914902 >> v2:172.21.15.78:3300/0 conn(0x7f79840937a0 0x7f79841243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f7989b9c700 1 -- 172.21.15.78:0/995914902 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79841274e0 msgr2=0x7f7984127990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f7989b9c700 1 --2- 172.21.15.78:0/995914902 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79841274e0 0x7f7984127990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f7989b9c700 1 -- 172.21.15.78:0/995914902 >> v2:172.21.15.78:3300/0 conn(0x7f79840937a0 msgr2=0x7f79841243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f7989b9c700 1 --2- 172.21.15.78:0/995914902 >> v2:172.21.15.78:3300/0 conn(0x7f79840937a0 0x7f79841243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f7989b9c700 1 -- 172.21.15.78:0/995914902 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840933a0 con 0x7f7984124000 2024-04-25T02:09:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798a39d700 1 --2- 172.21.15.78:0/995914902 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79841274e0 0x7f7984127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f798939b700 1 --2- 172.21.15.78:0/995914902 >> v2:172.21.15.78:3300/0 conn(0x7f79840937a0 0x7f79841243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.253+0000 7f7989b9c700 1 --2- 172.21.15.78:0/995914902 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7984124000 0x7f79840961a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f797400dbb0 tx=0x7f797400d500).ready entity=mon.2 client_cookie=c33479b247749c2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f7988b9a700 1 -- 172.21.15.78:0/995914902 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974012070 con 0x7f7984124000 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f7988b9a700 1 -- 172.21.15.78:0/995914902 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797400d2e0 con 0x7f7984124000 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f7988b9a700 1 -- 172.21.15.78:0/995914902 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400f790 con 0x7f7984124000 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f798be00700 1 -- 172.21.15.78:0/995914902 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7984124000 msgr2=0x7f79840961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f798be00700 1 --2- 172.21.15.78:0/995914902 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7984124000 0x7f79840961a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f797400dbb0 tx=0x7f797400d500).stop 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f798be00700 1 -- 172.21.15.78:0/995914902 shutdown_connections 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f798be00700 1 --2- 172.21.15.78:0/995914902 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79841274e0 0x7f7984127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f798be00700 1 --2- 172.21.15.78:0/995914902 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7984124000 0x7f79840961a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f798be00700 1 --2- 172.21.15.78:0/995914902 >> v2:172.21.15.78:3300/0 conn(0x7f79840937a0 0x7f79841243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f798be00700 1 -- 172.21.15.78:0/995914902 >> 172.21.15.78:0/995914902 conn(0x7f7984097450 msgr2=0x7f7984097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f798be00700 1 -- 172.21.15.78:0/995914902 shutdown_connections 2024-04-25T02:09:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.254+0000 7f798be00700 1 -- 172.21.15.78:0/995914902 wait complete. 2024-04-25T02:09:59.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.255+0000 7f798be00700 1 Processor -- start 2024-04-25T02:09:59.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.255+0000 7f798be00700 1 -- start start 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798be00700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f79840937a0 0x7f7984111c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798be00700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7984124000 0x7f7984112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798be00700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79841274e0 0x7f7984112600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798be00700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7984114e60 con 0x7f79841274e0 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798be00700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7984094fe0 con 0x7f7984124000 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798be00700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7984092440 con 0x7f79840937a0 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798939b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7984124000 0x7f7984112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f7989b9c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f79840937a0 0x7f7984111c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f7989b9c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f79840937a0 0x7f7984111c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43210/0 (socket says 172.21.15.78:43210) 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798939b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7984124000 0x7f7984112110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55484/0 (socket says 172.21.15.78:55484) 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f7989b9c700 1 -- 172.21.15.78:0/4017755101 learned_addr learned my addr 172.21.15.78:0/4017755101 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798a39d700 1 --2- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79841274e0 0x7f7984112600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f7989b9c700 1 -- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7984124000 msgr2=0x7f7984112110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f7989b9c700 1 --2- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7984124000 0x7f7984112110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f7989b9c700 1 -- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79841274e0 msgr2=0x7f7984112600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f7989b9c700 1 --2- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79841274e0 0x7f7984112600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f7989b9c700 1 -- 172.21.15.78:0/4017755101 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79800092a0 con 0x7f79840937a0 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f7989b9c700 1 --2- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f79840937a0 0x7f7984111c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f797400f8b0 tx=0x7f797400d500).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f797a7fc700 1 -- 172.21.15.78:0/4017755101 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400c6b0 con 0x7f79840937a0 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f797a7fc700 1 -- 172.21.15.78:0/4017755101 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797400c810 con 0x7f79840937a0 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c00bb00 con 0x7f79840937a0 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f797a7fc700 1 -- 172.21.15.78:0/4017755101 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400cbd0 con 0x7f79840937a0 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.256+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797400d740 con 0x7f79840937a0 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.257+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7984097f70 con 0x7f79840937a0 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.258+0000 7f797a7fc700 1 -- 172.21.15.78:0/4017755101 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f7974035430 con 0x7f79840937a0 2024-04-25T02:09:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.258+0000 7f797a7fc700 1 -- 172.21.15.78:0/4017755101 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f7974041000 con 0x7f79840937a0 2024-04-25T02:09:59.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.262+0000 7f797a7fc700 1 -- 172.21.15.78:0/4017755101 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f797402a990 con 0x7f79840937a0 2024-04-25T02:09:59.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.459+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7984091b30 con 0x7f79840937a0 2024-04-25T02:09:59.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.460+0000 7f797a7fc700 1 -- 172.21.15.78:0/4017755101 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1194 (secure 0 0 0) 0x7f797402a3c0 con 0x7f79840937a0 2024-04-25T02:09:59.468 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:59.468 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-25T02:09:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.461+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 >> v1:172.21.15.78:6816/46507 conn(0x7f796802bd00 legacy=0x7f796802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.462+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f79840937a0 msgr2=0x7f7984111c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.462+0000 7f798be00700 1 --2- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f79840937a0 0x7f7984111c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f797400f8b0 tx=0x7f797400d500).stop 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.462+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 shutdown_connections 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.462+0000 7f798be00700 1 --2- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79841274e0 0x7f7984112600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.462+0000 7f798be00700 1 --2- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f79840937a0 0x7f7984111c20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.462+0000 7f798be00700 1 --2- 172.21.15.78:0/4017755101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7984124000 0x7f7984112110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.462+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 >> 172.21.15.78:0/4017755101 conn(0x7f7984097450 msgr2=0x7f79841267a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.462+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 shutdown_connections 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.462+0000 7f798be00700 1 -- 172.21.15.78:0/4017755101 wait complete. 2024-04-25T02:09:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2024-04-25T02:09:59.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1ddccb700 1 Processor -- start 2024-04-25T02:09:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1ddccb700 1 -- start start 2024-04-25T02:09:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1ddccb700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8129040 0x7fc1d812d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1ddccb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1d812de00 0x7fc1d81301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1ddccb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d8095fb0 con 0x7fc1d8062860 2024-04-25T02:09:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1ddccb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80965c0 con 0x7fc1d812de00 2024-04-25T02:09:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1ddccb700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d81294a0 con 0x7fc1d8129040 2024-04-25T02:09:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1d6ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8129040 0x7fc1d812d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1d7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1d812de00 0x7fc1d81301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1d6ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8129040 0x7fc1d812d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43218/0 (socket says 172.21.15.78:43218) 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1d6ffd700 1 -- 172.21.15.78:0/206160920 learned_addr learned my addr 172.21.15.78:0/206160920 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.587+0000 7fc1d77fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc1d8062860 0x7fc1d8128930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35406/0 (socket says 172.21.15.78:35406) 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d67fc700 1 -- 172.21.15.78:0/206160920 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864509582 0 0) 0x7fc1d8095fb0 con 0x7fc1d8062860 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d67fc700 1 -- 172.21.15.78:0/206160920 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1c40033f0 con 0x7fc1d8062860 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d6ffd700 1 -- 172.21.15.78:0/206160920 >> v2:172.21.15.78:3300/0 conn(0x7fc1d812de00 msgr2=0x7fc1d81301f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d6ffd700 1 --2- 172.21.15.78:0/206160920 >> v2:172.21.15.78:3300/0 conn(0x7fc1d812de00 0x7fc1d81301f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d6ffd700 1 -- 172.21.15.78:0/206160920 >> v1:172.21.15.78:6789/0 conn(0x7fc1d8062860 legacy=0x7fc1d8128930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d6ffd700 1 -- 172.21.15.78:0/206160920 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8063310 con 0x7fc1d8129040 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d7fff700 1 --2- 172.21.15.78:0/206160920 >> v2:172.21.15.78:3300/0 conn(0x7fc1d812de00 0x7fc1d81301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d6ffd700 1 --2- 172.21.15.78:0/206160920 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8129040 0x7fc1d812d910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc1c0009830 tx=0x7fc1c00090f0).ready entity=mon.2 client_cookie=80a3faa398aa6d42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d67fc700 1 -- 172.21.15.78:0/206160920 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000f510 con 0x7fc1d8129040 2024-04-25T02:09:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d67fc700 1 -- 172.21.15.78:0/206160920 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c000f670 con 0x7fc1d8129040 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1d67fc700 1 -- 172.21.15.78:0/206160920 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000fa10 con 0x7fc1d8129040 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1ddccb700 1 -- 172.21.15.78:0/206160920 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8129040 msgr2=0x7fc1d812d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1ddccb700 1 --2- 172.21.15.78:0/206160920 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8129040 0x7fc1d812d910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc1c0009830 tx=0x7fc1c00090f0).stop 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1ddccb700 1 -- 172.21.15.78:0/206160920 shutdown_connections 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1ddccb700 1 --2- 172.21.15.78:0/206160920 >> v2:172.21.15.78:3300/0 conn(0x7fc1d812de00 0x7fc1d81301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1ddccb700 1 --2- 172.21.15.78:0/206160920 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8129040 0x7fc1d812d910 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1ddccb700 1 -- 172.21.15.78:0/206160920 >> 172.21.15.78:0/206160920 conn(0x7fc1d8097450 msgr2=0x7fc1d8097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1ddccb700 1 -- 172.21.15.78:0/206160920 shutdown_connections 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.588+0000 7fc1ddccb700 1 -- 172.21.15.78:0/206160920 wait complete. 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.589+0000 7fc1ddccb700 1 Processor -- start 2024-04-25T02:09:59.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.589+0000 7fc1ddccb700 1 -- start start 2024-04-25T02:09:59.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1ddccb700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8062860 0x7fc1d81296e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1ddccb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1d8129040 0x7fc1d8129bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1ddccb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1d812de00 0x7fc1d812a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1ddccb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80956f0 con 0x7fc1d812de00 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1ddccb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d812d650 con 0x7fc1d8129040 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1ddccb700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d812b220 con 0x7fc1d8062860 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d77fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8062860 0x7fc1d81296e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d6ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1d8129040 0x7fc1d8129bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1d812de00 0x7fc1d812a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1d812de00 0x7fc1d812a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32864/0 (socket says 172.21.15.78:32864) 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d7fff700 1 -- 172.21.15.78:0/3918236928 learned_addr learned my addr 172.21.15.78:0/3918236928 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d6ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1d8129040 0x7fc1d8129bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55492/0 (socket says 172.21.15.78:55492) 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d77fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8062860 0x7fc1d81296e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43222/0 (socket says 172.21.15.78:43222) 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d7fff700 1 -- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8062860 msgr2=0x7fc1d81296e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d7fff700 1 --2- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8062860 0x7fc1d81296e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d7fff700 1 -- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1d8129040 msgr2=0x7fc1d8129bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d7fff700 1 --2- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1d8129040 0x7fc1d8129bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d7fff700 1 -- 172.21.15.78:0/3918236928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00092a0 con 0x7fc1d812de00 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d6ffd700 1 --2- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1d8129040 0x7fc1d8129bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.590+0000 7fc1d7fff700 1 --2- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1d812de00 0x7fc1d812a0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc1d000e950 tx=0x7fc1d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.591+0000 7fc1cffff700 1 -- 172.21.15.78:0/3918236928 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0009580 con 0x7fc1d812de00 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.591+0000 7fc1cffff700 1 -- 172.21.15.78:0/3918236928 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d0012600 con 0x7fc1d812de00 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.591+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c0009370 con 0x7fc1d812de00 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.591+0000 7fc1cffff700 1 -- 172.21.15.78:0/3918236928 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00129a0 con 0x7fc1d812de00 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.591+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8110df0 con 0x7fc1d812de00 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.591+0000 7fc1cffff700 1 -- 172.21.15.78:0/3918236928 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fc1d0012d10 con 0x7fc1d812de00 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.591+0000 7fc1cffff700 1 -- 172.21.15.78:0/3918236928 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fc1d003b330 con 0x7fc1d812de00 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.592+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d812ccd0 con 0x7fc1d812de00 2024-04-25T02:09:59.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.596+0000 7fc1cffff700 1 -- 172.21.15.78:0/3918236928 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fc1d812ccd0 con 0x7fc1d812de00 2024-04-25T02:09:59.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.755+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1d812ccd0 con 0x7fc1d812de00 2024-04-25T02:09:59.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.756+0000 7fc1cffff700 1 -- 172.21.15.78:0/3918236928 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8092 (secure 0 0 0) 0x7fc1d812ccd0 con 0x7fc1d812de00 2024-04-25T02:09:59.764 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:09:59.764 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":12,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:09:59.206861+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 >> v1:172.21.15.78:6816/46507 conn(0x7fc1b802bd30 legacy=0x7fc1b802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1d812de00 msgr2=0x7fc1d812a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 --2- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1d812de00 0x7fc1d812a0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc1d000e950 tx=0x7fc1d0009060).stop 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 shutdown_connections 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 --2- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1d812de00 0x7fc1d812a0c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 --2- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc1d8062860 0x7fc1d81296e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 --2- 172.21.15.78:0/3918236928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1d8129040 0x7fc1d8129bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 >> 172.21.15.78:0/3918236928 conn(0x7fc1d8097450 msgr2=0x7fc1d81250e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 shutdown_connections 2024-04-25T02:09:59.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.758+0000 7fc1ddccb700 1 -- 172.21.15.78:0/3918236928 wait complete. 2024-04-25T02:09:59.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-25T02:09:59.777 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:09:59.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.887+0000 7feb22868700 1 Processor -- start 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.887+0000 7feb22868700 1 -- start start 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.887+0000 7feb22868700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c12d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.887+0000 7feb22868700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 0x7feb1c12f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.887+0000 7feb22868700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c094c70 con 0x7feb1c095190 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.887+0000 7feb22868700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c096060 con 0x7feb1c095c80 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.887+0000 7feb22868700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c096570 con 0x7feb1c12d500 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c12d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7feb1c095190 0x7feb1c095570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35414/0 (socket says 172.21.15.78:35414) 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1bfff700 1 -- 172.21.15.78:0/881349518 learned_addr learned my addr 172.21.15.78:0/881349518 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb20e05700 1 --2- 172.21.15.78:0/881349518 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 0x7feb1c12f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1affd700 1 -- 172.21.15.78:0/881349518 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103082672 0 0) 0x7feb1c094c70 con 0x7feb1c095190 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1b7fe700 1 -- 172.21.15.78:0/881349518 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 msgr2=0x7feb1c12f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1b7fe700 1 --2- 172.21.15.78:0/881349518 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 0x7feb1c12f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1b7fe700 1 -- 172.21.15.78:0/881349518 >> v1:172.21.15.78:6789/0 conn(0x7feb1c095190 legacy=0x7feb1c095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1b7fe700 1 -- 172.21.15.78:0/881349518 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c096da0 con 0x7feb1c095c80 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1b7fe700 1 --2- 172.21.15.78:0/881349518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c12d010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7feb0c009790 tx=0x7feb0c009060).ready entity=mon.1 client_cookie=91e06bbf02044363 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1affd700 1 -- 172.21.15.78:0/881349518 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c0090d0 con 0x7feb1c095c80 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1affd700 1 -- 172.21.15.78:0/881349518 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c00f510 con 0x7feb1c095c80 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.888+0000 7feb1affd700 1 -- 172.21.15.78:0/881349518 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00f890 con 0x7feb1c095c80 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.889+0000 7feb22868700 1 -- 172.21.15.78:0/881349518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 msgr2=0x7feb1c12d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.889+0000 7feb22868700 1 --2- 172.21.15.78:0/881349518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c12d010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7feb0c009790 tx=0x7feb0c009060).stop 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.889+0000 7feb22868700 1 -- 172.21.15.78:0/881349518 shutdown_connections 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.889+0000 7feb22868700 1 --2- 172.21.15.78:0/881349518 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 0x7feb1c12f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.889+0000 7feb22868700 1 --2- 172.21.15.78:0/881349518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c12d010 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.889+0000 7feb22868700 1 -- 172.21.15.78:0/881349518 >> 172.21.15.78:0/881349518 conn(0x7feb1c09a970 msgr2=0x7feb1c09ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.889+0000 7feb22868700 1 -- 172.21.15.78:0/881349518 shutdown_connections 2024-04-25T02:09:59.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.889+0000 7feb22868700 1 -- 172.21.15.78:0/881349518 wait complete. 2024-04-25T02:09:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb22868700 1 Processor -- start 2024-04-25T02:09:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb22868700 1 -- start start 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb22868700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c095190 0x7feb1c0663d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb22868700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c0668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb22868700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 0x7feb1c066db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb22868700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0672a0 con 0x7feb1c095190 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb22868700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c11d790 con 0x7feb1c095c80 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb22868700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c068100 con 0x7feb1c12d500 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c095190 0x7feb1c0663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb1b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c0668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb20e05700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 0x7feb1c066db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c095190 0x7feb1c0663d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32866/0 (socket says 172.21.15.78:32866) 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.890+0000 7feb1bfff700 1 -- 172.21.15.78:0/3656742654 learned_addr learned my addr 172.21.15.78:0/3656742654 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb1b7fe700 1 -- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 msgr2=0x7feb1c066db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb1b7fe700 1 --2- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 0x7feb1c066db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb1b7fe700 1 -- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c095190 msgr2=0x7feb1c0663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb1b7fe700 1 --2- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c095190 0x7feb1c0663d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb1b7fe700 1 -- 172.21.15.78:0/3656742654 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c0092a0 con 0x7feb1c095c80 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb20e05700 1 --2- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 0x7feb1c066db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb1bfff700 1 --2- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c095190 0x7feb1c0663d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb1b7fe700 1 --2- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c0668c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7feb0c014000 tx=0x7feb0c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb18ff9700 1 -- 172.21.15.78:0/3656742654 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00f890 con 0x7feb1c095c80 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb18ff9700 1 -- 172.21.15.78:0/3656742654 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c000d10 con 0x7feb1c095c80 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c099540 con 0x7feb1c095c80 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb18ff9700 1 -- 172.21.15.78:0/3656742654 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00fea0 con 0x7feb1c095c80 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.891+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c11e410 con 0x7feb1c095c80 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.892+0000 7feb18ff9700 1 -- 172.21.15.78:0/3656742654 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7feb0c01b620 con 0x7feb1c095c80 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.892+0000 7feb18ff9700 1 -- 172.21.15.78:0/3656742654 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7feb0c03c5e0 con 0x7feb1c095c80 2024-04-25T02:09:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.892+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c092fb0 con 0x7feb1c095c80 2024-04-25T02:09:59.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:09:59.897+0000 7feb18ff9700 1 -- 172.21.15.78:0/3656742654 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7feb0c023400 con 0x7feb1c095c80 2024-04-25T02:10:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.055+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7feb1c09b490 con 0x7feb1c095c80 2024-04-25T02:10:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.055+0000 7feb18ff9700 1 -- 172.21.15.78:0/3656742654 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7feb0c0103a0 con 0x7feb1c095c80 2024-04-25T02:10:00.063 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 >> v1:172.21.15.78:6816/46507 conn(0x7feb0802bd30 legacy=0x7feb0802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 msgr2=0x7feb1c0668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 --2- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c0668c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7feb0c014000 tx=0x7feb0c017000).stop 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 shutdown_connections 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 --2- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7feb1c12d500 0x7feb1c066db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 --2- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c095190 0x7feb1c0663d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 --2- 172.21.15.78:0/3656742654 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7feb1c095c80 0x7feb1c0668c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 >> 172.21.15.78:0/3656742654 conn(0x7feb1c09a970 msgr2=0x7feb1c062860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 shutdown_connections 2024-04-25T02:10:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.057+0000 7feb22868700 1 -- 172.21.15.78:0/3656742654 wait complete. 2024-04-25T02:10:00.076 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:10:00.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f18549dd700 1 Processor -- start 2024-04-25T02:10:00.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f18549dd700 1 -- start start 2024-04-25T02:10:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f18549dd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 0x7f1850129100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f18549dd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1850095b10 0x7f1850095f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f18549dd700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185005f7b0 con 0x7f1850096400 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f18549dd700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1850128880 con 0x7f1850095b10 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f18549dd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1850128b20 con 0x7f1850128d20 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f184e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 0x7f1850129100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f184dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1850095b10 0x7f1850095f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.187+0000 7f184ed9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1850096400 0x7f185012fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35418/0 (socket says 172.21.15.78:35418) 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184ed9d700 1 -- 172.21.15.78:0/3461315495 learned_addr learned my addr 172.21.15.78:0/3461315495 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184dd9b700 1 -- 172.21.15.78:0/3461315495 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 msgr2=0x7f1850129100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184dd9b700 1 --2- 172.21.15.78:0/3461315495 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 0x7f1850129100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184dd9b700 1 -- 172.21.15.78:0/3461315495 >> v1:172.21.15.78:6789/0 conn(0x7f1850096400 legacy=0x7f185012fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184dd9b700 1 -- 172.21.15.78:0/3461315495 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185005ed80 con 0x7f1850095b10 2024-04-25T02:10:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184d59a700 1 -- 172.21.15.78:0/3461315495 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144310096 0 0) 0x7f185005f7b0 con 0x7f1850096400 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184e59c700 1 --2- 172.21.15.78:0/3461315495 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 0x7f1850129100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184dd9b700 1 --2- 172.21.15.78:0/3461315495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 0x7f1850095f10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1844009760 tx=0x7f1844009060).ready entity=mon.0 client_cookie=5fba7f819b29ca5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184d59a700 1 -- 172.21.15.78:0/3461315495 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400f510 con 0x7f1850095b10 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184d59a700 1 -- 172.21.15.78:0/3461315495 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184400f670 con 0x7f1850095b10 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f184d59a700 1 -- 172.21.15.78:0/3461315495 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400f9f0 con 0x7f1850095b10 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f18549dd700 1 -- 172.21.15.78:0/3461315495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 msgr2=0x7f1850095f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.188+0000 7f18549dd700 1 --2- 172.21.15.78:0/3461315495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 0x7f1850095f10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1844009760 tx=0x7f1844009060).stop 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.189+0000 7f18549dd700 1 -- 172.21.15.78:0/3461315495 shutdown_connections 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.189+0000 7f18549dd700 1 --2- 172.21.15.78:0/3461315495 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 0x7f1850129100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.189+0000 7f18549dd700 1 --2- 172.21.15.78:0/3461315495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 0x7f1850095f10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.189+0000 7f18549dd700 1 -- 172.21.15.78:0/3461315495 >> 172.21.15.78:0/3461315495 conn(0x7f185009abf0 msgr2=0x7f1850096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.189+0000 7f18549dd700 1 -- 172.21.15.78:0/3461315495 shutdown_connections 2024-04-25T02:10:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.189+0000 7f18549dd700 1 -- 172.21.15.78:0/3461315495 wait complete. 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f18549dd700 1 Processor -- start 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f18549dd700 1 -- start start 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f18549dd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 0x7f1850122ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f18549dd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1850096400 0x7f18501233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f18549dd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 0x7f18501238c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f18549dd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18501252c0 con 0x7f1850095b10 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f18549dd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18500909c0 con 0x7f1850128d20 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f18549dd700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1850127230 con 0x7f1850096400 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f184e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 0x7f1850122ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f184e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 0x7f1850122ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32876/0 (socket says 172.21.15.78:32876) 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f184e59c700 1 -- 172.21.15.78:0/3856267822 learned_addr learned my addr 172.21.15.78:0/3856267822 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f184ed9d700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 0x7f18501238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.190+0000 7f184dd9b700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1850096400 0x7f18501233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f184e59c700 1 -- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1850096400 msgr2=0x7f18501233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f184e59c700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1850096400 0x7f18501233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f184e59c700 1 -- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 msgr2=0x7f18501238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f184e59c700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 0x7f18501238c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f184e59c700 1 -- 172.21.15.78:0/3856267822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18400092a0 con 0x7f1850095b10 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f184dd9b700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1850096400 0x7f18501233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f184e59c700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 0x7f1850122ee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f184000ea20 tx=0x7f1840009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f183effd700 1 -- 172.21.15.78:0/3856267822 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000ee60 con 0x7f1850095b10 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f183effd700 1 -- 172.21.15.78:0/3856267822 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000c850 con 0x7f1850095b10 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18440092a0 con 0x7f1850095b10 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f183effd700 1 -- 172.21.15.78:0/3856267822 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000cbd0 con 0x7f1850095b10 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.191+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1850083a70 con 0x7f1850095b10 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.192+0000 7f183effd700 1 -- 172.21.15.78:0/3856267822 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f184001b400 con 0x7f1850095b10 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.192+0000 7f183effd700 1 -- 172.21.15.78:0/3856267822 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f184003b330 con 0x7f1850095b10 2024-04-25T02:10:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.192+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1850068cc0 con 0x7f1850095b10 2024-04-25T02:10:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.197+0000 7f183effd700 1 -- 172.21.15.78:0/3856267822 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f1840019900 con 0x7f1850095b10 2024-04-25T02:10:00.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.357+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18501262c0 con 0x7f1850095b10 2024-04-25T02:10:00.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.358+0000 7f183effd700 1 -- 172.21.15.78:0/3856267822 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1840019310 con 0x7f1850095b10 2024-04-25T02:10:00.365 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:10:00.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.359+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 >> v1:172.21.15.78:6816/46507 conn(0x7f183002bd30 legacy=0x7f183002e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.359+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 msgr2=0x7f1850122ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.359+0000 7f18549dd700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 0x7f1850122ee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f184000ea20 tx=0x7f1840009060).stop 2024-04-25T02:10:00.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.359+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 shutdown_connections 2024-04-25T02:10:00.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.359+0000 7f18549dd700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1850128d20 0x7f18501238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.359+0000 7f18549dd700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1850095b10 0x7f1850122ee0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.359+0000 7f18549dd700 1 --2- 172.21.15.78:0/3856267822 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1850096400 0x7f18501233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.360+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 >> 172.21.15.78:0/3856267822 conn(0x7f185009abf0 msgr2=0x7f1850099630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:00.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.360+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 shutdown_connections 2024-04-25T02:10:00.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.360+0000 7f18549dd700 1 -- 172.21.15.78:0/3856267822 wait complete. 2024-04-25T02:10:00.379 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:10:00.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.486+0000 7fc6c0e42700 1 Processor -- start 2024-04-25T02:10:00.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.486+0000 7fc6c0e42700 1 -- start start 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6c0e42700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc0961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6c0e42700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc1243e0 0x7fc6bc127bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6c0e42700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc096cf0 con 0x7fc6bc0937a0 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6c0e42700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc093ba0 con 0x7fc6bc1243e0 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6c0e42700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc092d00 con 0x7fc6bc124000 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc0961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6bad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc1243e0 0x7fc6bc127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6b9d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc6bc0937a0 0x7fc6bc1274e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35430/0 (socket says 172.21.15.78:35430) 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6b9d9b700 1 -- 172.21.15.78:0/1794198761 learned_addr learned my addr 172.21.15.78:0/1794198761 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6ba59c700 1 -- 172.21.15.78:0/1794198761 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc1243e0 msgr2=0x7fc6bc127bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6ba59c700 1 --2- 172.21.15.78:0/1794198761 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc1243e0 0x7fc6bc127bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6ba59c700 1 -- 172.21.15.78:0/1794198761 >> v1:172.21.15.78:6789/0 conn(0x7fc6bc0937a0 legacy=0x7fc6bc1274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6ba59c700 1 -- 172.21.15.78:0/1794198761 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc0933a0 con 0x7fc6bc124000 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6b959a700 1 -- 172.21.15.78:0/1794198761 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275302663 0 0) 0x7fc6bc096cf0 con 0x7fc6bc0937a0 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6bad9d700 1 --2- 172.21.15.78:0/1794198761 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc1243e0 0x7fc6bc127bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6ba59c700 1 --2- 172.21.15.78:0/1794198761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc0961a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc6b0009790 tx=0x7fc6b0009060).ready entity=mon.2 client_cookie=6b325f59435bd0ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.487+0000 7fc6b959a700 1 -- 172.21.15.78:0/1794198761 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00090d0 con 0x7fc6bc124000 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6b959a700 1 -- 172.21.15.78:0/1794198761 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000f510 con 0x7fc6bc124000 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6b959a700 1 -- 172.21.15.78:0/1794198761 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000f890 con 0x7fc6bc124000 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6c0e42700 1 -- 172.21.15.78:0/1794198761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 msgr2=0x7fc6bc0961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6c0e42700 1 --2- 172.21.15.78:0/1794198761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc0961a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc6b0009790 tx=0x7fc6b0009060).stop 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6c0e42700 1 -- 172.21.15.78:0/1794198761 shutdown_connections 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6c0e42700 1 --2- 172.21.15.78:0/1794198761 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc1243e0 0x7fc6bc127bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6c0e42700 1 --2- 172.21.15.78:0/1794198761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc0961a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6c0e42700 1 -- 172.21.15.78:0/1794198761 >> 172.21.15.78:0/1794198761 conn(0x7fc6bc097450 msgr2=0x7fc6bc097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6c0e42700 1 -- 172.21.15.78:0/1794198761 shutdown_connections 2024-04-25T02:10:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.488+0000 7fc6c0e42700 1 -- 172.21.15.78:0/1794198761 wait complete. 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.489+0000 7fc6c0e42700 1 Processor -- start 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.489+0000 7fc6c0e42700 1 -- start start 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6c0e42700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc0937a0 0x7fc6bc136f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6c0e42700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc137400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6c0e42700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6bc1243e0 0x7fc6bc068710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6c0e42700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc12bca0 con 0x7fc6bc1243e0 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6c0e42700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc098bc0 con 0x7fc6bc0937a0 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6c0e42700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc112920 con 0x7fc6bc124000 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6b9d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc137400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6bad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6bc1243e0 0x7fc6bc068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc0937a0 0x7fc6bc136f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6b9d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc137400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43250/0 (socket says 172.21.15.78:43250) 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6b9d9b700 1 -- 172.21.15.78:0/2430369725 learned_addr learned my addr 172.21.15.78:0/2430369725 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6ba59c700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc0937a0 0x7fc6bc136f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55540/0 (socket says 172.21.15.78:55540) 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6bad9d700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6bc1243e0 0x7fc6bc068710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32884/0 (socket says 172.21.15.78:32884) 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6bad9d700 1 -- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 msgr2=0x7fc6bc137400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6bad9d700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc137400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6bad9d700 1 -- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc0937a0 msgr2=0x7fc6bc136f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6bad9d700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc0937a0 0x7fc6bc136f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6bad9d700 1 -- 172.21.15.78:0/2430369725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b4009a20 con 0x7fc6bc1243e0 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6b9d9b700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc137400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6ba59c700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc0937a0 0x7fc6bc136f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6bad9d700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6bc1243e0 0x7fc6bc068710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc6b4009f10 tx=0x7fc6b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6aaffd700 1 -- 172.21.15.78:0/2430369725 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b400cb70 con 0x7fc6bc1243e0 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6aaffd700 1 -- 172.21.15.78:0/2430369725 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b400f040 con 0x7fc6bc1243e0 2024-04-25T02:10:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b00092a0 con 0x7fc6bc1243e0 2024-04-25T02:10:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6aaffd700 1 -- 172.21.15.78:0/2430369725 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4013400 con 0x7fc6bc1243e0 2024-04-25T02:10:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.490+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc1132e0 con 0x7fc6bc1243e0 2024-04-25T02:10:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.491+0000 7fc6aaffd700 1 -- 172.21.15.78:0/2430369725 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fc6b40137f0 con 0x7fc6bc1243e0 2024-04-25T02:10:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.491+0000 7fc6aaffd700 1 -- 172.21.15.78:0/2430369725 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fc6b403b940 con 0x7fc6bc1243e0 2024-04-25T02:10:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.491+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc092440 con 0x7fc6bc1243e0 2024-04-25T02:10:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.496+0000 7fc6aaffd700 1 -- 172.21.15.78:0/2430369725 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fc6b4007340 con 0x7fc6bc1243e0 2024-04-25T02:10:00.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.657+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc6bc097f70 con 0x7fc6bc1243e0 2024-04-25T02:10:00.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.657+0000 7fc6aaffd700 1 -- 172.21.15.78:0/2430369725 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc6b401cbb0 con 0x7fc6bc1243e0 2024-04-25T02:10:00.665 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:00.665 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-04-25T02:10:00.665 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-25T02:10:00.665 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-04-25T02:10:00.665 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "device_health_metrics" 2024-04-25T02:10:00.666 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-04-25T02:10:00.666 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-04-25T02:10:00.666 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2024-04-25T02:10:00.666 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2024-04-25T02:10:00.666 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-04-25T02:10:00.666 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 >> v1:172.21.15.78:6816/46507 conn(0x7fc69c02bd00 legacy=0x7fc69c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6bc1243e0 msgr2=0x7fc6bc068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6bc1243e0 0x7fc6bc068710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc6b4009f10 tx=0x7fc6b400b040).stop 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 shutdown_connections 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6bc1243e0 0x7fc6bc068710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc6bc0937a0 0x7fc6bc136f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 --2- 172.21.15.78:0/2430369725 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc6bc124000 0x7fc6bc137400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 >> 172.21.15.78:0/2430369725 conn(0x7fc6bc097450 msgr2=0x7fc6bc095080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 shutdown_connections 2024-04-25T02:10:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.659+0000 7fc6c0e42700 1 -- 172.21.15.78:0/2430369725 wait complete. 2024-04-25T02:10:00.678 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:10:00.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:10:00.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.789+0000 7fa84d54a700 1 Processor -- start 2024-04-25T02:10:00.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.789+0000 7fa84d54a700 1 -- start start 2024-04-25T02:10:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa84d54a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa848095b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa84d54a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa848096000 0x7fa848096400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa84d54a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa84812f370 0x7fa848131760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa84d54a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa848092ed0 con 0x7fa84812f370 2024-04-25T02:10:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa84d54a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480931b0 con 0x7fa848092af0 2024-04-25T02:10:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa84d54a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa848091e20 con 0x7fa848096000 2024-04-25T02:10:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa846ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa848095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa8477fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa84812f370 0x7fa848131760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa846ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa848095b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55552/0 (socket says 172.21.15.78:55552) 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa8467fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa848096000 0x7fa848096400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa846ffd700 1 -- 172.21.15.78:0/3760014143 learned_addr learned my addr 172.21.15.78:0/3760014143 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa8467fc700 1 -- 172.21.15.78:0/3760014143 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 msgr2=0x7fa848095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa8467fc700 1 --2- 172.21.15.78:0/3760014143 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa848095b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa8467fc700 1 -- 172.21.15.78:0/3760014143 >> v2:172.21.15.78:3300/0 conn(0x7fa84812f370 msgr2=0x7fa848131760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa8467fc700 1 --2- 172.21.15.78:0/3760014143 >> v2:172.21.15.78:3300/0 conn(0x7fa84812f370 0x7fa848131760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa8467fc700 1 -- 172.21.15.78:0/3760014143 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84805ed80 con 0x7fa848096000 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa8477fe700 1 --2- 172.21.15.78:0/3760014143 >> v2:172.21.15.78:3300/0 conn(0x7fa84812f370 0x7fa848131760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa8467fc700 1 --2- 172.21.15.78:0/3760014143 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa848096000 0x7fa848096400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa838009790 tx=0x7fa838009060).ready entity=mon.2 client_cookie=25b5cde4eeea5d2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa845ffb700 1 -- 172.21.15.78:0/3760014143 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800d4a0 con 0x7fa848096000 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa845ffb700 1 -- 172.21.15.78:0/3760014143 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800d600 con 0x7fa848096000 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.790+0000 7fa845ffb700 1 -- 172.21.15.78:0/3760014143 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800d980 con 0x7fa848096000 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.791+0000 7fa84d54a700 1 -- 172.21.15.78:0/3760014143 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa848096000 msgr2=0x7fa848096400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.791+0000 7fa84d54a700 1 --2- 172.21.15.78:0/3760014143 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa848096000 0x7fa848096400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa838009790 tx=0x7fa838009060).stop 2024-04-25T02:10:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.791+0000 7fa84d54a700 1 -- 172.21.15.78:0/3760014143 shutdown_connections 2024-04-25T02:10:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.791+0000 7fa84d54a700 1 --2- 172.21.15.78:0/3760014143 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa848095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.791+0000 7fa84d54a700 1 --2- 172.21.15.78:0/3760014143 >> v2:172.21.15.78:3300/0 conn(0x7fa84812f370 0x7fa848131760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.791+0000 7fa84d54a700 1 --2- 172.21.15.78:0/3760014143 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa848096000 0x7fa848096400 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.791+0000 7fa84d54a700 1 -- 172.21.15.78:0/3760014143 >> 172.21.15.78:0/3760014143 conn(0x7fa84809abf0 msgr2=0x7fa848096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.791+0000 7fa84d54a700 1 -- 172.21.15.78:0/3760014143 shutdown_connections 2024-04-25T02:10:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.791+0000 7fa84d54a700 1 -- 172.21.15.78:0/3760014143 wait complete. 2024-04-25T02:10:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.792+0000 7fa84d54a700 1 Processor -- start 2024-04-25T02:10:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.792+0000 7fa84d54a700 1 -- start start 2024-04-25T02:10:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.792+0000 7fa84d54a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa84812e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.792+0000 7fa84d54a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa848096000 0x7fa84812eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.792+0000 7fa84d54a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa84812f370 0x7fa84808b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.792+0000 7fa84d54a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84808c7e0 con 0x7fa848096000 2024-04-25T02:10:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.792+0000 7fa84d54a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84808e900 con 0x7fa848092af0 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.792+0000 7fa84d54a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa84808eea0 con 0x7fa84812f370 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa846ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa84812e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa8477fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa84812f370 0x7fa84808b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa846ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa84812e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55558/0 (socket says 172.21.15.78:55558) 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa846ffd700 1 -- 172.21.15.78:0/2144247991 learned_addr learned my addr 172.21.15.78:0/2144247991 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa8467fc700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa848096000 0x7fa84812eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa8477fe700 1 -- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 msgr2=0x7fa84812e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa8477fe700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa84812e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa8477fe700 1 -- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa848096000 msgr2=0x7fa84812eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa8477fe700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa848096000 0x7fa84812eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa8477fe700 1 -- 172.21.15.78:0/2144247991 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa840009a20 con 0x7fa84812f370 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa846ffd700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa84812e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa8467fc700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa848096000 0x7fa84812eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa8477fe700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa84812f370 0x7fa84808b370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa840009ee0 tx=0x7fa84000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa82f7fe700 1 -- 172.21.15.78:0/2144247991 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84000cb70 con 0x7fa84812f370 2024-04-25T02:10:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa82f7fe700 1 -- 172.21.15.78:0/2144247991 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84000f040 con 0x7fa84812f370 2024-04-25T02:10:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8380092a0 con 0x7fa84812f370 2024-04-25T02:10:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa82f7fe700 1 -- 172.21.15.78:0/2144247991 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840013400 con 0x7fa84812f370 2024-04-25T02:10:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.793+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84808e610 con 0x7fa84812f370 2024-04-25T02:10:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.794+0000 7fa82f7fe700 1 -- 172.21.15.78:0/2144247991 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fa8400137f0 con 0x7fa84812f370 2024-04-25T02:10:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.794+0000 7fa82f7fe700 1 -- 172.21.15.78:0/2144247991 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fa84003b770 con 0x7fa84812f370 2024-04-25T02:10:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.794+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa848098dd0 con 0x7fa84812f370 2024-04-25T02:10:00.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.799+0000 7fa82f7fe700 1 -- 172.21.15.78:0/2144247991 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fa840013aa0 con 0x7fa84812f370 2024-04-25T02:10:00.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:00.957+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa84808fa80 con 0x7fa84812f370 2024-04-25T02:10:01.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.339+0000 7fa82f7fe700 1 -- 172.21.15.78:0/2144247991 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa84002b0b0 con 0x7fa84812f370 2024-04-25T02:10:01.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.343+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 >> v1:172.21.15.78:6816/46507 conn(0x7fa83402bcd0 legacy=0x7fa83402e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:01.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.343+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa84812f370 msgr2=0x7fa84808b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:01.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.343+0000 7fa84d54a700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa84812f370 0x7fa84808b370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa840009ee0 tx=0x7fa84000b040).stop 2024-04-25T02:10:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.344+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 shutdown_connections 2024-04-25T02:10:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.344+0000 7fa84d54a700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa84812f370 0x7fa84808b370 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.344+0000 7fa84d54a700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa848092af0 0x7fa84812e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.344+0000 7fa84d54a700 1 --2- 172.21.15.78:0/2144247991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa848096000 0x7fa84812eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.344+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 >> 172.21.15.78:0/2144247991 conn(0x7fa84809abf0 msgr2=0x7fa848094a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.345+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 shutdown_connections 2024-04-25T02:10:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.345+0000 7fa84d54a700 1 -- 172.21.15.78:0/2144247991 wait complete. 2024-04-25T02:10:01.353 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-04-25T02:10:01.364 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:10:01.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.478+0000 7f49b4890700 1 Processor -- start 2024-04-25T02:10:01.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.478+0000 7f49b4890700 1 -- start start 2024-04-25T02:10:01.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49b4890700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0064b70 0x7f49b0098840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:01.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49b4890700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b0099130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:01.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49b4890700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49b012a7c0 0x7f49b012ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:01.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49b4890700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b0064f50 con 0x7f49b012a7c0 2024-04-25T02:10:01.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49b4890700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0091c40 con 0x7f49b0064b70 2024-04-25T02:10:01.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49b4890700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0065930 con 0x7f49b0098d30 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49ae59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0064b70 0x7f49b0098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49add9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b0099130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49aed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49b012a7c0 0x7f49b012ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49add9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b0099130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43272/0 (socket says 172.21.15.78:43272) 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49ae59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0064b70 0x7f49b0098840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55570/0 (socket says 172.21.15.78:55570) 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49add9b700 1 -- 172.21.15.78:0/861619485 learned_addr learned my addr 172.21.15.78:0/861619485 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49add9b700 1 -- 172.21.15.78:0/861619485 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0064b70 msgr2=0x7f49b0098840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49add9b700 1 --2- 172.21.15.78:0/861619485 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0064b70 0x7f49b0098840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49add9b700 1 -- 172.21.15.78:0/861619485 >> v2:172.21.15.78:3300/0 conn(0x7f49b012a7c0 msgr2=0x7f49b012ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49add9b700 1 --2- 172.21.15.78:0/861619485 >> v2:172.21.15.78:3300/0 conn(0x7f49b012a7c0 0x7f49b012ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49add9b700 1 -- 172.21.15.78:0/861619485 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b0098530 con 0x7f49b0098d30 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49ae59c700 1 --2- 172.21.15.78:0/861619485 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0064b70 0x7f49b0098840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49add9b700 1 --2- 172.21.15.78:0/861619485 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b0099130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f49a0006fd0 tx=0x7f49a00090f0).ready entity=mon.2 client_cookie=ee1f5146dba899ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.479+0000 7f49ad59a700 1 -- 172.21.15.78:0/861619485 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a000f510 con 0x7f49b0098d30 2024-04-25T02:10:01.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49ad59a700 1 -- 172.21.15.78:0/861619485 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a000f670 con 0x7f49b0098d30 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49ad59a700 1 -- 172.21.15.78:0/861619485 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a000f9f0 con 0x7f49b0098d30 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49b4890700 1 -- 172.21.15.78:0/861619485 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 msgr2=0x7f49b0099130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49b4890700 1 --2- 172.21.15.78:0/861619485 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b0099130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f49a0006fd0 tx=0x7f49a00090f0).stop 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49b4890700 1 -- 172.21.15.78:0/861619485 shutdown_connections 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49b4890700 1 --2- 172.21.15.78:0/861619485 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0064b70 0x7f49b0098840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49b4890700 1 --2- 172.21.15.78:0/861619485 >> v2:172.21.15.78:3300/0 conn(0x7f49b012a7c0 0x7f49b012ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49b4890700 1 --2- 172.21.15.78:0/861619485 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b0099130 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49b4890700 1 -- 172.21.15.78:0/861619485 >> 172.21.15.78:0/861619485 conn(0x7f49b009e7a0 msgr2=0x7f49b009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49b4890700 1 -- 172.21.15.78:0/861619485 shutdown_connections 2024-04-25T02:10:01.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.480+0000 7f49b4890700 1 -- 172.21.15.78:0/861619485 wait complete. 2024-04-25T02:10:01.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.481+0000 7f49b4890700 1 Processor -- start 2024-04-25T02:10:01.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.481+0000 7f49b4890700 1 -- start start 2024-04-25T02:10:01.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49b4890700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b013a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49b4890700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b012a7c0 0x7f49b013a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49b4890700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0114190 0x7f49b01145d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49b4890700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0116cd0 con 0x7f49b012a7c0 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49b4890700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b009ca20 con 0x7f49b0114190 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49b4890700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0099a80 con 0x7f49b0098d30 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49ae59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b013a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49add9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b012a7c0 0x7f49b013a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49ae59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b013a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43284/0 (socket says 172.21.15.78:43284) 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49aed9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0114190 0x7f49b01145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49ae59c700 1 -- 172.21.15.78:0/609254742 learned_addr learned my addr 172.21.15.78:0/609254742 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49add9b700 1 -- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 msgr2=0x7f49b013a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49add9b700 1 --2- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b013a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49add9b700 1 -- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0114190 msgr2=0x7f49b01145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49add9b700 1 --2- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0114190 0x7f49b01145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49add9b700 1 -- 172.21.15.78:0/609254742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40092a0 con 0x7f49b012a7c0 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49aed9d700 1 --2- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0114190 0x7f49b01145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49ae59c700 1 --2- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b013a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49add9b700 1 --2- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b012a7c0 0x7f49b013a800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f49a0014000 tx=0x7f49a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f499effd700 1 -- 172.21.15.78:0/609254742 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a000fe30 con 0x7f49b012a7c0 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f499effd700 1 -- 172.21.15.78:0/609254742 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a000f7e0 con 0x7f49b012a7c0 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f499effd700 1 -- 172.21.15.78:0/609254742 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a001c670 con 0x7f49b012a7c0 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a0009370 con 0x7f49b012a7c0 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.482+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b0116f80 con 0x7f49b012a7c0 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.483+0000 7f499effd700 1 -- 172.21.15.78:0/609254742 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f49a001ca20 con 0x7f49b012a7c0 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.483+0000 7f499effd700 1 -- 172.21.15.78:0/609254742 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3208+0+0 (secure 0 0 0) 0x7f49a003cab0 con 0x7f49b012a7c0 2024-04-25T02:10:01.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.483+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b0063870 con 0x7f49b012a7c0 2024-04-25T02:10:01.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.488+0000 7f499effd700 1 -- 172.21.15.78:0/609254742 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f49a0020070 con 0x7f49b012a7c0 2024-04-25T02:10:01.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:01.648+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f49b0046ce0 con 0x7f49b012a7c0 2024-04-25T02:10:02.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.340+0000 7f499effd700 1 -- 172.21.15.78:0/609254742 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) v1 ==== 170+0+0 (secure 0 0 0) 0x7f49a00330d0 con 0x7f49b012a7c0 2024-04-25T02:10:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.350+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 >> v1:172.21.15.78:6816/46507 conn(0x7f499002bd00 legacy=0x7f499002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.350+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b012a7c0 msgr2=0x7f49b013a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.350+0000 7f49b4890700 1 --2- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b012a7c0 0x7f49b013a800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f49a0014000 tx=0x7f49a0017000).stop 2024-04-25T02:10:02.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.352+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 shutdown_connections 2024-04-25T02:10:02.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.352+0000 7f49b4890700 1 --2- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f49b0114190 0x7f49b01145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.352+0000 7f49b4890700 1 --2- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f49b0098d30 0x7f49b013a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.352+0000 7f49b4890700 1 --2- 172.21.15.78:0/609254742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49b012a7c0 0x7f49b013a800 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.352+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 >> 172.21.15.78:0/609254742 conn(0x7f49b0064b70 msgr2=0x7f49b012dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:02.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.353+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 shutdown_connections 2024-04-25T02:10:02.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.353+0000 7f49b4890700 1 -- 172.21.15.78:0/609254742 wait complete. 2024-04-25T02:10:02.364 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-04-25T02:10:02.382 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.491+0000 7f148a53f700 1 Processor -- start 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.491+0000 7f148a53f700 1 -- start start 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.491+0000 7f148a53f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f14840972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.491+0000 7f148a53f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1484127b70 0x7f148412a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.491+0000 7f148a53f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148412ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.491+0000 7f148a53f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1484066140 con 0x7f1484127b70 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.491+0000 7f148a53f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840652a0 con 0x7f1484065d60 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.491+0000 7f148a53f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14840649e0 con 0x7f1484127fb0 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1483fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f14840972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f14837fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1484127b70 0x7f148412a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f14837fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1484127b70 0x7f148412a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32920/0 (socket says 172.21.15.78:32920) 2024-04-25T02:10:02.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1488adc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148412ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1483fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f14840972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55592/0 (socket says 172.21.15.78:55592) 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f14837fe700 1 -- 172.21.15.78:0/1086383571 learned_addr learned my addr 172.21.15.78:0/1086383571 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1488adc700 1 -- 172.21.15.78:0/1086383571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 msgr2=0x7f14840972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1488adc700 1 --2- 172.21.15.78:0/1086383571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f14840972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1488adc700 1 -- 172.21.15.78:0/1086383571 >> v2:172.21.15.78:3300/0 conn(0x7f1484127b70 msgr2=0x7f148412a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1488adc700 1 --2- 172.21.15.78:0/1086383571 >> v2:172.21.15.78:3300/0 conn(0x7f1484127b70 0x7f148412a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1488adc700 1 -- 172.21.15.78:0/1086383571 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484097fb0 con 0x7f1484127fb0 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f14837fe700 1 --2- 172.21.15.78:0/1086383571 >> v2:172.21.15.78:3300/0 conn(0x7f1484127b70 0x7f148412a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1483fff700 1 --2- 172.21.15.78:0/1086383571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f14840972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1488adc700 1 --2- 172.21.15.78:0/1086383571 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148412ad90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f147c009e90 tx=0x7f147c009780).ready entity=mon.2 client_cookie=898c9572b32029e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1482ffd700 1 -- 172.21.15.78:0/1086383571 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00e070 con 0x7f1484127fb0 2024-04-25T02:10:02.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1482ffd700 1 -- 172.21.15.78:0/1086383571 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00ba70 con 0x7f1484127fb0 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.492+0000 7f1482ffd700 1 -- 172.21.15.78:0/1086383571 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00bdf0 con 0x7f1484127fb0 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.493+0000 7f148a53f700 1 -- 172.21.15.78:0/1086383571 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 msgr2=0x7f148412ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.493+0000 7f148a53f700 1 --2- 172.21.15.78:0/1086383571 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148412ad90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f147c009e90 tx=0x7f147c009780).stop 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.493+0000 7f148a53f700 1 -- 172.21.15.78:0/1086383571 shutdown_connections 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.493+0000 7f148a53f700 1 --2- 172.21.15.78:0/1086383571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f14840972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.493+0000 7f148a53f700 1 --2- 172.21.15.78:0/1086383571 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148412ad90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.493+0000 7f148a53f700 1 --2- 172.21.15.78:0/1086383571 >> v2:172.21.15.78:3300/0 conn(0x7f1484127b70 0x7f148412a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.493+0000 7f148a53f700 1 -- 172.21.15.78:0/1086383571 >> 172.21.15.78:0/1086383571 conn(0x7f148409ba80 msgr2=0x7f148409be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.493+0000 7f148a53f700 1 -- 172.21.15.78:0/1086383571 shutdown_connections 2024-04-25T02:10:02.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.493+0000 7f148a53f700 1 -- 172.21.15.78:0/1086383571 wait complete. 2024-04-25T02:10:02.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f148a53f700 1 Processor -- start 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f148a53f700 1 -- start start 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f148a53f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f1484069b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f148a53f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1484127b70 0x7f148413a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f148a53f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148413a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f148a53f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1484126340 con 0x7f1484127b70 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f148a53f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1484138090 con 0x7f1484065d60 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f148a53f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1484064c10 con 0x7f1484127fb0 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f14837fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1484127b70 0x7f148413a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f1483fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f1484069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f1488adc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148413a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f14837fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1484127b70 0x7f148413a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32930/0 (socket says 172.21.15.78:32930) 2024-04-25T02:10:02.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.494+0000 7f14837fe700 1 -- 172.21.15.78:0/842667980 learned_addr learned my addr 172.21.15.78:0/842667980 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1483fff700 1 -- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 msgr2=0x7f148413a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1483fff700 1 --2- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148413a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1483fff700 1 -- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1484127b70 msgr2=0x7f148413a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1483fff700 1 --2- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1484127b70 0x7f148413a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1483fff700 1 -- 172.21.15.78:0/842667980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14780092a0 con 0x7f1484065d60 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f14837fe700 1 --2- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1484127b70 0x7f148413a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1488adc700 1 --2- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148413a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1483fff700 1 --2- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f1484069b40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f147800e9b0 tx=0x7f1478009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1480ff9700 1 -- 172.21.15.78:0/842667980 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478012600 con 0x7f1484065d60 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1480ff9700 1 -- 172.21.15.78:0/842667980 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478012760 con 0x7f1484065d60 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1474009370 con 0x7f1484065d60 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f1480ff9700 1 -- 172.21.15.78:0/842667980 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478012ae0 con 0x7f1484065d60 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.495+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c009a20 con 0x7f1484065d60 2024-04-25T02:10:02.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.496+0000 7f1480ff9700 1 -- 172.21.15.78:0/842667980 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f147801b400 con 0x7f1484065d60 2024-04-25T02:10:02.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.496+0000 7f1480ff9700 1 -- 172.21.15.78:0/842667980 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3590+0+0 (secure 0 0 0) 0x7f147803b660 con 0x7f1484065d60 2024-04-25T02:10:02.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.496+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148413afa0 con 0x7f1484065d60 2024-04-25T02:10:02.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.501+0000 7f1480ff9700 1 -- 172.21.15.78:0/842667980 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f1478019900 con 0x7f1484065d60 2024-04-25T02:10:02.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.696+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1484114fe0 con 0x7f1484065d60 2024-04-25T02:10:02.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.703+0000 7f1480ff9700 1 -- 172.21.15.78:0/842667980 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1478019310 con 0x7f1484065d60 2024-04-25T02:10:02.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 >> v1:172.21.15.78:6816/46507 conn(0x7f147002bd00 legacy=0x7f147002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 msgr2=0x7f1484069b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 --2- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f1484069b40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f147800e9b0 tx=0x7f1478009060).stop 2024-04-25T02:10:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 shutdown_connections 2024-04-25T02:10:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 --2- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1484127fb0 0x7f148413a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 --2- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1484065d60 0x7f1484069b40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 --2- 172.21.15.78:0/842667980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1484127b70 0x7f148413a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 >> 172.21.15.78:0/842667980 conn(0x7f148409ba80 msgr2=0x7f148409a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 shutdown_connections 2024-04-25T02:10:02.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.706+0000 7f148a53f700 1 -- 172.21.15.78:0/842667980 wait complete. 2024-04-25T02:10:02.717 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 3 and data pool 4 2024-04-25T02:10:02.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.855+0000 7fd773246700 1 Processor -- start 2024-04-25T02:10:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.855+0000 7fd773246700 1 -- start start 2024-04-25T02:10:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd773246700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c12d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd773246700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd773246700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c095fb0 con 0x7fd76c062860 2024-04-25T02:10:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd773246700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0965c0 con 0x7fd76c12de00 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd773246700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c1294a0 con 0x7fd76c129040 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd76bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c12d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd7717e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd7717e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1301f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55612/0 (socket says 172.21.15.78:55612) 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd76bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c12d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43308/0 (socket says 172.21.15.78:43308) 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd7717e3700 1 -- 172.21.15.78:0/2166742668 learned_addr learned my addr 172.21.15.78:0/2166742668 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd76b7fe700 1 -- 172.21.15.78:0/2166742668 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819479074 0 0) 0x7fd76c095fb0 con 0x7fd76c062860 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd76b7fe700 1 -- 172.21.15.78:0/2166742668 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd75c0033f0 con 0x7fd76c062860 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd76bfff700 1 -- 172.21.15.78:0/2166742668 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 msgr2=0x7fd76c1301f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd76bfff700 1 --2- 172.21.15.78:0/2166742668 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1301f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd76bfff700 1 -- 172.21.15.78:0/2166742668 >> v1:172.21.15.78:6789/0 conn(0x7fd76c062860 legacy=0x7fd76c128930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd76bfff700 1 -- 172.21.15.78:0/2166742668 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c063310 con 0x7fd76c129040 2024-04-25T02:10:02.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.856+0000 7fd7717e3700 1 --2- 172.21.15.78:0/2166742668 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd76bfff700 1 --2- 172.21.15.78:0/2166742668 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c12d910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd758009790 tx=0x7fd758009060).ready entity=mon.2 client_cookie=ac4d4370d7db0f98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd76b7fe700 1 -- 172.21.15.78:0/2166742668 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800f510 con 0x7fd76c129040 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd76b7fe700 1 -- 172.21.15.78:0/2166742668 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75800f670 con 0x7fd76c129040 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd76b7fe700 1 -- 172.21.15.78:0/2166742668 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800f9f0 con 0x7fd76c129040 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd773246700 1 -- 172.21.15.78:0/2166742668 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 msgr2=0x7fd76c12d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd773246700 1 --2- 172.21.15.78:0/2166742668 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c12d910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd758009790 tx=0x7fd758009060).stop 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd773246700 1 -- 172.21.15.78:0/2166742668 shutdown_connections 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd773246700 1 --2- 172.21.15.78:0/2166742668 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd773246700 1 --2- 172.21.15.78:0/2166742668 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c12d910 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd773246700 1 -- 172.21.15.78:0/2166742668 >> 172.21.15.78:0/2166742668 conn(0x7fd76c097450 msgr2=0x7fd76c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd773246700 1 -- 172.21.15.78:0/2166742668 shutdown_connections 2024-04-25T02:10:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.857+0000 7fd773246700 1 -- 172.21.15.78:0/2166742668 wait complete. 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.858+0000 7fd773246700 1 Processor -- start 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.858+0000 7fd773246700 1 -- start start 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd773246700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd76c062860 0x7fd76c12d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd773246700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c1222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd773246700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd773246700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c093640 con 0x7fd76c062860 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd773246700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c12dbc0 con 0x7fd76c12de00 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd773246700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0956f0 con 0x7fd76c129040 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd76bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c1222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7717e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd76bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c1222d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43324/0 (socket says 172.21.15.78:43324) 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd76bfff700 1 -- 172.21.15.78:0/3223480223 learned_addr learned my addr 172.21.15.78:0/3223480223 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd770fe2700 1 --2- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd76c062860 0x7fd76c12d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7717e3700 1 -- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 msgr2=0x7fd76c1222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7717e3700 1 --2- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c1222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7717e3700 1 -- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd76c062860 msgr2=0x7fd76c12d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7717e3700 1 --2- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd76c062860 0x7fd76c12d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7717e3700 1 -- 172.21.15.78:0/3223480223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764009ae0 con 0x7fd76c12de00 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd76bfff700 1 --2- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c1222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7717e3700 1 --2- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1227c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd764009f10 tx=0x7fd76400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7697fa700 1 -- 172.21.15.78:0/3223480223 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640092e0 con 0x7fd76c12de00 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7697fa700 1 -- 172.21.15.78:0/3223480223 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76400f040 con 0x7fd76c12de00 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd7697fa700 1 -- 172.21.15.78:0/3223480223 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400cb70 con 0x7fd76c12de00 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7580092a0 con 0x7fd76c12de00 2024-04-25T02:10:02.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.859+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c12ad50 con 0x7fd76c12de00 2024-04-25T02:10:02.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.860+0000 7fd7697fa700 1 -- 172.21.15.78:0/3223480223 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fd764014460 con 0x7fd76c12de00 2024-04-25T02:10:02.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.860+0000 7fd7697fa700 1 -- 172.21.15.78:0/3223480223 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd76403b140 con 0x7fd76c12de00 2024-04-25T02:10:02.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.861+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c097f70 con 0x7fd76c12de00 2024-04-25T02:10:02.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:02.865+0000 7fd7697fa700 1 -- 172.21.15.78:0/3223480223 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fd764012360 con 0x7fd76c12de00 2024-04-25T02:10:03.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.021+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd76c063550 con 0x7fd76c12de00 2024-04-25T02:10:03.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.022+0000 7fd7697fa700 1 -- 172.21.15.78:0/3223480223 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11322 (secure 0 0 0) 0x7fd76401cb10 con 0x7fd76c12de00 2024-04-25T02:10:03.030 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:03.030 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":15,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:02.698477+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 >> v1:172.21.15.78:6816/46507 conn(0x7fd75002bd00 legacy=0x7fd75002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 msgr2=0x7fd76c1227c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 --2- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1227c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd764009f10 tx=0x7fd76400b040).stop 2024-04-25T02:10:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 shutdown_connections 2024-04-25T02:10:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 --2- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd76c12de00 0x7fd76c1227c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 --2- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd76c062860 0x7fd76c12d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 --2- 172.21.15.78:0/3223480223 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd76c129040 0x7fd76c1222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 >> 172.21.15.78:0/3223480223 conn(0x7fd76c097450 msgr2=0x7fd76c1250c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:03.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 shutdown_connections 2024-04-25T02:10:03.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.024+0000 7fd773246700 1 -- 172.21.15.78:0/3223480223 wait complete. 2024-04-25T02:10:03.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:03.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.149+0000 7fd7570e2700 1 Processor -- start 2024-04-25T02:10:03.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.149+0000 7fd7570e2700 1 -- start start 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd7570e2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7500961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd7570e2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7500937a0 0x7fd7501243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd7570e2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7501274e0 0x7fd750127960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd7570e2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd750096cf0 con 0x7fd7501274e0 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd7570e2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd750093ba0 con 0x7fd750124000 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd7570e2700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd750092d00 con 0x7fd7500937a0 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd74ffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7500937a0 0x7fd7501243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd754e7e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7500961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd75567f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7501274e0 0x7fd750127960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd754e7e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7500961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55634/0 (socket says 172.21.15.78:55634) 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd74ffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7500937a0 0x7fd7501243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43330/0 (socket says 172.21.15.78:43330) 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd75567f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7501274e0 0x7fd750127960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32942/0 (socket says 172.21.15.78:32942) 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd754e7e700 1 -- 172.21.15.78:0/2863390298 learned_addr learned my addr 172.21.15.78:0/2863390298 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd754e7e700 1 -- 172.21.15.78:0/2863390298 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7500937a0 msgr2=0x7fd7501243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd754e7e700 1 --2- 172.21.15.78:0/2863390298 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7500937a0 0x7fd7501243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd754e7e700 1 -- 172.21.15.78:0/2863390298 >> v2:172.21.15.78:3300/0 conn(0x7fd7501274e0 msgr2=0x7fd750127960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd754e7e700 1 --2- 172.21.15.78:0/2863390298 >> v2:172.21.15.78:3300/0 conn(0x7fd7501274e0 0x7fd750127960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd754e7e700 1 -- 172.21.15.78:0/2863390298 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500933a0 con 0x7fd750124000 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd74ffff700 1 --2- 172.21.15.78:0/2863390298 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7500937a0 0x7fd7501243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.150+0000 7fd75567f700 1 --2- 172.21.15.78:0/2863390298 >> v2:172.21.15.78:3300/0 conn(0x7fd7501274e0 0x7fd750127960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd754e7e700 1 --2- 172.21.15.78:0/2863390298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7500961a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd744006fd0 tx=0x7fd7440090f0).ready entity=mon.1 client_cookie=cc3b34d9552bf55a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd74f7fe700 1 -- 172.21.15.78:0/2863390298 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74400f510 con 0x7fd750124000 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd74f7fe700 1 -- 172.21.15.78:0/2863390298 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74400f670 con 0x7fd750124000 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd74f7fe700 1 -- 172.21.15.78:0/2863390298 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74400fa10 con 0x7fd750124000 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd7570e2700 1 -- 172.21.15.78:0/2863390298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 msgr2=0x7fd7500961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd7570e2700 1 --2- 172.21.15.78:0/2863390298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7500961a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd744006fd0 tx=0x7fd7440090f0).stop 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd7570e2700 1 -- 172.21.15.78:0/2863390298 shutdown_connections 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd7570e2700 1 --2- 172.21.15.78:0/2863390298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7500961a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd7570e2700 1 --2- 172.21.15.78:0/2863390298 >> v2:172.21.15.78:3300/0 conn(0x7fd7501274e0 0x7fd750127960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd7570e2700 1 --2- 172.21.15.78:0/2863390298 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7500937a0 0x7fd7501243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd7570e2700 1 -- 172.21.15.78:0/2863390298 >> 172.21.15.78:0/2863390298 conn(0x7fd750097450 msgr2=0x7fd750097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:03.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd7570e2700 1 -- 172.21.15.78:0/2863390298 shutdown_connections 2024-04-25T02:10:03.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.151+0000 7fd7570e2700 1 -- 172.21.15.78:0/2863390298 wait complete. 2024-04-25T02:10:03.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.152+0000 7fd7570e2700 1 Processor -- start 2024-04-25T02:10:03.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.152+0000 7fd7570e2700 1 -- start start 2024-04-25T02:10:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd7570e2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7500937a0 0x7fd750123a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd7570e2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7501159a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd7570e2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7501274e0 0x7fd750115e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd7570e2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd750118f30 con 0x7fd7500937a0 2024-04-25T02:10:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd7570e2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd750119b00 con 0x7fd750124000 2024-04-25T02:10:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd7570e2700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd750062a10 con 0x7fd7501274e0 2024-04-25T02:10:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd754e7e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7500937a0 0x7fd750123a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd75567f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7501274e0 0x7fd750115e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd754e7e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7500937a0 0x7fd750123a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32958/0 (socket says 172.21.15.78:32958) 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd754e7e700 1 -- 172.21.15.78:0/1799222717 learned_addr learned my addr 172.21.15.78:0/1799222717 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd74ffff700 1 --2- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7501159a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd754e7e700 1 -- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7501274e0 msgr2=0x7fd750115e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd754e7e700 1 --2- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7501274e0 0x7fd750115e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd754e7e700 1 -- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 msgr2=0x7fd7501159a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd754e7e700 1 --2- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7501159a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd754e7e700 1 -- 172.21.15.78:0/1799222717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c0092a0 con 0x7fd7500937a0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd754e7e700 1 --2- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7500937a0 0x7fd750123a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd744009df0 tx=0x7fd744017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd74d7fa700 1 -- 172.21.15.78:0/1799222717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744006930 con 0x7fd7500937a0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd74d7fa700 1 -- 172.21.15.78:0/1799222717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd744000bc0 con 0x7fd7500937a0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74800bc30 con 0x7fd7500937a0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd74d7fa700 1 -- 172.21.15.78:0/1799222717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744024470 con 0x7fd7500937a0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.153+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd744009370 con 0x7fd7500937a0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.154+0000 7fd74d7fa700 1 -- 172.21.15.78:0/1799222717 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fd744021070 con 0x7fd7500937a0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.154+0000 7fd74d7fa700 1 -- 172.21.15.78:0/1799222717 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd74403cac0 con 0x7fd7500937a0 2024-04-25T02:10:03.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.155+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd750097f70 con 0x7fd7500937a0 2024-04-25T02:10:03.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.159+0000 7fd74d7fa700 1 -- 172.21.15.78:0/1799222717 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fd744019960 con 0x7fd7500937a0 2024-04-25T02:10:03.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.319+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd750091b30 con 0x7fd7500937a0 2024-04-25T02:10:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.319+0000 7fd74d7fa700 1 -- 172.21.15.78:0/1799222717 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11322 (secure 0 0 0) 0x7fd744019390 con 0x7fd7500937a0 2024-04-25T02:10:03.327 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:03.327 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":15,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:02.698477+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 >> v1:172.21.15.78:6816/46507 conn(0x7fd73402bd30 legacy=0x7fd73402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7500937a0 msgr2=0x7fd750123a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 --2- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7500937a0 0x7fd750123a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd744009df0 tx=0x7fd744017000).stop 2024-04-25T02:10:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 shutdown_connections 2024-04-25T02:10:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 --2- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd7501274e0 0x7fd750115e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 --2- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7500937a0 0x7fd750123a30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 --2- 172.21.15.78:0/1799222717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd750124000 0x7fd7501159a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 >> 172.21.15.78:0/1799222717 conn(0x7fd750097450 msgr2=0x7fd7501268a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:03.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 shutdown_connections 2024-04-25T02:10:03.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.321+0000 7fd7570e2700 1 -- 172.21.15.78:0/1799222717 wait complete. 2024-04-25T02:10:03.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:10:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f697b2ac700 1 Processor -- start 2024-04-25T02:10:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f697b2ac700 1 -- start start 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f697b2ac700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6974095190 0x7f6974095570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f697b2ac700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f697412fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f697b2ac700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6974094c70 con 0x7f6974095a60 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f697b2ac700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6974096570 con 0x7f6974095190 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f697b2ac700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69740923f0 con 0x7f697412d720 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f6979849700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f697412fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f6979048700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6974095190 0x7f6974095570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f6979048700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6974095190 0x7f6974095570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42638/0 (socket says 172.21.15.78:42638) 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f6979849700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f697412fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40548/0 (socket says 172.21.15.78:40548) 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f6979048700 1 -- 172.21.15.78:0/1481181462 learned_addr learned my addr 172.21.15.78:0/1481181462 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.450+0000 7f6978847700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6974095a60 0x7f697412c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59892/0 (socket says 172.21.15.78:59892) 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f6979849700 1 -- 172.21.15.78:0/1481181462 >> v2:172.21.15.78:3300/0 conn(0x7f6974095190 msgr2=0x7f6974095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f6979849700 1 --2- 172.21.15.78:0/1481181462 >> v2:172.21.15.78:3300/0 conn(0x7f6974095190 0x7f6974095570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f6979849700 1 -- 172.21.15.78:0/1481181462 >> v1:172.21.15.78:6789/0 conn(0x7f6974095a60 legacy=0x7f697412c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f696bfff700 1 -- 172.21.15.78:0/1481181462 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193558174 0 0) 0x7f6974094c70 con 0x7f6974095a60 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f6979849700 1 -- 172.21.15.78:0/1481181462 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974096da0 con 0x7f697412d720 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f6979048700 1 --2- 172.21.15.78:0/1481181462 >> v2:172.21.15.78:3300/0 conn(0x7f6974095190 0x7f6974095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f6979849700 1 --2- 172.21.15.78:0/1481181462 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f697412fb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f696c009e60 tx=0x7f696c009780).ready entity=mon.2 client_cookie=1cff582b8bee1e78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f696bfff700 1 -- 172.21.15.78:0/1481181462 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c00e070 con 0x7f697412d720 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f696bfff700 1 -- 172.21.15.78:0/1481181462 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00bb60 con 0x7f697412d720 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.451+0000 7f696bfff700 1 -- 172.21.15.78:0/1481181462 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c012410 con 0x7f697412d720 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.452+0000 7f697b2ac700 1 -- 172.21.15.78:0/1481181462 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 msgr2=0x7f697412fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.452+0000 7f697b2ac700 1 --2- 172.21.15.78:0/1481181462 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f697412fb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f696c009e60 tx=0x7f696c009780).stop 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.452+0000 7f697b2ac700 1 -- 172.21.15.78:0/1481181462 shutdown_connections 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.452+0000 7f697b2ac700 1 --2- 172.21.15.78:0/1481181462 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f697412fb10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.452+0000 7f697b2ac700 1 --2- 172.21.15.78:0/1481181462 >> v2:172.21.15.78:3300/0 conn(0x7f6974095190 0x7f6974095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.452+0000 7f697b2ac700 1 -- 172.21.15.78:0/1481181462 >> 172.21.15.78:0/1481181462 conn(0x7f697409a970 msgr2=0x7f697409ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.452+0000 7f697b2ac700 1 -- 172.21.15.78:0/1481181462 shutdown_connections 2024-04-25T02:10:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.452+0000 7f697b2ac700 1 -- 172.21.15.78:0/1481181462 wait complete. 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.453+0000 7f697b2ac700 1 Processor -- start 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.453+0000 7f697b2ac700 1 -- start start 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.453+0000 7f697b2ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6974095190 0x7f6974117450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.453+0000 7f697b2ac700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6974095a60 0x7f6974117940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.453+0000 7f697b2ac700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f6974117e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f697b2ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6974119340 con 0x7f6974095190 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f697b2ac700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6974092540 con 0x7f6974095a60 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f697b2ac700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f697411a210 con 0x7f697412d720 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979048700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6974095190 0x7f6974117450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6978847700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6974095a60 0x7f6974117940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979048700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6974095190 0x7f6974117450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42646/0 (socket says 172.21.15.78:42646) 2024-04-25T02:10:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979048700 1 -- 172.21.15.78:0/2722509222 learned_addr learned my addr 172.21.15.78:0/2722509222 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979849700 1 --2- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f6974117e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979048700 1 -- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 msgr2=0x7f6974117e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979048700 1 --2- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f6974117e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979048700 1 -- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6974095a60 msgr2=0x7f6974117940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979048700 1 --2- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6974095a60 0x7f6974117940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979048700 1 -- 172.21.15.78:0/2722509222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009370 con 0x7f6974095190 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6978847700 1 --2- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6974095a60 0x7f6974117940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6979048700 1 --2- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6974095190 0x7f6974117450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6970009d50 tx=0x7f69700090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6969f76700 1 -- 172.21.15.78:0/2722509222 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000cb30 con 0x7f6974095190 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6969f76700 1 -- 172.21.15.78:0/2722509222 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697000cc90 con 0x7f6974095190 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c009a20 con 0x7f6974095190 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f6969f76700 1 -- 172.21.15.78:0/2722509222 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697001b650 con 0x7f6974095190 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.454+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697411ae90 con 0x7f6974095190 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.455+0000 7f6969f76700 1 -- 172.21.15.78:0/2722509222 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f697001ba40 con 0x7f6974095190 2024-04-25T02:10:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.455+0000 7f6969f76700 1 -- 172.21.15.78:0/2722509222 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f697003f850 con 0x7f6974095190 2024-04-25T02:10:03.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.455+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697411a3c0 con 0x7f6974095190 2024-04-25T02:10:03.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.460+0000 7f6969f76700 1 -- 172.21.15.78:0/2722509222 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f697411a3c0 con 0x7f6974095190 2024-04-25T02:10:03.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.656+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f697411a3c0 con 0x7f6974095190 2024-04-25T02:10:03.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.707+0000 7f6969f76700 1 -- 172.21.15.78:0/2722509222 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7f697411a3c0 con 0x7f6974095190 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 >> v1:172.21.15.78:6816/46507 conn(0x7f695802bd30 legacy=0x7f695802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6974095190 msgr2=0x7f6974117450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 --2- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6974095190 0x7f6974117450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6970009d50 tx=0x7f69700090f0).stop 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 shutdown_connections 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 --2- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f697412d720 0x7f6974117e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 --2- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6974095190 0x7f6974117450 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 --2- 172.21.15.78:0/2722509222 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6974095a60 0x7f6974117940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 >> 172.21.15.78:0/2722509222 conn(0x7f697409a970 msgr2=0x7f6974110e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 shutdown_connections 2024-04-25T02:10:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.709+0000 7f697b2ac700 1 -- 172.21.15.78:0/2722509222 wait complete. 2024-04-25T02:10:03.728 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:10:03.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f38058fa700 1 Processor -- start 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f38058fa700 1 -- start start 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f38058fa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3800064b70 0x7f3800098840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f38058fa700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f3800099130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f38058fa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380012ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f38058fa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3800064f50 con 0x7f3800064b70 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f38058fa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3800091c40 con 0x7f380012a7c0 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f38058fa700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3800065930 con 0x7f3800098d30 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f37fe7fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f3800099130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37ff7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380012ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.837+0000 7f37feffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3800064b70 0x7f3800098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fe7fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f3800099130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40568/0 (socket says 172.21.15.78:40568) 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37ff7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380012ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35132/0 (socket says 172.21.15.78:35132) 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fe7fc700 1 -- 172.21.15.78:0/1547827040 learned_addr learned my addr 172.21.15.78:0/1547827040 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fe7fc700 1 -- 172.21.15.78:0/1547827040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 msgr2=0x7f380012ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fe7fc700 1 --2- 172.21.15.78:0/1547827040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380012ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fe7fc700 1 -- 172.21.15.78:0/1547827040 >> v2:172.21.15.78:3300/0 conn(0x7f3800064b70 msgr2=0x7f3800098840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fe7fc700 1 --2- 172.21.15.78:0/1547827040 >> v2:172.21.15.78:3300/0 conn(0x7f3800064b70 0x7f3800098840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fe7fc700 1 -- 172.21.15.78:0/1547827040 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3800098530 con 0x7f3800098d30 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37ff7fe700 1 --2- 172.21.15.78:0/1547827040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380012ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37feffd700 1 --2- 172.21.15.78:0/1547827040 >> v2:172.21.15.78:3300/0 conn(0x7f3800064b70 0x7f3800098840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fe7fc700 1 --2- 172.21.15.78:0/1547827040 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f3800099130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f37f0009830 tx=0x7f37f00090f0).ready entity=mon.2 client_cookie=505d71910c215ff2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fdffb700 1 -- 172.21.15.78:0/1547827040 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f000f510 con 0x7f3800098d30 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fdffb700 1 -- 172.21.15.78:0/1547827040 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f000f670 con 0x7f3800098d30 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f37fdffb700 1 -- 172.21.15.78:0/1547827040 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f000f9f0 con 0x7f3800098d30 2024-04-25T02:10:03.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f38058fa700 1 -- 172.21.15.78:0/1547827040 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 msgr2=0x7f3800099130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.838+0000 7f38058fa700 1 --2- 172.21.15.78:0/1547827040 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f3800099130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f37f0009830 tx=0x7f37f00090f0).stop 2024-04-25T02:10:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.839+0000 7f38058fa700 1 -- 172.21.15.78:0/1547827040 shutdown_connections 2024-04-25T02:10:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.839+0000 7f38058fa700 1 --2- 172.21.15.78:0/1547827040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380012ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.839+0000 7f38058fa700 1 --2- 172.21.15.78:0/1547827040 >> v2:172.21.15.78:3300/0 conn(0x7f3800064b70 0x7f3800098840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.839+0000 7f38058fa700 1 --2- 172.21.15.78:0/1547827040 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f3800099130 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.839+0000 7f38058fa700 1 -- 172.21.15.78:0/1547827040 >> 172.21.15.78:0/1547827040 conn(0x7f380009e7a0 msgr2=0x7f380009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.839+0000 7f38058fa700 1 -- 172.21.15.78:0/1547827040 shutdown_connections 2024-04-25T02:10:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.839+0000 7f38058fa700 1 -- 172.21.15.78:0/1547827040 wait complete. 2024-04-25T02:10:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f38058fa700 1 Processor -- start 2024-04-25T02:10:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f38058fa700 1 -- start start 2024-04-25T02:10:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f38058fa700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f380013a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f38058fa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380013a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f38058fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380013acd0 0x7f3800114190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f38058fa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800117c40 con 0x7f380013acd0 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f38058fa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380013a0c0 con 0x7f380012a7c0 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f38058fa700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3800099a80 con 0x7f3800098d30 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37feffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f380013a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37feffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f380013a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40582/0 (socket says 172.21.15.78:40582) 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37feffd700 1 -- 172.21.15.78:0/1038003346 learned_addr learned my addr 172.21.15.78:0/1038003346 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37ff7fe700 1 --2- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380013acd0 0x7f3800114190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37fe7fc700 1 --2- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380013a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37feffd700 1 -- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 msgr2=0x7f380013a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37feffd700 1 --2- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380013a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37feffd700 1 -- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380013acd0 msgr2=0x7f3800114190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37feffd700 1 --2- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380013acd0 0x7f3800114190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.840+0000 7f37feffd700 1 -- 172.21.15.78:0/1038003346 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f40092a0 con 0x7f3800098d30 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.841+0000 7f37feffd700 1 --2- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f380013a2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f37f400ea80 tx=0x7f37f4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.841+0000 7f37e77fe700 1 -- 172.21.15.78:0/1038003346 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400c850 con 0x7f3800098d30 2024-04-25T02:10:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.841+0000 7f37e77fe700 1 -- 172.21.15.78:0/1038003346 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f400c9b0 con 0x7f3800098d30 2024-04-25T02:10:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.841+0000 7f37e77fe700 1 -- 172.21.15.78:0/1038003346 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400cd30 con 0x7f3800098d30 2024-04-25T02:10:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.841+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f8009a20 con 0x7f3800098d30 2024-04-25T02:10:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.841+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f0009370 con 0x7f3800098d30 2024-04-25T02:10:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.841+0000 7f37e77fe700 1 -- 172.21.15.78:0/1038003346 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f37f4012600 con 0x7f3800098d30 2024-04-25T02:10:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.842+0000 7f37e77fe700 1 -- 172.21.15.78:0/1038003346 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f37f403b770 con 0x7f3800098d30 2024-04-25T02:10:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.842+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38001171b0 con 0x7f3800098d30 2024-04-25T02:10:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:03.846+0000 7f37e77fe700 1 -- 172.21.15.78:0/1038003346 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f37f401b400 con 0x7f3800098d30 2024-04-25T02:10:04.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.045+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3800063870 con 0x7f3800098d30 2024-04-25T02:10:04.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.711+0000 7f37e77fe700 1 -- 172.21.15.78:0/1038003346 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7f37f4023350 con 0x7f3800098d30 2024-04-25T02:10:04.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 >> v1:172.21.15.78:6816/46507 conn(0x7f37ec02bd00 legacy=0x7f37ec02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:04.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 msgr2=0x7f380013a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:04.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 --2- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f380013a2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f37f400ea80 tx=0x7f37f4009060).stop 2024-04-25T02:10:04.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 shutdown_connections 2024-04-25T02:10:04.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 --2- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380013acd0 0x7f3800114190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:04.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 --2- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3800098d30 0x7f380013a2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:04.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 --2- 172.21.15.78:0/1038003346 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f380012a7c0 0x7f380013a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:04.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 >> 172.21.15.78:0/1038003346 conn(0x7f3800064b70 msgr2=0x7f380009b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:04.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 shutdown_connections 2024-04-25T02:10:04.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.713+0000 7f38058fa700 1 -- 172.21.15.78:0/1038003346 wait complete. 2024-04-25T02:10:04.735 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:10:04.735 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:04.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc91d368700 1 Processor -- start 2024-04-25T02:10:04.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc91d368700 1 -- start start 2024-04-25T02:10:04.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc91d368700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91812abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:04.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc91d368700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc91812a750 0x7fc91812b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:04.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc91d368700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc918065750 con 0x7fc918098530 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc91d368700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc918064eb0 con 0x7fc91812a750 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc91d368700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc918099930 con 0x7fc918064ad0 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc916ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91812abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc916ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91812abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40594/0 (socket says 172.21.15.78:40594) 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc916ffd700 1 -- 172.21.15.78:0/1437904168 learned_addr learned my addr 172.21.15.78:0/1437904168 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc9177fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc918098530 0x7fc9180989e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59908/0 (socket says 172.21.15.78:59908) 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.847+0000 7fc9167fc700 1 --2- 172.21.15.78:0/1437904168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc91812a750 0x7fc91812b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc916ffd700 1 -- 172.21.15.78:0/1437904168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc91812a750 msgr2=0x7fc91812b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc916ffd700 1 --2- 172.21.15.78:0/1437904168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc91812a750 0x7fc91812b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc915ffb700 1 -- 172.21.15.78:0/1437904168 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139547017 0 0) 0x7fc918065750 con 0x7fc918098530 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc916ffd700 1 -- 172.21.15.78:0/1437904168 >> v1:172.21.15.78:6789/0 conn(0x7fc918098530 legacy=0x7fc9180989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc916ffd700 1 -- 172.21.15.78:0/1437904168 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc918065b40 con 0x7fc918064ad0 2024-04-25T02:10:04.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc9167fc700 1 --2- 172.21.15.78:0/1437904168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc91812a750 0x7fc91812b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc916ffd700 1 --2- 172.21.15.78:0/1437904168 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91812abe0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc908009830 tx=0x7fc9080090f0).ready entity=mon.2 client_cookie=dd124784c1e52eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc915ffb700 1 -- 172.21.15.78:0/1437904168 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90800b520 con 0x7fc918064ad0 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc915ffb700 1 -- 172.21.15.78:0/1437904168 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90800b680 con 0x7fc918064ad0 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc915ffb700 1 -- 172.21.15.78:0/1437904168 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90800ba20 con 0x7fc918064ad0 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc91d368700 1 -- 172.21.15.78:0/1437904168 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 msgr2=0x7fc91812abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc91d368700 1 --2- 172.21.15.78:0/1437904168 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91812abe0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc908009830 tx=0x7fc9080090f0).stop 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc91d368700 1 -- 172.21.15.78:0/1437904168 shutdown_connections 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc91d368700 1 --2- 172.21.15.78:0/1437904168 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91812abe0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc91d368700 1 --2- 172.21.15.78:0/1437904168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc91812a750 0x7fc91812b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc91d368700 1 -- 172.21.15.78:0/1437904168 >> 172.21.15.78:0/1437904168 conn(0x7fc91809a630 msgr2=0x7fc91809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc91d368700 1 -- 172.21.15.78:0/1437904168 shutdown_connections 2024-04-25T02:10:04.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.848+0000 7fc91d368700 1 -- 172.21.15.78:0/1437904168 wait complete. 2024-04-25T02:10:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.849+0000 7fc91d368700 1 Processor -- start 2024-04-25T02:10:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc91d368700 1 -- start start 2024-04-25T02:10:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc91d368700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91813a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc91d368700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc918098530 0x7fc91813a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc91d368700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc918114170 0x7fc9181145d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:04.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc91d368700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9181179a0 con 0x7fc918114170 2024-04-25T02:10:04.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc91d368700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc918099ab0 con 0x7fc918098530 2024-04-25T02:10:04.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc91d368700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc91809d330 con 0x7fc918064ad0 2024-04-25T02:10:04.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc916ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91813a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:04.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc9167fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc918098530 0x7fc91813a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:04.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc916ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91813a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40596/0 (socket says 172.21.15.78:40596) 2024-04-25T02:10:04.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc9177fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc918114170 0x7fc9181145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:04.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc916ffd700 1 -- 172.21.15.78:0/1794357113 learned_addr learned my addr 172.21.15.78:0/1794357113 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:04.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc916ffd700 1 -- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc918098530 msgr2=0x7fc91813a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc916ffd700 1 --2- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc918098530 0x7fc91813a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc916ffd700 1 -- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc918114170 msgr2=0x7fc9181145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc916ffd700 1 --2- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc918114170 0x7fc9181145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc916ffd700 1 -- 172.21.15.78:0/1794357113 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0092a0 con 0x7fc918064ad0 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc9167fc700 1 --2- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc918098530 0x7fc91813a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc9177fe700 1 --2- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc918114170 0x7fc9181145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.850+0000 7fc916ffd700 1 --2- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91813a100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc9180658e0 tx=0x7fc908017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.851+0000 7fc8ff7fe700 1 -- 172.21.15.78:0/1794357113 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90800b520 con 0x7fc918064ad0 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.851+0000 7fc8ff7fe700 1 -- 172.21.15.78:0/1794357113 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908000bc0 con 0x7fc918064ad0 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.851+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc908009370 con 0x7fc918064ad0 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.851+0000 7fc8ff7fe700 1 -- 172.21.15.78:0/1794357113 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908006970 con 0x7fc918064ad0 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.851+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc918097180 con 0x7fc918064ad0 2024-04-25T02:10:04.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.851+0000 7fc8ff7fe700 1 -- 172.21.15.78:0/1794357113 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fc90801c630 con 0x7fc918064ad0 2024-04-25T02:10:04.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.851+0000 7fc8ff7fe700 1 -- 172.21.15.78:0/1794357113 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc90803cbb0 con 0x7fc918064ad0 2024-04-25T02:10:04.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.852+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91809b150 con 0x7fc918064ad0 2024-04-25T02:10:04.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:04.856+0000 7fc8ff7fe700 1 -- 172.21.15.78:0/1794357113 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fc908029020 con 0x7fc918064ad0 2024-04-25T02:10:05.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.053+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc918046ce0 con 0x7fc918064ad0 2024-04-25T02:10:05.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.053+0000 7fc8ff7fe700 1 -- 172.21.15.78:0/1794357113 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fc90801c8e0 con 0x7fc918064ad0 2024-04-25T02:10:05.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:05.061 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:02.698771+0000","modified":"2024-04-25T02:10:04.706190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 >> v1:172.21.15.78:6816/46507 conn(0x7fc90402bd00 legacy=0x7fc90402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 msgr2=0x7fc91813a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 --2- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91813a100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc9180658e0 tx=0x7fc908017000).stop 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 shutdown_connections 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 --2- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc918114170 0x7fc9181145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 --2- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc918064ad0 0x7fc91813a100 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 --2- 172.21.15.78:0/1794357113 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc918098530 0x7fc91813a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 >> 172.21.15.78:0/1794357113 conn(0x7fc91809a630 msgr2=0x7fc91809b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 shutdown_connections 2024-04-25T02:10:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.055+0000 7fc91d368700 1 -- 172.21.15.78:0/1794357113 wait complete. 2024-04-25T02:10:05.064 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-25T02:10:05.074 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.181+0000 7f39487a4700 1 Processor -- start 2024-04-25T02:10:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.181+0000 7f39487a4700 1 -- start start 2024-04-25T02:10:05.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f39487a4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3940127eb0 0x7f39401271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f39487a4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f3940131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f39487a4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3940096490 con 0x7f3940062860 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f39487a4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3940062c40 con 0x7f3940127eb0 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f39487a4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3940091b90 con 0x7f394012fb30 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3946d41700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f3940131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3945d3f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3940127eb0 0x7f39401271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3946540700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3940062860 0x7f39401277a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59920/0 (socket says 172.21.15.78:59920) 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3946d41700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f3940131f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35182/0 (socket says 172.21.15.78:35182) 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3946540700 1 -- 172.21.15.78:0/2685563885 learned_addr learned my addr 172.21.15.78:0/2685563885 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3945d3f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3940127eb0 0x7f39401271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42690/0 (socket says 172.21.15.78:42690) 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3946d41700 1 -- 172.21.15.78:0/2685563885 >> v2:172.21.15.78:3300/0 conn(0x7f3940127eb0 msgr2=0x7f39401271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3946d41700 1 --2- 172.21.15.78:0/2685563885 >> v2:172.21.15.78:3300/0 conn(0x7f3940127eb0 0x7f39401271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3946d41700 1 -- 172.21.15.78:0/2685563885 >> v1:172.21.15.78:6789/0 conn(0x7f3940062860 legacy=0x7f39401277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f394553e700 1 -- 172.21.15.78:0/2685563885 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282590337 0 0) 0x7f3940096490 con 0x7f3940062860 2024-04-25T02:10:05.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3946d41700 1 -- 172.21.15.78:0/2685563885 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940091e50 con 0x7f394012fb30 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3945d3f700 1 --2- 172.21.15.78:0/2685563885 >> v2:172.21.15.78:3300/0 conn(0x7f3940127eb0 0x7f39401271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f3946d41700 1 --2- 172.21.15.78:0/2685563885 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f3940131f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3938009e60 tx=0x7f3938009780).ready entity=mon.1 client_cookie=6460904b6dc1c5e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f394553e700 1 -- 172.21.15.78:0/2685563885 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393800e070 con 0x7f394012fb30 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f394553e700 1 -- 172.21.15.78:0/2685563885 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393800bb60 con 0x7f394012fb30 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.182+0000 7f394553e700 1 -- 172.21.15.78:0/2685563885 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938012410 con 0x7f394012fb30 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.183+0000 7f39487a4700 1 -- 172.21.15.78:0/2685563885 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 msgr2=0x7f3940131f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.183+0000 7f39487a4700 1 --2- 172.21.15.78:0/2685563885 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f3940131f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3938009e60 tx=0x7f3938009780).stop 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.183+0000 7f39487a4700 1 -- 172.21.15.78:0/2685563885 shutdown_connections 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.183+0000 7f39487a4700 1 --2- 172.21.15.78:0/2685563885 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f3940131f20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.183+0000 7f39487a4700 1 --2- 172.21.15.78:0/2685563885 >> v2:172.21.15.78:3300/0 conn(0x7f3940127eb0 0x7f39401271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.183+0000 7f39487a4700 1 -- 172.21.15.78:0/2685563885 >> 172.21.15.78:0/2685563885 conn(0x7f3940097450 msgr2=0x7f3940097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.183+0000 7f39487a4700 1 -- 172.21.15.78:0/2685563885 shutdown_connections 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.183+0000 7f39487a4700 1 -- 172.21.15.78:0/2685563885 wait complete. 2024-04-25T02:10:05.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f39487a4700 1 Processor -- start 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f39487a4700 1 -- start start 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f39487a4700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3940062860 0x7f3940126b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f39487a4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3940127eb0 0x7f394012d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f39487a4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f394012db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f39487a4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940096d20 con 0x7f3940127eb0 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f39487a4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394012f7e0 con 0x7f394012fb30 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f39487a4700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3940111ec0 con 0x7f3940062860 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f3945d3f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3940127eb0 0x7f394012d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f3946540700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3940062860 0x7f3940126b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f3945d3f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3940127eb0 0x7f394012d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42704/0 (socket says 172.21.15.78:42704) 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f3946540700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3940062860 0x7f3940126b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40608/0 (socket says 172.21.15.78:40608) 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f3945d3f700 1 -- 172.21.15.78:0/2720196769 learned_addr learned my addr 172.21.15.78:0/2720196769 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.184+0000 7f3946d41700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f394012db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3945d3f700 1 -- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3940062860 msgr2=0x7f3940126b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3945d3f700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3940062860 0x7f3940126b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3945d3f700 1 -- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 msgr2=0x7f394012db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3945d3f700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f394012db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3945d3f700 1 -- 172.21.15.78:0/2720196769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c0092a0 con 0x7f3940127eb0 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3946540700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3940062860 0x7f3940126b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3946d41700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f394012db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3945d3f700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3940127eb0 0x7f394012d6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f393c00ea20 tx=0x7f393c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3936ffd700 1 -- 172.21.15.78:0/2720196769 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00ee60 con 0x7f3940127eb0 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3936ffd700 1 -- 172.21.15.78:0/2720196769 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c00c850 con 0x7f3940127eb0 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f3936ffd700 1 -- 172.21.15.78:0/2720196769 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00cbd0 con 0x7f3940127eb0 2024-04-25T02:10:05.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3938009a20 con 0x7f3940127eb0 2024-04-25T02:10:05.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.185+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394012f230 con 0x7f3940127eb0 2024-04-25T02:10:05.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.186+0000 7f3936ffd700 1 -- 172.21.15.78:0/2720196769 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f393c01b400 con 0x7f3940127eb0 2024-04-25T02:10:05.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.186+0000 7f3936ffd700 1 -- 172.21.15.78:0/2720196769 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f393c03b6d0 con 0x7f3940127eb0 2024-04-25T02:10:05.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.186+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3940097f70 con 0x7f3940127eb0 2024-04-25T02:10:05.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.190+0000 7f3936ffd700 1 -- 172.21.15.78:0/2720196769 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f393c019900 con 0x7f3940127eb0 2024-04-25T02:10:05.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.349+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3940046ce0 con 0x7f3940127eb0 2024-04-25T02:10:05.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.349+0000 7f3936ffd700 1 -- 172.21.15.78:0/2720196769 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11309 (secure 0 0 0) 0x7f393c019310 con 0x7f3940127eb0 2024-04-25T02:10:05.357 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:05.357 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:03.700137+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 >> v1:172.21.15.78:6816/46507 conn(0x7f392402bd30 legacy=0x7f392402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3940127eb0 msgr2=0x7f394012d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3940127eb0 0x7f394012d6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f393c00ea20 tx=0x7f393c009060).stop 2024-04-25T02:10:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 shutdown_connections 2024-04-25T02:10:05.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f394012fb30 0x7f394012db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3940062860 0x7f3940126b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 --2- 172.21.15.78:0/2720196769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3940127eb0 0x7f394012d6a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 >> 172.21.15.78:0/2720196769 conn(0x7f3940097450 msgr2=0x7f3940099ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 shutdown_connections 2024-04-25T02:10:05.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.351+0000 7f39487a4700 1 -- 172.21.15.78:0/2720196769 wait complete. 2024-04-25T02:10:05.370 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:10:05.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:05.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.477+0000 7f5a8bdf3700 1 Processor -- start 2024-04-25T02:10:05.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.477+0000 7f5a8bdf3700 1 -- start start 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8bdf3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 0x7f5a8412c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8bdf3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5a8412c890 0x7f5a8412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8bdf3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a84093d70 con 0x7f5a84091450 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8bdf3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8406c260 con 0x7f5a8412c890 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8bdf3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a84099570 con 0x7f5a84091f40 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8938e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 0x7f5a8412c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8a390700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5a8412c890 0x7f5a8412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a89b8f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5a84091450 0x7f5a84091830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59930/0 (socket says 172.21.15.78:59930) 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a89b8f700 1 -- 172.21.15.78:0/431810295 learned_addr learned my addr 172.21.15.78:0/431810295 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8938e700 1 -- 172.21.15.78:0/431810295 >> v2:172.21.15.78:3300/0 conn(0x7f5a8412c890 msgr2=0x7f5a8412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8938e700 1 --2- 172.21.15.78:0/431810295 >> v2:172.21.15.78:3300/0 conn(0x7f5a8412c890 0x7f5a8412ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8938e700 1 -- 172.21.15.78:0/431810295 >> v1:172.21.15.78:6789/0 conn(0x7f5a84091450 legacy=0x7f5a84091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a88b8d700 1 -- 172.21.15.78:0/431810295 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072000524 0 0) 0x7f5a84093d70 con 0x7f5a84091450 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8938e700 1 -- 172.21.15.78:0/431810295 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a84093ad0 con 0x7f5a84091f40 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8a390700 1 --2- 172.21.15.78:0/431810295 >> v2:172.21.15.78:3300/0 conn(0x7f5a8412c890 0x7f5a8412ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a8938e700 1 --2- 172.21.15.78:0/431810295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 0x7f5a8412c3a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5a80009790 tx=0x7f5a80009060).ready entity=mon.1 client_cookie=f6febd09c0629262 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a88b8d700 1 -- 172.21.15.78:0/431810295 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a800090d0 con 0x7f5a84091f40 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a88b8d700 1 -- 172.21.15.78:0/431810295 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8000f510 con 0x7f5a84091f40 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.478+0000 7f5a88b8d700 1 -- 172.21.15.78:0/431810295 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8000f890 con 0x7f5a84091f40 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.479+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/431810295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 msgr2=0x7f5a8412c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.479+0000 7f5a8bdf3700 1 --2- 172.21.15.78:0/431810295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 0x7f5a8412c3a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5a80009790 tx=0x7f5a80009060).stop 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.479+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/431810295 shutdown_connections 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.479+0000 7f5a8bdf3700 1 --2- 172.21.15.78:0/431810295 >> v2:172.21.15.78:3300/0 conn(0x7f5a8412c890 0x7f5a8412ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.479+0000 7f5a8bdf3700 1 --2- 172.21.15.78:0/431810295 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 0x7f5a8412c3a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.479+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/431810295 >> 172.21.15.78:0/431810295 conn(0x7f5a840974d0 msgr2=0x7f5a84099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.479+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/431810295 shutdown_connections 2024-04-25T02:10:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.479+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/431810295 wait complete. 2024-04-25T02:10:05.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8bdf3700 1 Processor -- start 2024-04-25T02:10:05.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8bdf3700 1 -- start start 2024-04-25T02:10:05.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8bdf3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a84091450 0x7f5a84124da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8bdf3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 0x7f5a84068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8bdf3700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5a8412c890 0x7f5a84068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8bdf3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a84123e50 con 0x7f5a84091450 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8bdf3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840960c0 con 0x7f5a84091f40 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8bdf3700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a84093f00 con 0x7f5a8412c890 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a89b8f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a84091450 0x7f5a84124da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a89b8f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a84091450 0x7f5a84124da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42734/0 (socket says 172.21.15.78:42734) 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a89b8f700 1 -- 172.21.15.78:0/1222770117 learned_addr learned my addr 172.21.15.78:0/1222770117 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8938e700 1 --2- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 0x7f5a84068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.480+0000 7f5a8a390700 1 --2- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5a8412c890 0x7f5a84068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a89b8f700 1 -- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5a8412c890 msgr2=0x7f5a84068c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a89b8f700 1 --2- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5a8412c890 0x7f5a84068c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a89b8f700 1 -- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 msgr2=0x7f5a84068760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a89b8f700 1 --2- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 0x7f5a84068760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a89b8f700 1 -- 172.21.15.78:0/1222770117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c00ab30 con 0x7f5a84091450 2024-04-25T02:10:05.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a89b8f700 1 --2- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a84091450 0x7f5a84124da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5a7400c4f0 tx=0x7f5a74007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a7a7fc700 1 -- 172.21.15.78:0/1222770117 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400ce20 con 0x7f5a84091450 2024-04-25T02:10:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a7a7fc700 1 -- 172.21.15.78:0/1222770117 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a740072e0 con 0x7f5a84091450 2024-04-25T02:10:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a800092a0 con 0x7f5a84091450 2024-04-25T02:10:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a7a7fc700 1 -- 172.21.15.78:0/1222770117 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a740057a0 con 0x7f5a84091450 2024-04-25T02:10:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.481+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8406a480 con 0x7f5a84091450 2024-04-25T02:10:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.482+0000 7f5a7a7fc700 1 -- 172.21.15.78:0/1222770117 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f5a74005bd0 con 0x7f5a84091450 2024-04-25T02:10:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.482+0000 7f5a7a7fc700 1 -- 172.21.15.78:0/1222770117 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5a7403a940 con 0x7f5a84091450 2024-04-25T02:10:05.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.482+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a840992c0 con 0x7f5a84091450 2024-04-25T02:10:05.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.486+0000 7f5a7a7fc700 1 -- 172.21.15.78:0/1222770117 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f5a7401b340 con 0x7f5a84091450 2024-04-25T02:10:05.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.641+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a8409a660 con 0x7f5a6802bd00 2024-04-25T02:10:05.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.648+0000 7f5a7a7fc700 1 -- 172.21.15.78:0/1222770117 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243870 (unknown 2965378022 0 788581219) 0x7f5a8409a660 con 0x7f5a6802bd00 2024-04-25T02:10:05.659 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:05.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.650+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 >> v1:172.21.15.78:6816/46507 conn(0x7f5a6802bd00 legacy=0x7f5a6802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.650+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a84091450 msgr2=0x7f5a84124da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.650+0000 7f5a8bdf3700 1 --2- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a84091450 0x7f5a84124da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5a7400c4f0 tx=0x7f5a74007c10).stop 2024-04-25T02:10:05.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.651+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 shutdown_connections 2024-04-25T02:10:05.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.651+0000 7f5a8bdf3700 1 --2- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5a8412c890 0x7f5a84068c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.651+0000 7f5a8bdf3700 1 --2- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a84091450 0x7f5a84124da0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.651+0000 7f5a8bdf3700 1 --2- 172.21.15.78:0/1222770117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a84091f40 0x7f5a84068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.651+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 >> 172.21.15.78:0/1222770117 conn(0x7f5a840974d0 msgr2=0x7f5a84094930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:05.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.651+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 shutdown_connections 2024-04-25T02:10:05.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.651+0000 7f5a8bdf3700 1 -- 172.21.15.78:0/1222770117 wait complete. 2024-04-25T02:10:05.662 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:10:05.670 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-25T02:10:04.197283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339526+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339372+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343343+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340428+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.344335+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339818+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.342652+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343354+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340284+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.342708+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340878+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339676+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343883+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341907+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339945+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341878+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341864+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339122+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339150+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212589+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:09:59.212589+0000","last_peered":"2024-04-25T02:09:59.212589+0000","last_clean":"2024-04-25T02:09:59.212589+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:09:59.212589+0000","last_undegraded":"2024-04-25T02:09:59.212589+0000","last_fullsized":"2024-04-25T02:09:59.212589+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.344011+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467258+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:00.467258+0000","last_peered":"2024-04-25T02:10:00.467258+0000","last_clean":"2024-04-25T02:10:00.467258+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:00.467258+0000","last_undegraded":"2024-04-25T02:10:00.467258+0000","last_fullsized":"2024-04-25T02:10:00.467258+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339648+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212209+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:09:59.212209+0000","last_peered":"2024-04-25T02:09:59.212209+0000","last_clean":"2024-04-25T02:09:59.212209+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:09:59.212209+0000","last_undegraded":"2024-04-25T02:09:59.212209+0000","last_fullsized":"2024-04-25T02:09:59.212209+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339303+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467296+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:00.467296+0000","last_peered":"2024-04-25T02:10:00.467296+0000","last_clean":"2024-04-25T02:10:00.467296+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:00.467296+0000","last_undegraded":"2024-04-25T02:10:00.467296+0000","last_fullsized":"2024-04-25T02:10:00.467296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212692+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:09:59.212692+0000","last_peered":"2024-04-25T02:09:59.212692+0000","last_clean":"2024-04-25T02:09:59.212692+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:09:59.212692+0000","last_undegraded":"2024-04-25T02:09:59.212692+0000","last_fullsized":"2024-04-25T02:09:59.212692+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341274+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467331+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:00.467331+0000","last_peered":"2024-04-25T02:10:00.467331+0000","last_clean":"2024-04-25T02:10:00.467331+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:00.467331+0000","last_undegraded":"2024-04-25T02:10:00.467331+0000","last_fullsized":"2024-04-25T02:10:00.467331+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339837+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467272+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:00.467272+0000","last_peered":"2024-04-25T02:10:00.467272+0000","last_clean":"2024-04-25T02:10:00.467272+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:00.467272+0000","last_undegraded":"2024-04-25T02:10:00.467272+0000","last_fullsized":"2024-04-25T02:10:00.467272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339699+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339124+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212588+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:09:59.212588+0000","last_peered":"2024-04-25T02:09:59.212588+0000","last_clean":"2024-04-25T02:09:59.212588+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:09:59.212588+0000","last_undegraded":"2024-04-25T02:09:59.212588+0000","last_fullsized":"2024-04-25T02:09:59.212588+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467301+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:00.467301+0000","last_peered":"2024-04-25T02:10:00.467301+0000","last_clean":"2024-04-25T02:10:00.467301+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:00.467301+0000","last_undegraded":"2024-04-25T02:10:00.467301+0000","last_fullsized":"2024-04-25T02:10:00.467301+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340382+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341785+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340056+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343135+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343137+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340804+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:05.673 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:05.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe9a697c700 1 Processor -- start 2024-04-25T02:10:05.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe9a697c700 1 -- start start 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe9a697c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a00937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe9a697c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0127bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe9a697c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a0096cf0 con 0x7fe9a0124000 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe9a697c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0092d00 con 0x7fe9a00961a0 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe9a697c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a00933a0 con 0x7fe9a01243e0 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe99f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a00937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe9a4f19700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.816+0000 7fe99ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe9a0124000 0x7fe9a01274e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59940/0 (socket says 172.21.15.78:59940) 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe99ffff700 1 -- 172.21.15.78:0/1945618585 learned_addr learned my addr 172.21.15.78:0/1945618585 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe99effd700 1 -- 172.21.15.78:0/1945618585 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604305664 0 0) 0x7fe9a0096cf0 con 0x7fe9a0124000 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe99effd700 1 -- 172.21.15.78:0/1945618585 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9880033f0 con 0x7fe9a0124000 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe9a4f19700 1 -- 172.21.15.78:0/1945618585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 msgr2=0x7fe9a00937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:05.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe9a4f19700 1 --2- 172.21.15.78:0/1945618585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a00937a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe9a4f19700 1 -- 172.21.15.78:0/1945618585 >> v1:172.21.15.78:6789/0 conn(0x7fe9a0124000 legacy=0x7fe9a01274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe9a4f19700 1 -- 172.21.15.78:0/1945618585 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a0124a50 con 0x7fe9a01243e0 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe99f7fe700 1 --2- 172.21.15.78:0/1945618585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a00937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe9a4f19700 1 --2- 172.21.15.78:0/1945618585 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0127bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe998009e90 tx=0x7fe998009780).ready entity=mon.2 client_cookie=8b63eb366c413bc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe99effd700 1 -- 172.21.15.78:0/1945618585 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800e070 con 0x7fe9a01243e0 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe99effd700 1 -- 172.21.15.78:0/1945618585 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99800bab0 con 0x7fe9a01243e0 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.817+0000 7fe99effd700 1 -- 172.21.15.78:0/1945618585 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800be30 con 0x7fe9a01243e0 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.818+0000 7fe9a697c700 1 -- 172.21.15.78:0/1945618585 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 msgr2=0x7fe9a0127bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.818+0000 7fe9a697c700 1 --2- 172.21.15.78:0/1945618585 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0127bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe998009e90 tx=0x7fe998009780).stop 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.818+0000 7fe9a697c700 1 -- 172.21.15.78:0/1945618585 shutdown_connections 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.818+0000 7fe9a697c700 1 --2- 172.21.15.78:0/1945618585 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0127bf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.818+0000 7fe9a697c700 1 --2- 172.21.15.78:0/1945618585 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a00937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.818+0000 7fe9a697c700 1 -- 172.21.15.78:0/1945618585 >> 172.21.15.78:0/1945618585 conn(0x7fe9a0097450 msgr2=0x7fe9a0097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.818+0000 7fe9a697c700 1 -- 172.21.15.78:0/1945618585 shutdown_connections 2024-04-25T02:10:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.818+0000 7fe9a697c700 1 -- 172.21.15.78:0/1945618585 wait complete. 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe9a697c700 1 Processor -- start 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe9a697c700 1 -- start start 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe9a697c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a0123740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe9a697c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0124000 0x7fe9a01156a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe9a697c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe9a697c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0116b70 con 0x7fe9a0124000 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe9a697c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0117cd0 con 0x7fe9a00961a0 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe9a697c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0092470 con 0x7fe9a01243e0 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe99f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0124000 0x7fe9a01156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe99f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0124000 0x7fe9a01156a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42736/0 (socket says 172.21.15.78:42736) 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe99f7fe700 1 -- 172.21.15.78:0/1122466664 learned_addr learned my addr 172.21.15.78:0/1122466664 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe9a4f19700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.819+0000 7fe99ffff700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a0123740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99f7fe700 1 -- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 msgr2=0x7fe9a0115b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99f7fe700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0115b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99f7fe700 1 -- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 msgr2=0x7fe9a0123740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99f7fe700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a0123740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99f7fe700 1 -- 172.21.15.78:0/1122466664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940092a0 con 0x7fe9a0124000 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe9a4f19700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99ffff700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a0123740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99f7fe700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0124000 0x7fe9a01156a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe99400e9d0 tx=0x7fe994009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99cff9700 1 -- 172.21.15.78:0/1122466664 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99400c6a0 con 0x7fe9a0124000 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99cff9700 1 -- 172.21.15.78:0/1122466664 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99400c800 con 0x7fe9a0124000 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe998009a20 con 0x7fe9a0124000 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99cff9700 1 -- 172.21.15.78:0/1122466664 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99400cb80 con 0x7fe9a0124000 2024-04-25T02:10:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a01199e0 con 0x7fe9a0124000 2024-04-25T02:10:05.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.820+0000 7fe99cff9700 1 -- 172.21.15.78:0/1122466664 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fe99401b400 con 0x7fe9a0124000 2024-04-25T02:10:05.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.821+0000 7fe99cff9700 1 -- 172.21.15.78:0/1122466664 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe99403b540 con 0x7fe9a0124000 2024-04-25T02:10:05.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.821+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a01199e0 con 0x7fe9a0124000 2024-04-25T02:10:05.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.825+0000 7fe99cff9700 1 -- 172.21.15.78:0/1122466664 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fe9a01199e0 con 0x7fe9a0124000 2024-04-25T02:10:05.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.979+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9a0118c20 con 0x7fe98c02bd00 2024-04-25T02:10:05.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.985+0000 7fe99cff9700 1 -- 172.21.15.78:0/1122466664 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243870 (unknown 2965378022 0 788581219) 0x7fe990001690 con 0x7fe98c02bd00 2024-04-25T02:10:05.996 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:05.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.987+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 >> v1:172.21.15.78:6816/46507 conn(0x7fe98c02bd00 legacy=0x7fe98c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.987+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0124000 msgr2=0x7fe9a01156a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.987+0000 7fe9a697c700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0124000 0x7fe9a01156a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe99400e9d0 tx=0x7fe994009060).stop 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.988+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 shutdown_connections 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.988+0000 7fe9a697c700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe9a01243e0 0x7fe9a0115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.988+0000 7fe9a697c700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe9a00961a0 0x7fe9a0123740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.988+0000 7fe9a697c700 1 --2- 172.21.15.78:0/1122466664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9a0124000 0x7fe9a01156a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.988+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 >> 172.21.15.78:0/1122466664 conn(0x7fe9a0097450 msgr2=0x7fe9a0099590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.988+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 shutdown_connections 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:05.988+0000 7fe9a697c700 1 -- 172.21.15.78:0/1122466664 wait complete. 2024-04-25T02:10:05.998 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:10:06.007 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-25T02:10:04.197283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339526+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339372+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343343+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340428+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.344335+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339818+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.342652+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343354+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340284+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.342708+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340878+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339676+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343883+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341907+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339945+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341878+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341864+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339122+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339150+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212589+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:09:59.212589+0000","last_peered":"2024-04-25T02:09:59.212589+0000","last_clean":"2024-04-25T02:09:59.212589+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:09:59.212589+0000","last_undegraded":"2024-04-25T02:09:59.212589+0000","last_fullsized":"2024-04-25T02:09:59.212589+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.344011+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467258+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:00.467258+0000","last_peered":"2024-04-25T02:10:00.467258+0000","last_clean":"2024-04-25T02:10:00.467258+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:00.467258+0000","last_undegraded":"2024-04-25T02:10:00.467258+0000","last_fullsized":"2024-04-25T02:10:00.467258+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339648+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212209+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:09:59.212209+0000","last_peered":"2024-04-25T02:09:59.212209+0000","last_clean":"2024-04-25T02:09:59.212209+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:09:59.212209+0000","last_undegraded":"2024-04-25T02:09:59.212209+0000","last_fullsized":"2024-04-25T02:09:59.212209+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339303+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467296+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:00.467296+0000","last_peered":"2024-04-25T02:10:00.467296+0000","last_clean":"2024-04-25T02:10:00.467296+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:00.467296+0000","last_undegraded":"2024-04-25T02:10:00.467296+0000","last_fullsized":"2024-04-25T02:10:00.467296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212692+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:09:59.212692+0000","last_peered":"2024-04-25T02:09:59.212692+0000","last_clean":"2024-04-25T02:09:59.212692+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:09:59.212692+0000","last_undegraded":"2024-04-25T02:09:59.212692+0000","last_fullsized":"2024-04-25T02:09:59.212692+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341274+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467331+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:00.467331+0000","last_peered":"2024-04-25T02:10:00.467331+0000","last_clean":"2024-04-25T02:10:00.467331+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:00.467331+0000","last_undegraded":"2024-04-25T02:10:00.467331+0000","last_fullsized":"2024-04-25T02:10:00.467331+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339837+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467272+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:00.467272+0000","last_peered":"2024-04-25T02:10:00.467272+0000","last_clean":"2024-04-25T02:10:00.467272+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:00.467272+0000","last_undegraded":"2024-04-25T02:10:00.467272+0000","last_fullsized":"2024-04-25T02:10:00.467272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339699+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339124+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212588+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:09:59.212588+0000","last_peered":"2024-04-25T02:09:59.212588+0000","last_clean":"2024-04-25T02:09:59.212588+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:09:59.212588+0000","last_undegraded":"2024-04-25T02:09:59.212588+0000","last_fullsized":"2024-04-25T02:09:59.212588+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467301+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:00.467301+0000","last_peered":"2024-04-25T02:10:00.467301+0000","last_clean":"2024-04-25T02:10:00.467301+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:00.467301+0000","last_undegraded":"2024-04-25T02:10:00.467301+0000","last_fullsized":"2024-04-25T02:10:00.467301+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340382+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341785+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340056+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343135+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343137+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340804+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:06.010 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:06.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.153+0000 7f124537f700 1 Processor -- start 2024-04-25T02:10:06.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.153+0000 7f124537f700 1 -- start start 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f124537f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12401279d0 0x7f1240127db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f124537f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f124537f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1240093180 con 0x7f1240099330 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f124537f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1240094120 con 0x7f12401279d0 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f124537f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1240092a80 con 0x7f12401282a0 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123e7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123effd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12401279d0 0x7f1240127db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1240099330 0x7f124012ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59948/0 (socket says 172.21.15.78:59948) 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123f7fe700 1 -- 172.21.15.78:0/2397271017 learned_addr learned my addr 172.21.15.78:0/2397271017 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123e7fc700 1 -- 172.21.15.78:0/2397271017 >> v2:172.21.15.78:3300/0 conn(0x7f12401279d0 msgr2=0x7f1240127db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123e7fc700 1 --2- 172.21.15.78:0/2397271017 >> v2:172.21.15.78:3300/0 conn(0x7f12401279d0 0x7f1240127db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123e7fc700 1 -- 172.21.15.78:0/2397271017 >> v1:172.21.15.78:6789/0 conn(0x7f1240099330 legacy=0x7f124012ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123e7fc700 1 -- 172.21.15.78:0/2397271017 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240093440 con 0x7f12401282a0 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123dffb700 1 -- 172.21.15.78:0/2397271017 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729158563 0 0) 0x7f1240093180 con 0x7f1240099330 2024-04-25T02:10:06.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.154+0000 7f123effd700 1 --2- 172.21.15.78:0/2397271017 >> v2:172.21.15.78:3300/0 conn(0x7f12401279d0 0x7f1240127db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f123e7fc700 1 --2- 172.21.15.78:0/2397271017 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240098e40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1234009760 tx=0x7f1234009060).ready entity=mon.1 client_cookie=a3b2180ef3cd5670 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f123dffb700 1 -- 172.21.15.78:0/2397271017 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400f510 con 0x7f12401282a0 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f123dffb700 1 -- 172.21.15.78:0/2397271017 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123400f670 con 0x7f12401282a0 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f123dffb700 1 -- 172.21.15.78:0/2397271017 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400f9f0 con 0x7f12401282a0 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f124537f700 1 -- 172.21.15.78:0/2397271017 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 msgr2=0x7f1240098e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f124537f700 1 --2- 172.21.15.78:0/2397271017 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240098e40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1234009760 tx=0x7f1234009060).stop 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f124537f700 1 -- 172.21.15.78:0/2397271017 shutdown_connections 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f124537f700 1 --2- 172.21.15.78:0/2397271017 >> v2:172.21.15.78:3300/0 conn(0x7f12401279d0 0x7f1240127db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f124537f700 1 --2- 172.21.15.78:0/2397271017 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240098e40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f124537f700 1 -- 172.21.15.78:0/2397271017 >> 172.21.15.78:0/2397271017 conn(0x7f12400974d0 msgr2=0x7f1240099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f124537f700 1 -- 172.21.15.78:0/2397271017 shutdown_connections 2024-04-25T02:10:06.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.155+0000 7f124537f700 1 -- 172.21.15.78:0/2397271017 wait complete. 2024-04-25T02:10:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.156+0000 7f124537f700 1 Processor -- start 2024-04-25T02:10:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.156+0000 7f124537f700 1 -- start start 2024-04-25T02:10:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f124537f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1240099330 0x7f1240090760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f124537f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12401279d0 0x7f1240090c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f124537f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240091450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f124537f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124006a640 con 0x7f1240099330 2024-04-25T02:10:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f124537f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1240096150 con 0x7f12401282a0 2024-04-25T02:10:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f124537f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1240092bd0 con 0x7f12401279d0 2024-04-25T02:10:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1240099330 0x7f1240090760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240091450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1240099330 0x7f1240090760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42764/0 (socket says 172.21.15.78:42764) 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123effd700 1 -- 172.21.15.78:0/1359457565 learned_addr learned my addr 172.21.15.78:0/1359457565 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123e7fc700 1 --2- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12401279d0 0x7f1240090c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123f7fe700 1 -- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12401279d0 msgr2=0x7f1240090c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123f7fe700 1 --2- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12401279d0 0x7f1240090c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123f7fe700 1 -- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1240099330 msgr2=0x7f1240090760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123f7fe700 1 --2- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1240099330 0x7f1240090760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123f7fe700 1 -- 172.21.15.78:0/1359457565 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1238009a20 con 0x7f12401282a0 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123effd700 1 --2- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1240099330 0x7f1240090760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f123f7fe700 1 --2- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240091450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1230001eb0 tx=0x7f1230007b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f12277fe700 1 -- 172.21.15.78:0/1359457565 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300070d0 con 0x7f12401282a0 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f12277fe700 1 -- 172.21.15.78:0/1359457565 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230007230 con 0x7f12401282a0 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340092a0 con 0x7f12401282a0 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f12277fe700 1 -- 172.21.15.78:0/1359457565 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300075f0 con 0x7f12401282a0 2024-04-25T02:10:06.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.157+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1240120b40 con 0x7f12401282a0 2024-04-25T02:10:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.158+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124009a660 con 0x7f12401282a0 2024-04-25T02:10:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.159+0000 7f12277fe700 1 -- 172.21.15.78:0/1359457565 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f12300059b0 con 0x7f12401282a0 2024-04-25T02:10:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.159+0000 7f12277fe700 1 -- 172.21.15.78:0/1359457565 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f123003af30 con 0x7f12401282a0 2024-04-25T02:10:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.163+0000 7f12277fe700 1 -- 172.21.15.78:0/1359457565 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f123001b340 con 0x7f12401282a0 2024-04-25T02:10:06.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.319+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1240095700 con 0x7f122c02bd00 2024-04-25T02:10:06.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.325+0000 7f12277fe700 1 -- 172.21.15.78:0/1359457565 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243870 (unknown 2965378022 0 8041990) 0x7f1240095700 con 0x7f122c02bd00 2024-04-25T02:10:06.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 >> v1:172.21.15.78:6816/46507 conn(0x7f122c02bd00 legacy=0x7f122c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 msgr2=0x7f1240091450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 --2- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240091450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1230001eb0 tx=0x7f1230007b30).stop 2024-04-25T02:10:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 shutdown_connections 2024-04-25T02:10:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 --2- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f12401282a0 0x7f1240091450 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 --2- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1240099330 0x7f1240090760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 --2- 172.21.15.78:0/1359457565 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f12401279d0 0x7f1240090c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 >> 172.21.15.78:0/1359457565 conn(0x7f12400974d0 msgr2=0x7f124012ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 shutdown_connections 2024-04-25T02:10:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.328+0000 7f124537f700 1 -- 172.21.15.78:0/1359457565 wait complete. 2024-04-25T02:10:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:10:06.347 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-25T02:10:06.197604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339526+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339372+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343343+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340428+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.344335+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339818+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.342652+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343354+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340284+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.342708+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340878+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339676+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343883+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341907+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339945+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341878+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341864+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339122+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339150+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212589+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:09:59.212589+0000","last_peered":"2024-04-25T02:09:59.212589+0000","last_clean":"2024-04-25T02:09:59.212589+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:09:59.212589+0000","last_undegraded":"2024-04-25T02:09:59.212589+0000","last_fullsized":"2024-04-25T02:09:59.212589+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.344011+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467258+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:00.467258+0000","last_peered":"2024-04-25T02:10:00.467258+0000","last_clean":"2024-04-25T02:10:00.467258+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:00.467258+0000","last_undegraded":"2024-04-25T02:10:00.467258+0000","last_fullsized":"2024-04-25T02:10:00.467258+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339648+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212209+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:09:59.212209+0000","last_peered":"2024-04-25T02:09:59.212209+0000","last_clean":"2024-04-25T02:09:59.212209+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:09:59.212209+0000","last_undegraded":"2024-04-25T02:09:59.212209+0000","last_fullsized":"2024-04-25T02:09:59.212209+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339303+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467296+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:00.467296+0000","last_peered":"2024-04-25T02:10:00.467296+0000","last_clean":"2024-04-25T02:10:00.467296+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:00.467296+0000","last_undegraded":"2024-04-25T02:10:00.467296+0000","last_fullsized":"2024-04-25T02:10:00.467296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212692+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:09:59.212692+0000","last_peered":"2024-04-25T02:09:59.212692+0000","last_clean":"2024-04-25T02:09:59.212692+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:09:59.212692+0000","last_undegraded":"2024-04-25T02:09:59.212692+0000","last_fullsized":"2024-04-25T02:09:59.212692+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341274+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467331+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:00.467331+0000","last_peered":"2024-04-25T02:10:00.467331+0000","last_clean":"2024-04-25T02:10:00.467331+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:00.467331+0000","last_undegraded":"2024-04-25T02:10:00.467331+0000","last_fullsized":"2024-04-25T02:10:00.467331+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339837+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467272+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:00.467272+0000","last_peered":"2024-04-25T02:10:00.467272+0000","last_clean":"2024-04-25T02:10:00.467272+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:00.467272+0000","last_undegraded":"2024-04-25T02:10:00.467272+0000","last_fullsized":"2024-04-25T02:10:00.467272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339699+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339124+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212588+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:09:59.212588+0000","last_peered":"2024-04-25T02:09:59.212588+0000","last_clean":"2024-04-25T02:09:59.212588+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:09:59.212588+0000","last_undegraded":"2024-04-25T02:09:59.212588+0000","last_fullsized":"2024-04-25T02:09:59.212588+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467301+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:00.467301+0000","last_peered":"2024-04-25T02:10:00.467301+0000","last_clean":"2024-04-25T02:10:00.467301+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:00.467301+0000","last_undegraded":"2024-04-25T02:10:00.467301+0000","last_fullsized":"2024-04-25T02:10:00.467301+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340382+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341785+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340056+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343135+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343137+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340804+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:06.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-25T02:10:06.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-25T02:10:06.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-25T02:10:06.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-25T02:10:06.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339526+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339372+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-25T02:10:06.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.343343+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.340428+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.344335+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339818+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.342652+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.343354+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.340284+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.342708+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.340878+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-25T02:10:06.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339676+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.343883+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-25T02:10:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.341907+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339945+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.341878+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-25T02:10:06.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.341864+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339122+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339150+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-25T02:10:06.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.344011+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339648+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339303+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-25T02:10:06.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.341274+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339837+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339699+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-25T02:10:06.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.339124+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.340382+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.341785+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-25T02:10:06.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.340056+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.343135+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.343137+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-25T02:10:06.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-04-25T02:10:01.331885+0000', 'last_change': '2024-04-25T02:10:01.340804+0000', 'last_active': '2024-04-25T02:10:01.331885+0000', 'last_peered': '2024-04-25T02:10:01.331885+0000', 'last_clean': '2024-04-25T02:10:01.331885+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:01.331885+0000', 'last_undegraded': '2024-04-25T02:10:01.331885+0000', 'last_fullsized': '2024-04-25T02:10:01.331885+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:01.331885+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-25T02:10:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-25T02:10:06.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T02:10:02.336284+0000', 'last_change': '2024-04-25T02:10:02.336284+0000', 'last_active': '2024-04-25T02:10:02.336284+0000', 'last_peered': '2024-04-25T02:10:02.336284+0000', 'last_clean': '2024-04-25T02:10:02.336284+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T02:10:02.336284+0000', 'last_undegraded': '2024-04-25T02:10:02.336284+0000', 'last_fullsized': '2024-04-25T02:10:02.336284+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'last_clean_scrub_stamp': '2024-04-25T02:10:02.336284+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:10:06.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T02:10:06.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.493+0000 7f0093aee700 1 Processor -- start 2024-04-25T02:10:06.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0093aee700 1 -- start start 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0093aee700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c099930 0x7f008c130150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0093aee700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c130640 0x7f008c132a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0093aee700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c092070 con 0x7f008c098e40 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0093aee700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c099d10 con 0x7f008c130640 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0093aee700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f008c092ff0 con 0x7f008c099930 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0091089700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c099930 0x7f008c130150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f009188a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f008c098e40 0x7f008c099220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59960/0 (socket says 172.21.15.78:59960) 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f009188a700 1 -- 172.21.15.78:0/1008901672 learned_addr learned my addr 172.21.15.78:0/1008901672 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f009208b700 1 --2- 172.21.15.78:0/1008901672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c130640 0x7f008c132a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0091089700 1 -- 172.21.15.78:0/1008901672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c130640 msgr2=0x7f008c132a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0091089700 1 --2- 172.21.15.78:0/1008901672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c130640 0x7f008c132a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0091089700 1 -- 172.21.15.78:0/1008901672 >> v1:172.21.15.78:6789/0 conn(0x7f008c098e40 legacy=0x7f008c099220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0090888700 1 -- 172.21.15.78:0/1008901672 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388012091 0 0) 0x7f008c092070 con 0x7f008c098e40 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f0091089700 1 -- 172.21.15.78:0/1008901672 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c0978e0 con 0x7f008c099930 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.494+0000 7f009208b700 1 --2- 172.21.15.78:0/1008901672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c130640 0x7f008c132a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0091089700 1 --2- 172.21.15.78:0/1008901672 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c099930 0x7f008c130150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0088009790 tx=0x7f0088009060).ready entity=mon.2 client_cookie=ab47a3a8ab774516 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0090888700 1 -- 172.21.15.78:0/1008901672 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800f510 con 0x7f008c099930 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0090888700 1 -- 172.21.15.78:0/1008901672 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008800f670 con 0x7f008c099930 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0090888700 1 -- 172.21.15.78:0/1008901672 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800f9f0 con 0x7f008c099930 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0093aee700 1 -- 172.21.15.78:0/1008901672 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c099930 msgr2=0x7f008c130150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0093aee700 1 --2- 172.21.15.78:0/1008901672 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c099930 0x7f008c130150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0088009790 tx=0x7f0088009060).stop 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0093aee700 1 -- 172.21.15.78:0/1008901672 shutdown_connections 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0093aee700 1 --2- 172.21.15.78:0/1008901672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c130640 0x7f008c132a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0093aee700 1 --2- 172.21.15.78:0/1008901672 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c099930 0x7f008c130150 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0093aee700 1 -- 172.21.15.78:0/1008901672 >> 172.21.15.78:0/1008901672 conn(0x7f008c0974d0 msgr2=0x7f008c099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0093aee700 1 -- 172.21.15.78:0/1008901672 shutdown_connections 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.495+0000 7f0093aee700 1 -- 172.21.15.78:0/1008901672 wait complete. 2024-04-25T02:10:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.496+0000 7f0093aee700 1 Processor -- start 2024-04-25T02:10:06.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.496+0000 7f0093aee700 1 -- start start 2024-04-25T02:10:06.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f0093aee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f008c098e40 0x7f008c08f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f0093aee700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c099930 0x7f008c08b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f0093aee700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c130640 0x7f008c08b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f0093aee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c08c7e0 con 0x7f008c098e40 2024-04-25T02:10:06.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f0093aee700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c08cec0 con 0x7f008c099930 2024-04-25T02:10:06.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f0093aee700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f008c08f9b0 con 0x7f008c130640 2024-04-25T02:10:06.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009188a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f008c098e40 0x7f008c08f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009208b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c130640 0x7f008c08b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f0091089700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c099930 0x7f008c08b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009188a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f008c098e40 0x7f008c08f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42768/0 (socket says 172.21.15.78:42768) 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009188a700 1 -- 172.21.15.78:0/3949618696 learned_addr learned my addr 172.21.15.78:0/3949618696 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009208b700 1 -- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c099930 msgr2=0x7f008c08b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009208b700 1 --2- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c099930 0x7f008c08b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009208b700 1 -- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f008c098e40 msgr2=0x7f008c08f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009208b700 1 --2- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f008c098e40 0x7f008c08f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009208b700 1 -- 172.21.15.78:0/3949618696 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084009a20 con 0x7f008c130640 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009188a700 1 --2- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f008c098e40 0x7f008c08f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f009208b700 1 --2- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c130640 0x7f008c08b820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0084009ed0 tx=0x7f008400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f00827fc700 1 -- 172.21.15.78:0/3949618696 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400cb70 con 0x7f008c130640 2024-04-25T02:10:06.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f00827fc700 1 -- 172.21.15.78:0/3949618696 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008400f040 con 0x7f008c130640 2024-04-25T02:10:06.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00880092a0 con 0x7f008c130640 2024-04-25T02:10:06.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f00827fc700 1 -- 172.21.15.78:0/3949618696 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084013400 con 0x7f008c130640 2024-04-25T02:10:06.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.497+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c08edd0 con 0x7f008c130640 2024-04-25T02:10:06.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.498+0000 7f00827fc700 1 -- 172.21.15.78:0/3949618696 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f00840137b0 con 0x7f008c130640 2024-04-25T02:10:06.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.498+0000 7f00827fc700 1 -- 172.21.15.78:0/3949618696 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f008403bb60 con 0x7f008c130640 2024-04-25T02:10:06.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.498+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c09a660 con 0x7f008c130640 2024-04-25T02:10:06.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.503+0000 7f00827fc700 1 -- 172.21.15.78:0/3949618696 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f0084007340 con 0x7f008c130640 2024-04-25T02:10:06.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.724+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f008c046ce0 con 0x7f008c130640 2024-04-25T02:10:06.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.724+0000 7f00827fc700 1 -- 172.21.15.78:0/3949618696 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1106 (secure 0 0 0) 0x7f008401cbb0 con 0x7f008c130640 2024-04-25T02:10:06.732 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:06.732 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":19,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":16,"num_osds":4,"num_up_osds":4,"osd_up_since":1714010996,"num_in_osds":4,"osd_in_since":1714010989,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":1217363968,"bytes_avail":385329692672,"bytes_total":386547056640,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4187}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-25T02:09:47.236173+0000","services":{}},"progress_events":{}} 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 >> v1:172.21.15.78:6816/46507 conn(0x7f007002bcd0 legacy=0x7f007002e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c130640 msgr2=0x7f008c08b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 --2- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c130640 0x7f008c08b820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0084009ed0 tx=0x7f008400b040).stop 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 shutdown_connections 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 --2- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f008c130640 0x7f008c08b820 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 --2- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f008c098e40 0x7f008c08f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 --2- 172.21.15.78:0/3949618696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f008c099930 0x7f008c08b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 >> 172.21.15.78:0/3949618696 conn(0x7f008c0974d0 msgr2=0x7f008c094910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 shutdown_connections 2024-04-25T02:10:06.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.726+0000 7f0093aee700 1 -- 172.21.15.78:0/3949618696 wait complete. 2024-04-25T02:10:06.745 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T02:10:06.745 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f981d072700 1 Processor -- start 2024-04-25T02:10:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f981d072700 1 -- start start 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f981d072700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818127eb0 0x7f98181271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f981d072700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 0x7f9818131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f981d072700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9818096490 con 0x7f9818062860 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f981d072700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9818062c40 con 0x7f981812fb30 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f981d072700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9818091b90 con 0x7f9818127eb0 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f9816d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9818062860 0x7f98181277a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59976/0 (socket says 172.21.15.78:59976) 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f981759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 0x7f9818131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f9816d9d700 1 -- 172.21.15.78:0/2413369785 learned_addr learned my addr 172.21.15.78:0/2413369785 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.852+0000 7f981659c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818127eb0 0x7f98181271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f9815d9b700 1 -- 172.21.15.78:0/2413369785 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693383934 0 0) 0x7f9818096490 con 0x7f9818062860 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981759e700 1 -- 172.21.15.78:0/2413369785 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818127eb0 msgr2=0x7f98181271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981759e700 1 --2- 172.21.15.78:0/2413369785 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818127eb0 0x7f98181271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981759e700 1 -- 172.21.15.78:0/2413369785 >> v1:172.21.15.78:6789/0 conn(0x7f9818062860 legacy=0x7f98181277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981759e700 1 -- 172.21.15.78:0/2413369785 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9818091e50 con 0x7f981812fb30 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981659c700 1 --2- 172.21.15.78:0/2413369785 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818127eb0 0x7f98181271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981759e700 1 --2- 172.21.15.78:0/2413369785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 0x7f9818131f20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9810009e90 tx=0x7f9810009780).ready entity=mon.1 client_cookie=9a3a89fc898a823b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f9815d9b700 1 -- 172.21.15.78:0/2413369785 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000e070 con 0x7f981812fb30 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f9815d9b700 1 -- 172.21.15.78:0/2413369785 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981000bb60 con 0x7f981812fb30 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f9815d9b700 1 -- 172.21.15.78:0/2413369785 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810012410 con 0x7f981812fb30 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981d072700 1 -- 172.21.15.78:0/2413369785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 msgr2=0x7f9818131f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981d072700 1 --2- 172.21.15.78:0/2413369785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 0x7f9818131f20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9810009e90 tx=0x7f9810009780).stop 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981d072700 1 -- 172.21.15.78:0/2413369785 shutdown_connections 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981d072700 1 --2- 172.21.15.78:0/2413369785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 0x7f9818131f20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981d072700 1 --2- 172.21.15.78:0/2413369785 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818127eb0 0x7f98181271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.853+0000 7f981d072700 1 -- 172.21.15.78:0/2413369785 >> 172.21.15.78:0/2413369785 conn(0x7f9818097450 msgr2=0x7f9818097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.854+0000 7f981d072700 1 -- 172.21.15.78:0/2413369785 shutdown_connections 2024-04-25T02:10:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.854+0000 7f981d072700 1 -- 172.21.15.78:0/2413369785 wait complete. 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981d072700 1 Processor -- start 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981d072700 1 -- start start 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981d072700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818062860 0x7f9818126b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981d072700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9818127eb0 0x7f981812d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981d072700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 0x7f981812dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981d072700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9818111e80 con 0x7f9818127eb0 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981d072700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981812f800 con 0x7f981812fb30 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981d072700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9818096d20 con 0x7f9818062860 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f9816d9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818062860 0x7f9818126b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 0x7f981812dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f981659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9818127eb0 0x7f981812d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f9816d9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818062860 0x7f9818126b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40678/0 (socket says 172.21.15.78:40678) 2024-04-25T02:10:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f9816d9d700 1 -- 172.21.15.78:0/3659026743 learned_addr learned my addr 172.21.15.78:0/3659026743 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f9816d9d700 1 -- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 msgr2=0x7f981812dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.855+0000 7f9816d9d700 1 --2- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 0x7f981812dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f9816d9d700 1 -- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9818127eb0 msgr2=0x7f981812d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f9816d9d700 1 --2- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9818127eb0 0x7f981812d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f9816d9d700 1 -- 172.21.15.78:0/3659026743 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0092a0 con 0x7f9818062860 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f9816d9d700 1 --2- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818062860 0x7f9818126b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f980800c4c0 tx=0x7f9808007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f97ff7fe700 1 -- 172.21.15.78:0/3659026743 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800ce30 con 0x7f9818062860 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f97ff7fe700 1 -- 172.21.15.78:0/3659026743 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98080072e0 con 0x7f9818062860 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f97ff7fe700 1 -- 172.21.15.78:0/3659026743 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080057a0 con 0x7f9818062860 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9810009a20 con 0x7f9818062860 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9818112b00 con 0x7f9818062860 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.856+0000 7f97ff7fe700 1 -- 172.21.15.78:0/3659026743 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9808005bd0 con 0x7f9818062860 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.857+0000 7f97ff7fe700 1 -- 172.21.15.78:0/3659026743 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f980803a870 con 0x7f9818062860 2024-04-25T02:10:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.857+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9818097f70 con 0x7f9818062860 2024-04-25T02:10:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:06.861+0000 7f97ff7fe700 1 -- 172.21.15.78:0/3659026743 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f980801d3f0 con 0x7f9818062860 2024-04-25T02:10:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.017+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9818046ce0 con 0x7f980402bd00 2024-04-25T02:10:07.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.023+0000 7f97ff7fe700 1 -- 172.21.15.78:0/3659026743 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243870 (unknown 2965378022 0 8041990) 0x7f9818046ce0 con 0x7f980402bd00 2024-04-25T02:10:07.033 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:07.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 >> v1:172.21.15.78:6816/46507 conn(0x7f980402bd00 legacy=0x7f980402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:07.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818062860 msgr2=0x7f9818126b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:07.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 --2- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818062860 0x7f9818126b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f980800c4c0 tx=0x7f9808007c10).stop 2024-04-25T02:10:07.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 shutdown_connections 2024-04-25T02:10:07.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 --2- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f981812fb30 0x7f981812dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:07.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 --2- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9818062860 0x7f9818126b30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:07.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 --2- 172.21.15.78:0/3659026743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9818127eb0 0x7f981812d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:07.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 >> 172.21.15.78:0/3659026743 conn(0x7f9818097450 msgr2=0x7f981809a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:07.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 shutdown_connections 2024-04-25T02:10:07.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:07.026+0000 7f981d072700 1 -- 172.21.15.78:0/3659026743 wait complete. 2024-04-25T02:10:07.036 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:10:07.045 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-25T02:10:06.197604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339526+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339372+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343343+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340428+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.344335+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339818+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.342652+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343354+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340284+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.342708+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340878+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339676+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343883+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341907+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339945+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341878+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341864+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339122+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339150+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212589+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:09:59.212589+0000","last_peered":"2024-04-25T02:09:59.212589+0000","last_clean":"2024-04-25T02:09:59.212589+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:09:59.212589+0000","last_undegraded":"2024-04-25T02:09:59.212589+0000","last_fullsized":"2024-04-25T02:09:59.212589+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.344011+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467258+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:00.467258+0000","last_peered":"2024-04-25T02:10:00.467258+0000","last_clean":"2024-04-25T02:10:00.467258+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:00.467258+0000","last_undegraded":"2024-04-25T02:10:00.467258+0000","last_fullsized":"2024-04-25T02:10:00.467258+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339648+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212209+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:09:59.212209+0000","last_peered":"2024-04-25T02:09:59.212209+0000","last_clean":"2024-04-25T02:09:59.212209+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:09:59.212209+0000","last_undegraded":"2024-04-25T02:09:59.212209+0000","last_fullsized":"2024-04-25T02:09:59.212209+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339303+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467296+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:00.467296+0000","last_peered":"2024-04-25T02:10:00.467296+0000","last_clean":"2024-04-25T02:10:00.467296+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:00.467296+0000","last_undegraded":"2024-04-25T02:10:00.467296+0000","last_fullsized":"2024-04-25T02:10:00.467296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212692+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:09:59.212692+0000","last_peered":"2024-04-25T02:09:59.212692+0000","last_clean":"2024-04-25T02:09:59.212692+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:09:59.212692+0000","last_undegraded":"2024-04-25T02:09:59.212692+0000","last_fullsized":"2024-04-25T02:09:59.212692+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341274+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467331+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:00.467331+0000","last_peered":"2024-04-25T02:10:00.467331+0000","last_clean":"2024-04-25T02:10:00.467331+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:00.467331+0000","last_undegraded":"2024-04-25T02:10:00.467331+0000","last_fullsized":"2024-04-25T02:10:00.467331+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339837+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467272+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:00.467272+0000","last_peered":"2024-04-25T02:10:00.467272+0000","last_clean":"2024-04-25T02:10:00.467272+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:00.467272+0000","last_undegraded":"2024-04-25T02:10:00.467272+0000","last_fullsized":"2024-04-25T02:10:00.467272+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339699+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.339124+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:09:59.212588+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:09:59.212588+0000","last_peered":"2024-04-25T02:09:59.212588+0000","last_clean":"2024-04-25T02:09:59.212588+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:09:59.212588+0000","last_undegraded":"2024-04-25T02:09:59.212588+0000","last_fullsized":"2024-04-25T02:09:59.212588+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-25T02:10:00.467301+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:00.467301+0000","last_peered":"2024-04-25T02:10:00.467301+0000","last_clean":"2024-04-25T02:10:00.467301+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:00.467301+0000","last_undegraded":"2024-04-25T02:10:00.467301+0000","last_fullsized":"2024-04-25T02:10:00.467301+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340382+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.341785+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340056+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343135+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.343137+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-04-25T02:10:01.331885+0000","last_change":"2024-04-25T02:10:01.340804+0000","last_active":"2024-04-25T02:10:01.331885+0000","last_peered":"2024-04-25T02:10:01.331885+0000","last_clean":"2024-04-25T02:10:01.331885+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:01.331885+0000","last_undegraded":"2024-04-25T02:10:01.331885+0000","last_fullsized":"2024-04-25T02:10:01.331885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T02:10:02.336284+0000","last_change":"2024-04-25T02:10:02.336284+0000","last_active":"2024-04-25T02:10:02.336284+0000","last_peered":"2024-04-25T02:10:02.336284+0000","last_clean":"2024-04-25T02:10:02.336284+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T02:10:02.336284+0000","last_undegraded":"2024-04-25T02:10:02.336284+0000","last_fullsized":"2024-04-25T02:10:02.336284+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:10.049 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:10.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.167+0000 7fb34c8a0700 1 Processor -- start 2024-04-25T02:10:10.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb34c8a0700 1 -- start start 2024-04-25T02:10:10.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb34c8a0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb348129040 0x7fb34812d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb34c8a0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb34812de00 0x7fb3481301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb34c8a0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb348095fb0 con 0x7fb348062860 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb34c8a0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3480965c0 con 0x7fb34812de00 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb34c8a0700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3481294a0 con 0x7fb348129040 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb345d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb348129040 0x7fb34812d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb346d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb34812de00 0x7fb3481301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb34659c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb348062860 0x7fb348128930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59992/0 (socket says 172.21.15.78:59992) 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.168+0000 7fb34659c700 1 -- 172.21.15.78:0/4152174539 learned_addr learned my addr 172.21.15.78:0/4152174539 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb345d9b700 1 -- 172.21.15.78:0/4152174539 >> v2:172.21.15.78:3300/0 conn(0x7fb34812de00 msgr2=0x7fb3481301f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb345d9b700 1 --2- 172.21.15.78:0/4152174539 >> v2:172.21.15.78:3300/0 conn(0x7fb34812de00 0x7fb3481301f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb345d9b700 1 -- 172.21.15.78:0/4152174539 >> v1:172.21.15.78:6789/0 conn(0x7fb348062860 legacy=0x7fb348128930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb345d9b700 1 -- 172.21.15.78:0/4152174539 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348063310 con 0x7fb348129040 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34559a700 1 -- 172.21.15.78:0/4152174539 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805656577 0 0) 0x7fb348095fb0 con 0x7fb348062860 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb346d9d700 1 --2- 172.21.15.78:0/4152174539 >> v2:172.21.15.78:3300/0 conn(0x7fb34812de00 0x7fb3481301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb345d9b700 1 --2- 172.21.15.78:0/4152174539 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb348129040 0x7fb34812d910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb338009790 tx=0x7fb338009060).ready entity=mon.2 client_cookie=9798fdbb1c127019 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34559a700 1 -- 172.21.15.78:0/4152174539 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380090d0 con 0x7fb348129040 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34559a700 1 -- 172.21.15.78:0/4152174539 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33800f510 con 0x7fb348129040 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34559a700 1 -- 172.21.15.78:0/4152174539 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33800f890 con 0x7fb348129040 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34c8a0700 1 -- 172.21.15.78:0/4152174539 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb348129040 msgr2=0x7fb34812d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34c8a0700 1 --2- 172.21.15.78:0/4152174539 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb348129040 0x7fb34812d910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb338009790 tx=0x7fb338009060).stop 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34c8a0700 1 -- 172.21.15.78:0/4152174539 shutdown_connections 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34c8a0700 1 --2- 172.21.15.78:0/4152174539 >> v2:172.21.15.78:3300/0 conn(0x7fb34812de00 0x7fb3481301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34c8a0700 1 --2- 172.21.15.78:0/4152174539 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb348129040 0x7fb34812d910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.169+0000 7fb34c8a0700 1 -- 172.21.15.78:0/4152174539 >> 172.21.15.78:0/4152174539 conn(0x7fb348097450 msgr2=0x7fb348097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.170+0000 7fb34c8a0700 1 -- 172.21.15.78:0/4152174539 shutdown_connections 2024-04-25T02:10:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.170+0000 7fb34c8a0700 1 -- 172.21.15.78:0/4152174539 wait complete. 2024-04-25T02:10:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.171+0000 7fb34c8a0700 1 Processor -- start 2024-04-25T02:10:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.171+0000 7fb34c8a0700 1 -- start start 2024-04-25T02:10:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.171+0000 7fb34c8a0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb348062860 0x7fb348138360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb34c8a0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb348129040 0x7fb348138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb34c8a0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb34812de00 0x7fb348138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb34c8a0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34812d020 con 0x7fb348129040 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb34c8a0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34812b6b0 con 0x7fb348062860 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb34c8a0700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb34806a800 con 0x7fb34812de00 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb346d9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb34812de00 0x7fb348138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb345d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb348129040 0x7fb348138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb346d9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb34812de00 0x7fb348138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40696/0 (socket says 172.21.15.78:40696) 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb346d9d700 1 -- 172.21.15.78:0/2280351264 learned_addr learned my addr 172.21.15.78:0/2280351264 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb345d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb348129040 0x7fb348138850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42796/0 (socket says 172.21.15.78:42796) 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb34659c700 1 --2- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb348062860 0x7fb348138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb346d9d700 1 -- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb348062860 msgr2=0x7fb348138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb346d9d700 1 --2- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb348062860 0x7fb348138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb346d9d700 1 -- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb348129040 msgr2=0x7fb348138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb346d9d700 1 --2- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb348129040 0x7fb348138850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb346d9d700 1 -- 172.21.15.78:0/2280351264 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340009a20 con 0x7fb34812de00 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb345d9b700 1 --2- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb348129040 0x7fb348138850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb346d9d700 1 --2- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb34812de00 0x7fb348138d40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb34000ef90 tx=0x7fb34000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb336ffd700 1 -- 172.21.15.78:0/2280351264 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000cbd0 con 0x7fb34812de00 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb336ffd700 1 -- 172.21.15.78:0/2280351264 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000f040 con 0x7fb34812de00 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3380092a0 con 0x7fb34812de00 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb336ffd700 1 -- 172.21.15.78:0/2280351264 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340013400 con 0x7fb34812de00 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.172+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34812cd40 con 0x7fb34812de00 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.173+0000 7fb336ffd700 1 -- 172.21.15.78:0/2280351264 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fb340013830 con 0x7fb34812de00 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.173+0000 7fb336ffd700 1 -- 172.21.15.78:0/2280351264 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb34003baa0 con 0x7fb34812de00 2024-04-25T02:10:10.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.173+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb348097f70 con 0x7fb34812de00 2024-04-25T02:10:10.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.178+0000 7fb336ffd700 1 -- 172.21.15.78:0/2280351264 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fb34001bdc0 con 0x7fb34812de00 2024-04-25T02:10:10.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.335+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb348094dc0 con 0x7fb32802bd00 2024-04-25T02:10:10.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.341+0000 7fb336ffd700 1 -- 172.21.15.78:0/2280351264 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249986 (unknown 2965378022 0 209956955) 0x7fb348094dc0 con 0x7fb32802bd00 2024-04-25T02:10:10.351 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:10.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.343+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 >> v1:172.21.15.78:6816/46507 conn(0x7fb32802bd00 legacy=0x7fb32802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.344+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb34812de00 msgr2=0x7fb348138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.344+0000 7fb34c8a0700 1 --2- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb34812de00 0x7fb348138d40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb34000ef90 tx=0x7fb34000b040).stop 2024-04-25T02:10:10.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.344+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 shutdown_connections 2024-04-25T02:10:10.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.344+0000 7fb34c8a0700 1 --2- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb34812de00 0x7fb348138d40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.344+0000 7fb34c8a0700 1 --2- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb348062860 0x7fb348138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.344+0000 7fb34c8a0700 1 --2- 172.21.15.78:0/2280351264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb348129040 0x7fb348138850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.344+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 >> 172.21.15.78:0/2280351264 conn(0x7fb348097450 msgr2=0x7fb3481250e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.344+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 shutdown_connections 2024-04-25T02:10:10.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.344+0000 7fb34c8a0700 1 -- 172.21.15.78:0/2280351264 wait complete. 2024-04-25T02:10:10.354 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:10:10.363 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-25T02:10:10.198369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188992,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298368,"statfs":{"total":386547056640,"available":385329528832,"internally_reserved":0,"allocated":622592,"data_stored":182668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000447"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752012+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:10:02.752012+0000","last_peered":"2024-04-25T02:10:02.752012+0000","last_clean":"2024-04-25T02:10:02.752012+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:10:02.752012+0000","last_undegraded":"2024-04-25T02:10:02.752012+0000","last_fullsized":"2024-04-25T02:10:02.752012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751974+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:10:02.751974+0000","last_peered":"2024-04-25T02:10:02.751974+0000","last_clean":"2024-04-25T02:10:02.751974+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:10:02.751974+0000","last_undegraded":"2024-04-25T02:10:02.751974+0000","last_fullsized":"2024-04-25T02:10:02.751974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750337+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:10:02.750337+0000","last_peered":"2024-04-25T02:10:02.750337+0000","last_clean":"2024-04-25T02:10:02.750337+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:10:02.750337+0000","last_undegraded":"2024-04-25T02:10:02.750337+0000","last_fullsized":"2024-04-25T02:10:02.750337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751731+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:10:02.751731+0000","last_peered":"2024-04-25T02:10:02.751731+0000","last_clean":"2024-04-25T02:10:02.751731+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:10:02.751731+0000","last_undegraded":"2024-04-25T02:10:02.751731+0000","last_fullsized":"2024-04-25T02:10:02.751731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751364+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:10:02.751364+0000","last_peered":"2024-04-25T02:10:02.751364+0000","last_clean":"2024-04-25T02:10:02.751364+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:10:02.751364+0000","last_undegraded":"2024-04-25T02:10:02.751364+0000","last_fullsized":"2024-04-25T02:10:02.751364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750560+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:10:02.750560+0000","last_peered":"2024-04-25T02:10:02.750560+0000","last_clean":"2024-04-25T02:10:02.750560+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:10:02.750560+0000","last_undegraded":"2024-04-25T02:10:02.750560+0000","last_fullsized":"2024-04-25T02:10:02.750560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750799+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:10:02.750799+0000","last_peered":"2024-04-25T02:10:02.750799+0000","last_clean":"2024-04-25T02:10:02.750799+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:10:02.750799+0000","last_undegraded":"2024-04-25T02:10:02.750799+0000","last_fullsized":"2024-04-25T02:10:02.750799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.740931+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:10:02.740931+0000","last_peered":"2024-04-25T02:10:02.740931+0000","last_clean":"2024-04-25T02:10:02.740931+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:10:02.740931+0000","last_undegraded":"2024-04-25T02:10:02.740931+0000","last_fullsized":"2024-04-25T02:10:02.740931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751938+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:10:02.751938+0000","last_peered":"2024-04-25T02:10:02.751938+0000","last_clean":"2024-04-25T02:10:02.751938+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:10:02.751938+0000","last_undegraded":"2024-04-25T02:10:02.751938+0000","last_fullsized":"2024-04-25T02:10:02.751938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743408+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:10:02.743408+0000","last_peered":"2024-04-25T02:10:02.743408+0000","last_clean":"2024-04-25T02:10:02.743408+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:10:02.743408+0000","last_undegraded":"2024-04-25T02:10:02.743408+0000","last_fullsized":"2024-04-25T02:10:02.743408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.742455+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:10:02.742455+0000","last_peered":"2024-04-25T02:10:02.742455+0000","last_clean":"2024-04-25T02:10:02.742455+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:10:02.742455+0000","last_undegraded":"2024-04-25T02:10:02.742455+0000","last_fullsized":"2024-04-25T02:10:02.742455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752082+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:10:02.752082+0000","last_peered":"2024-04-25T02:10:02.752082+0000","last_clean":"2024-04-25T02:10:02.752082+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:10:02.752082+0000","last_undegraded":"2024-04-25T02:10:02.752082+0000","last_fullsized":"2024-04-25T02:10:02.752082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751894+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:10:02.751894+0000","last_peered":"2024-04-25T02:10:02.751894+0000","last_clean":"2024-04-25T02:10:02.751894+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:10:02.751894+0000","last_undegraded":"2024-04-25T02:10:02.751894+0000","last_fullsized":"2024-04-25T02:10:02.751894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.741478+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:10:02.741478+0000","last_peered":"2024-04-25T02:10:02.741478+0000","last_clean":"2024-04-25T02:10:02.741478+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:10:02.741478+0000","last_undegraded":"2024-04-25T02:10:02.741478+0000","last_fullsized":"2024-04-25T02:10:02.741478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.735925+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:10:02.735925+0000","last_peered":"2024-04-25T02:10:02.735925+0000","last_clean":"2024-04-25T02:10:02.735925+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:10:02.735925+0000","last_undegraded":"2024-04-25T02:10:02.735925+0000","last_fullsized":"2024-04-25T02:10:02.735925+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750880+0000","last_change":"2024-04-25T02:10:02.735597+0000","last_active":"2024-04-25T02:10:02.750880+0000","last_peered":"2024-04-25T02:10:02.750880+0000","last_clean":"2024-04-25T02:10:02.750880+0000","last_became_active":"2024-04-25T02:10:02.735267+0000","last_became_peered":"2024-04-25T02:10:02.735267+0000","last_unstale":"2024-04-25T02:10:02.750880+0000","last_undegraded":"2024-04-25T02:10:02.750880+0000","last_fullsized":"2024-04-25T02:10:02.750880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751917+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:10:02.751917+0000","last_peered":"2024-04-25T02:10:02.751917+0000","last_clean":"2024-04-25T02:10:02.751917+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:10:02.751917+0000","last_undegraded":"2024-04-25T02:10:02.751917+0000","last_fullsized":"2024-04-25T02:10:02.751917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.733646+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:10:02.733646+0000","last_peered":"2024-04-25T02:10:02.733646+0000","last_clean":"2024-04-25T02:10:02.733646+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:10:02.733646+0000","last_undegraded":"2024-04-25T02:10:02.733646+0000","last_fullsized":"2024-04-25T02:10:02.733646+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752004+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:10:02.752004+0000","last_peered":"2024-04-25T02:10:02.752004+0000","last_clean":"2024-04-25T02:10:02.752004+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:10:02.752004+0000","last_undegraded":"2024-04-25T02:10:02.752004+0000","last_fullsized":"2024-04-25T02:10:02.752004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.744013+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:10:02.744013+0000","last_peered":"2024-04-25T02:10:02.744013+0000","last_clean":"2024-04-25T02:10:02.744013+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:10:02.744013+0000","last_undegraded":"2024-04-25T02:10:02.744013+0000","last_fullsized":"2024-04-25T02:10:02.744013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743911+0000","last_change":"2024-04-25T02:10:02.737504+0000","last_active":"2024-04-25T02:10:02.743911+0000","last_peered":"2024-04-25T02:10:02.743911+0000","last_clean":"2024-04-25T02:10:02.743911+0000","last_became_active":"2024-04-25T02:10:02.737240+0000","last_became_peered":"2024-04-25T02:10:02.737240+0000","last_unstale":"2024-04-25T02:10:02.743911+0000","last_undegraded":"2024-04-25T02:10:02.743911+0000","last_fullsized":"2024-04-25T02:10:02.743911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.735754+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:10:02.735754+0000","last_peered":"2024-04-25T02:10:02.735754+0000","last_clean":"2024-04-25T02:10:02.735754+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:10:02.735754+0000","last_undegraded":"2024-04-25T02:10:02.735754+0000","last_fullsized":"2024-04-25T02:10:02.735754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751571+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:10:02.751571+0000","last_peered":"2024-04-25T02:10:02.751571+0000","last_clean":"2024-04-25T02:10:02.751571+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:10:02.751571+0000","last_undegraded":"2024-04-25T02:10:02.751571+0000","last_fullsized":"2024-04-25T02:10:02.751571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.742751+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:10:02.742751+0000","last_peered":"2024-04-25T02:10:02.742751+0000","last_clean":"2024-04-25T02:10:02.742751+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:10:02.742751+0000","last_undegraded":"2024-04-25T02:10:02.742751+0000","last_fullsized":"2024-04-25T02:10:02.742751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750687+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:10:02.750687+0000","last_peered":"2024-04-25T02:10:02.750687+0000","last_clean":"2024-04-25T02:10:02.750687+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:10:02.750687+0000","last_undegraded":"2024-04-25T02:10:02.750687+0000","last_fullsized":"2024-04-25T02:10:02.750687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743438+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:10:02.743438+0000","last_peered":"2024-04-25T02:10:02.743438+0000","last_clean":"2024-04-25T02:10:02.743438+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:10:02.743438+0000","last_undegraded":"2024-04-25T02:10:02.743438+0000","last_fullsized":"2024-04-25T02:10:02.743438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751844+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:10:02.751844+0000","last_peered":"2024-04-25T02:10:02.751844+0000","last_clean":"2024-04-25T02:10:02.751844+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:10:02.751844+0000","last_undegraded":"2024-04-25T02:10:02.751844+0000","last_fullsized":"2024-04-25T02:10:02.751844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.730800+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:10:02.730800+0000","last_peered":"2024-04-25T02:10:02.730800+0000","last_clean":"2024-04-25T02:10:02.730800+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:10:02.730800+0000","last_undegraded":"2024-04-25T02:10:02.730800+0000","last_fullsized":"2024-04-25T02:10:02.730800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750605+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:10:02.750605+0000","last_peered":"2024-04-25T02:10:02.750605+0000","last_clean":"2024-04-25T02:10:02.750605+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:10:02.750605+0000","last_undegraded":"2024-04-25T02:10:02.750605+0000","last_fullsized":"2024-04-25T02:10:02.750605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.711548+0000","last_change":"2024-04-25T02:10:02.370405+0000","last_active":"2024-04-25T02:10:02.711548+0000","last_peered":"2024-04-25T02:10:02.711548+0000","last_clean":"2024-04-25T02:10:02.711548+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:10:02.711548+0000","last_undegraded":"2024-04-25T02:10:02.711548+0000","last_fullsized":"2024-04-25T02:10:02.711548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750370+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:10:02.750370+0000","last_peered":"2024-04-25T02:10:02.750370+0000","last_clean":"2024-04-25T02:10:02.750370+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:10:02.750370+0000","last_undegraded":"2024-04-25T02:10:02.750370+0000","last_fullsized":"2024-04-25T02:10:02.750370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.709328+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:10:02.709328+0000","last_peered":"2024-04-25T02:10:02.709328+0000","last_clean":"2024-04-25T02:10:02.709328+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:10:02.709328+0000","last_undegraded":"2024-04-25T02:10:02.709328+0000","last_fullsized":"2024-04-25T02:10:02.709328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751527+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:10:02.751527+0000","last_peered":"2024-04-25T02:10:02.751527+0000","last_clean":"2024-04-25T02:10:02.751527+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:10:02.751527+0000","last_undegraded":"2024-04-25T02:10:02.751527+0000","last_fullsized":"2024-04-25T02:10:02.751527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.713945+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:10:02.713945+0000","last_peered":"2024-04-25T02:10:02.713945+0000","last_clean":"2024-04-25T02:10:02.713945+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:10:02.713945+0000","last_undegraded":"2024-04-25T02:10:02.713945+0000","last_fullsized":"2024-04-25T02:10:02.713945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750844+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:10:02.750844+0000","last_peered":"2024-04-25T02:10:02.750844+0000","last_clean":"2024-04-25T02:10:02.750844+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:10:02.750844+0000","last_undegraded":"2024-04-25T02:10:02.750844+0000","last_fullsized":"2024-04-25T02:10:02.750844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.712697+0000","last_change":"2024-04-25T02:10:02.367526+0000","last_active":"2024-04-25T02:10:02.712697+0000","last_peered":"2024-04-25T02:10:02.712697+0000","last_clean":"2024-04-25T02:10:02.712697+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:10:02.712697+0000","last_undegraded":"2024-04-25T02:10:02.712697+0000","last_fullsized":"2024-04-25T02:10:02.712697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751541+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:10:02.751541+0000","last_peered":"2024-04-25T02:10:02.751541+0000","last_clean":"2024-04-25T02:10:02.751541+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:10:02.751541+0000","last_undegraded":"2024-04-25T02:10:02.751541+0000","last_fullsized":"2024-04-25T02:10:02.751541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751247+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:10:02.751247+0000","last_peered":"2024-04-25T02:10:02.751247+0000","last_clean":"2024-04-25T02:10:02.751247+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:10:02.751247+0000","last_undegraded":"2024-04-25T02:10:02.751247+0000","last_fullsized":"2024-04-25T02:10:02.751247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.747657+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:10:02.747657+0000","last_peered":"2024-04-25T02:10:02.747657+0000","last_clean":"2024-04-25T02:10:02.747657+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:10:02.747657+0000","last_undegraded":"2024-04-25T02:10:02.747657+0000","last_fullsized":"2024-04-25T02:10:02.747657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.754250+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:10:02.754250+0000","last_peered":"2024-04-25T02:10:02.754250+0000","last_clean":"2024-04-25T02:10:02.754250+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:10:02.754250+0000","last_undegraded":"2024-04-25T02:10:02.754250+0000","last_fullsized":"2024-04-25T02:10:02.754250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751878+0000","last_change":"2024-04-25T02:10:02.742932+0000","last_active":"2024-04-25T02:10:02.751878+0000","last_peered":"2024-04-25T02:10:02.751878+0000","last_clean":"2024-04-25T02:10:02.751878+0000","last_became_active":"2024-04-25T02:10:02.742365+0000","last_became_peered":"2024-04-25T02:10:02.742365+0000","last_unstale":"2024-04-25T02:10:02.751878+0000","last_undegraded":"2024-04-25T02:10:02.751878+0000","last_fullsized":"2024-04-25T02:10:02.751878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750666+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:10:02.750666+0000","last_peered":"2024-04-25T02:10:02.750666+0000","last_clean":"2024-04-25T02:10:02.750666+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:10:02.750666+0000","last_undegraded":"2024-04-25T02:10:02.750666+0000","last_fullsized":"2024-04-25T02:10:02.750666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751840+0000","last_change":"2024-04-25T02:10:02.739416+0000","last_active":"2024-04-25T02:10:02.751840+0000","last_peered":"2024-04-25T02:10:02.751840+0000","last_clean":"2024-04-25T02:10:02.751840+0000","last_became_active":"2024-04-25T02:10:02.739082+0000","last_became_peered":"2024-04-25T02:10:02.739082+0000","last_unstale":"2024-04-25T02:10:02.751840+0000","last_undegraded":"2024-04-25T02:10:02.751840+0000","last_fullsized":"2024-04-25T02:10:02.751840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.713109+0000","last_change":"2024-04-25T02:10:02.370169+0000","last_active":"2024-04-25T02:10:02.713109+0000","last_peered":"2024-04-25T02:10:02.713109+0000","last_clean":"2024-04-25T02:10:02.713109+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:10:02.713109+0000","last_undegraded":"2024-04-25T02:10:02.713109+0000","last_fullsized":"2024-04-25T02:10:02.713109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751863+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:10:02.751863+0000","last_peered":"2024-04-25T02:10:02.751863+0000","last_clean":"2024-04-25T02:10:02.751863+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:10:02.751863+0000","last_undegraded":"2024-04-25T02:10:02.751863+0000","last_fullsized":"2024-04-25T02:10:02.751863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.718278+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:10:02.718278+0000","last_peered":"2024-04-25T02:10:02.718278+0000","last_clean":"2024-04-25T02:10:02.718278+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:10:02.718278+0000","last_undegraded":"2024-04-25T02:10:02.718278+0000","last_fullsized":"2024-04-25T02:10:02.718278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751409+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:10:02.751409+0000","last_peered":"2024-04-25T02:10:02.751409+0000","last_clean":"2024-04-25T02:10:02.751409+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:10:02.751409+0000","last_undegraded":"2024-04-25T02:10:02.751409+0000","last_fullsized":"2024-04-25T02:10:02.751409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.737251+0000","last_change":"2024-04-25T02:10:02.360557+0000","last_active":"2024-04-25T02:10:02.737251+0000","last_peered":"2024-04-25T02:10:02.737251+0000","last_clean":"2024-04-25T02:10:02.737251+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:10:02.737251+0000","last_undegraded":"2024-04-25T02:10:02.737251+0000","last_fullsized":"2024-04-25T02:10:02.737251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750758+0000","last_change":"2024-04-25T02:10:02.738439+0000","last_active":"2024-04-25T02:10:02.750758+0000","last_peered":"2024-04-25T02:10:02.750758+0000","last_clean":"2024-04-25T02:10:02.750758+0000","last_became_active":"2024-04-25T02:10:02.738074+0000","last_became_peered":"2024-04-25T02:10:02.738074+0000","last_unstale":"2024-04-25T02:10:02.750758+0000","last_undegraded":"2024-04-25T02:10:02.750758+0000","last_fullsized":"2024-04-25T02:10:02.750758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.740833+0000","last_change":"2024-04-25T02:10:02.370637+0000","last_active":"2024-04-25T02:10:02.740833+0000","last_peered":"2024-04-25T02:10:02.740833+0000","last_clean":"2024-04-25T02:10:02.740833+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:10:02.740833+0000","last_undegraded":"2024-04-25T02:10:02.740833+0000","last_fullsized":"2024-04-25T02:10:02.740833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750862+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:10:02.750862+0000","last_peered":"2024-04-25T02:10:02.750862+0000","last_clean":"2024-04-25T02:10:02.750862+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:10:02.750862+0000","last_undegraded":"2024-04-25T02:10:02.750862+0000","last_fullsized":"2024-04-25T02:10:02.750862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.728279+0000","last_change":"2024-04-25T02:10:02.358829+0000","last_active":"2024-04-25T02:10:02.728279+0000","last_peered":"2024-04-25T02:10:02.728279+0000","last_clean":"2024-04-25T02:10:02.728279+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:10:02.728279+0000","last_undegraded":"2024-04-25T02:10:02.728279+0000","last_fullsized":"2024-04-25T02:10:02.728279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.745845+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:10:02.745845+0000","last_peered":"2024-04-25T02:10:02.745845+0000","last_clean":"2024-04-25T02:10:02.745845+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:10:02.745845+0000","last_undegraded":"2024-04-25T02:10:02.745845+0000","last_fullsized":"2024-04-25T02:10:02.745845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750283+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:10:02.750283+0000","last_peered":"2024-04-25T02:10:02.750283+0000","last_clean":"2024-04-25T02:10:02.750283+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:10:02.750283+0000","last_undegraded":"2024-04-25T02:10:02.750283+0000","last_fullsized":"2024-04-25T02:10:02.750283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752036+0000","last_change":"2024-04-25T02:10:02.744548+0000","last_active":"2024-04-25T02:10:02.752036+0000","last_peered":"2024-04-25T02:10:02.752036+0000","last_clean":"2024-04-25T02:10:02.752036+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:10:02.752036+0000","last_undegraded":"2024-04-25T02:10:02.752036+0000","last_fullsized":"2024-04-25T02:10:02.752036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.719975+0000","last_change":"2024-04-25T02:10:02.371223+0000","last_active":"2024-04-25T02:10:02.719975+0000","last_peered":"2024-04-25T02:10:02.719975+0000","last_clean":"2024-04-25T02:10:02.719975+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:10:02.719975+0000","last_undegraded":"2024-04-25T02:10:02.719975+0000","last_fullsized":"2024-04-25T02:10:02.719975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751343+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:10:02.751343+0000","last_peered":"2024-04-25T02:10:02.751343+0000","last_clean":"2024-04-25T02:10:02.751343+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:10:02.751343+0000","last_undegraded":"2024-04-25T02:10:02.751343+0000","last_fullsized":"2024-04-25T02:10:02.751343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750444+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:10:02.750444+0000","last_peered":"2024-04-25T02:10:02.750444+0000","last_clean":"2024-04-25T02:10:02.750444+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:10:02.750444+0000","last_undegraded":"2024-04-25T02:10:02.750444+0000","last_fullsized":"2024-04-25T02:10:02.750444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751251+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:10:02.751251+0000","last_peered":"2024-04-25T02:10:02.751251+0000","last_clean":"2024-04-25T02:10:02.751251+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:10:02.751251+0000","last_undegraded":"2024-04-25T02:10:02.751251+0000","last_fullsized":"2024-04-25T02:10:02.751251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715303+0000","last_change":"2024-04-25T02:10:02.367348+0000","last_active":"2024-04-25T02:10:02.715303+0000","last_peered":"2024-04-25T02:10:02.715303+0000","last_clean":"2024-04-25T02:10:02.715303+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:10:02.715303+0000","last_undegraded":"2024-04-25T02:10:02.715303+0000","last_fullsized":"2024-04-25T02:10:02.715303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751592+0000","last_change":"2024-04-25T02:10:02.738639+0000","last_active":"2024-04-25T02:10:02.751592+0000","last_peered":"2024-04-25T02:10:02.751592+0000","last_clean":"2024-04-25T02:10:02.751592+0000","last_became_active":"2024-04-25T02:10:02.738040+0000","last_became_peered":"2024-04-25T02:10:02.738040+0000","last_unstale":"2024-04-25T02:10:02.751592+0000","last_undegraded":"2024-04-25T02:10:02.751592+0000","last_fullsized":"2024-04-25T02:10:02.751592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.716182+0000","last_change":"2024-04-25T02:10:02.360699+0000","last_active":"2024-04-25T02:10:02.716182+0000","last_peered":"2024-04-25T02:10:02.716182+0000","last_clean":"2024-04-25T02:10:02.716182+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:10:02.716182+0000","last_undegraded":"2024-04-25T02:10:02.716182+0000","last_fullsized":"2024-04-25T02:10:02.716182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751951+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:10:02.751951+0000","last_peered":"2024-04-25T02:10:02.751951+0000","last_clean":"2024-04-25T02:10:02.751951+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:10:02.751951+0000","last_undegraded":"2024-04-25T02:10:02.751951+0000","last_fullsized":"2024-04-25T02:10:02.751951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708856+0000","last_change":"2024-04-25T02:10:02.365974+0000","last_active":"2024-04-25T02:10:02.708856+0000","last_peered":"2024-04-25T02:10:02.708856+0000","last_clean":"2024-04-25T02:10:02.708856+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:10:02.708856+0000","last_undegraded":"2024-04-25T02:10:02.708856+0000","last_fullsized":"2024-04-25T02:10:02.708856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750664+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:10:02.750664+0000","last_peered":"2024-04-25T02:10:02.750664+0000","last_clean":"2024-04-25T02:10:02.750664+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:10:02.750664+0000","last_undegraded":"2024-04-25T02:10:02.750664+0000","last_fullsized":"2024-04-25T02:10:02.750664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.711566+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:10:02.711566+0000","last_peered":"2024-04-25T02:10:02.711566+0000","last_clean":"2024-04-25T02:10:02.711566+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:10:02.711566+0000","last_undegraded":"2024-04-25T02:10:02.711566+0000","last_fullsized":"2024-04-25T02:10:02.711566+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.711916+0000","last_change":"2024-04-25T02:10:02.367538+0000","last_active":"2024-04-25T02:10:02.711916+0000","last_peered":"2024-04-25T02:10:02.711916+0000","last_clean":"2024-04-25T02:10:02.711916+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:10:02.711916+0000","last_undegraded":"2024-04-25T02:10:02.711916+0000","last_fullsized":"2024-04-25T02:10:02.711916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.747676+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:10:02.747676+0000","last_peered":"2024-04-25T02:10:02.747676+0000","last_clean":"2024-04-25T02:10:02.747676+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:10:02.747676+0000","last_undegraded":"2024-04-25T02:10:02.747676+0000","last_fullsized":"2024-04-25T02:10:02.747676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715220+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:02.715220+0000","last_peered":"2024-04-25T02:10:02.715220+0000","last_clean":"2024-04-25T02:10:02.715220+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:02.715220+0000","last_undegraded":"2024-04-25T02:10:02.715220+0000","last_fullsized":"2024-04-25T02:10:02.715220+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.719601+0000","last_change":"2024-04-25T02:10:02.360464+0000","last_active":"2024-04-25T02:10:02.719601+0000","last_peered":"2024-04-25T02:10:02.719601+0000","last_clean":"2024-04-25T02:10:02.719601+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:10:02.719601+0000","last_undegraded":"2024-04-25T02:10:02.719601+0000","last_fullsized":"2024-04-25T02:10:02.719601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743997+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:10:02.743997+0000","last_peered":"2024-04-25T02:10:02.743997+0000","last_clean":"2024-04-25T02:10:02.743997+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:10:02.743997+0000","last_undegraded":"2024-04-25T02:10:02.743997+0000","last_fullsized":"2024-04-25T02:10:02.743997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708934+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:10:02.708934+0000","last_peered":"2024-04-25T02:10:02.708934+0000","last_clean":"2024-04-25T02:10:02.708934+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:10:02.708934+0000","last_undegraded":"2024-04-25T02:10:02.708934+0000","last_fullsized":"2024-04-25T02:10:02.708934+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708931+0000","last_change":"2024-04-25T02:10:02.361010+0000","last_active":"2024-04-25T02:10:02.708931+0000","last_peered":"2024-04-25T02:10:02.708931+0000","last_clean":"2024-04-25T02:10:02.708931+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:10:02.708931+0000","last_undegraded":"2024-04-25T02:10:02.708931+0000","last_fullsized":"2024-04-25T02:10:02.708931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.740726+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:10:02.740726+0000","last_peered":"2024-04-25T02:10:02.740726+0000","last_clean":"2024-04-25T02:10:02.740726+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:10:02.740726+0000","last_undegraded":"2024-04-25T02:10:02.740726+0000","last_fullsized":"2024-04-25T02:10:02.740726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715234+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:02.715234+0000","last_peered":"2024-04-25T02:10:02.715234+0000","last_clean":"2024-04-25T02:10:02.715234+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:02.715234+0000","last_undegraded":"2024-04-25T02:10:02.715234+0000","last_fullsized":"2024-04-25T02:10:02.715234+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708832+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:10:02.708832+0000","last_peered":"2024-04-25T02:10:02.708832+0000","last_clean":"2024-04-25T02:10:02.708832+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:10:02.708832+0000","last_undegraded":"2024-04-25T02:10:02.708832+0000","last_fullsized":"2024-04-25T02:10:02.708832+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715074+0000","last_change":"2024-04-25T02:10:02.364629+0000","last_active":"2024-04-25T02:10:02.715074+0000","last_peered":"2024-04-25T02:10:02.715074+0000","last_clean":"2024-04-25T02:10:02.715074+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:10:02.715074+0000","last_undegraded":"2024-04-25T02:10:02.715074+0000","last_fullsized":"2024-04-25T02:10:02.715074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751605+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:10:02.751605+0000","last_peered":"2024-04-25T02:10:02.751605+0000","last_clean":"2024-04-25T02:10:02.751605+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:10:02.751605+0000","last_undegraded":"2024-04-25T02:10:02.751605+0000","last_fullsized":"2024-04-25T02:10:02.751605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.709238+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:02.709238+0000","last_peered":"2024-04-25T02:10:02.709238+0000","last_clean":"2024-04-25T02:10:02.709238+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:02.709238+0000","last_undegraded":"2024-04-25T02:10:02.709238+0000","last_fullsized":"2024-04-25T02:10:02.709238+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.712258+0000","last_change":"2024-04-25T02:10:02.356105+0000","last_active":"2024-04-25T02:10:02.712258+0000","last_peered":"2024-04-25T02:10:02.712258+0000","last_clean":"2024-04-25T02:10:02.712258+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:10:02.712258+0000","last_undegraded":"2024-04-25T02:10:02.712258+0000","last_fullsized":"2024-04-25T02:10:02.712258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750390+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:10:02.750390+0000","last_peered":"2024-04-25T02:10:02.750390+0000","last_clean":"2024-04-25T02:10:02.750390+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:10:02.750390+0000","last_undegraded":"2024-04-25T02:10:02.750390+0000","last_fullsized":"2024-04-25T02:10:02.750390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.714745+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:02.714745+0000","last_peered":"2024-04-25T02:10:02.714745+0000","last_clean":"2024-04-25T02:10:02.714745+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:02.714745+0000","last_undegraded":"2024-04-25T02:10:02.714745+0000","last_fullsized":"2024-04-25T02:10:02.714745+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.710292+0000","last_change":"2024-04-25T02:10:02.360478+0000","last_active":"2024-04-25T02:10:02.710292+0000","last_peered":"2024-04-25T02:10:02.710292+0000","last_clean":"2024-04-25T02:10:02.710292+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:10:02.710292+0000","last_undegraded":"2024-04-25T02:10:02.710292+0000","last_fullsized":"2024-04-25T02:10:02.710292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.733559+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:10:02.733559+0000","last_peered":"2024-04-25T02:10:02.733559+0000","last_clean":"2024-04-25T02:10:02.733559+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:10:02.733559+0000","last_undegraded":"2024-04-25T02:10:02.733559+0000","last_fullsized":"2024-04-25T02:10:02.733559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743700+0000","last_change":"2024-04-25T02:10:02.370193+0000","last_active":"2024-04-25T02:10:02.743700+0000","last_peered":"2024-04-25T02:10:02.743700+0000","last_clean":"2024-04-25T02:10:02.743700+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:10:02.743700+0000","last_undegraded":"2024-04-25T02:10:02.743700+0000","last_fullsized":"2024-04-25T02:10:02.743700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.714484+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:10:02.714484+0000","last_peered":"2024-04-25T02:10:02.714484+0000","last_clean":"2024-04-25T02:10:02.714484+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:10:02.714484+0000","last_undegraded":"2024-04-25T02:10:02.714484+0000","last_fullsized":"2024-04-25T02:10:02.714484+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750824+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:10:02.750824+0000","last_peered":"2024-04-25T02:10:02.750824+0000","last_clean":"2024-04-25T02:10:02.750824+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:10:02.750824+0000","last_undegraded":"2024-04-25T02:10:02.750824+0000","last_fullsized":"2024-04-25T02:10:02.750824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.714476+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:02.714476+0000","last_peered":"2024-04-25T02:10:02.714476+0000","last_clean":"2024-04-25T02:10:02.714476+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:02.714476+0000","last_undegraded":"2024-04-25T02:10:02.714476+0000","last_fullsized":"2024-04-25T02:10:02.714476+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.719926+0000","last_change":"2024-04-25T02:10:02.370537+0000","last_active":"2024-04-25T02:10:02.719926+0000","last_peered":"2024-04-25T02:10:02.719926+0000","last_clean":"2024-04-25T02:10:02.719926+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:10:02.719926+0000","last_undegraded":"2024-04-25T02:10:02.719926+0000","last_fullsized":"2024-04-25T02:10:02.719926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752025+0000","last_change":"2024-04-25T02:10:02.748709+0000","last_active":"2024-04-25T02:10:02.752025+0000","last_peered":"2024-04-25T02:10:02.752025+0000","last_clean":"2024-04-25T02:10:02.752025+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:10:02.752025+0000","last_undegraded":"2024-04-25T02:10:02.752025+0000","last_fullsized":"2024-04-25T02:10:02.752025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750585+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:10:02.750585+0000","last_peered":"2024-04-25T02:10:02.750585+0000","last_clean":"2024-04-25T02:10:02.750585+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:10:02.750585+0000","last_undegraded":"2024-04-25T02:10:02.750585+0000","last_fullsized":"2024-04-25T02:10:02.750585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750180+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:10:02.750180+0000","last_peered":"2024-04-25T02:10:02.750180+0000","last_clean":"2024-04-25T02:10:02.750180+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:10:02.750180+0000","last_undegraded":"2024-04-25T02:10:02.750180+0000","last_fullsized":"2024-04-25T02:10:02.750180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.737684+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:10:02.737684+0000","last_peered":"2024-04-25T02:10:02.737684+0000","last_clean":"2024-04-25T02:10:02.737684+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:10:02.737684+0000","last_undegraded":"2024-04-25T02:10:02.737684+0000","last_fullsized":"2024-04-25T02:10:02.737684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751910+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:10:02.751910+0000","last_peered":"2024-04-25T02:10:02.751910+0000","last_clean":"2024-04-25T02:10:02.751910+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:10:02.751910+0000","last_undegraded":"2024-04-25T02:10:02.751910+0000","last_fullsized":"2024-04-25T02:10:02.751910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.745989+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:10:02.745989+0000","last_peered":"2024-04-25T02:10:02.745989+0000","last_clean":"2024-04-25T02:10:02.745989+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:10:02.745989+0000","last_undegraded":"2024-04-25T02:10:02.745989+0000","last_fullsized":"2024-04-25T02:10:02.745989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752054+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:10:02.752054+0000","last_peered":"2024-04-25T02:10:02.752054+0000","last_clean":"2024-04-25T02:10:02.752054+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:10:02.752054+0000","last_undegraded":"2024-04-25T02:10:02.752054+0000","last_fullsized":"2024-04-25T02:10:02.752054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.741785+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:10:02.741785+0000","last_peered":"2024-04-25T02:10:02.741785+0000","last_clean":"2024-04-25T02:10:02.741785+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:10:02.741785+0000","last_undegraded":"2024-04-25T02:10:02.741785+0000","last_fullsized":"2024-04-25T02:10:02.741785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751558+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:10:02.751558+0000","last_peered":"2024-04-25T02:10:02.751558+0000","last_clean":"2024-04-25T02:10:02.751558+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:10:02.751558+0000","last_undegraded":"2024-04-25T02:10:02.751558+0000","last_fullsized":"2024-04-25T02:10:02.751558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.744528+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:10:02.744528+0000","last_peered":"2024-04-25T02:10:02.744528+0000","last_clean":"2024-04-25T02:10:02.744528+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:10:02.744528+0000","last_undegraded":"2024-04-25T02:10:02.744528+0000","last_fullsized":"2024-04-25T02:10:02.744528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751847+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:10:02.751847+0000","last_peered":"2024-04-25T02:10:02.751847+0000","last_clean":"2024-04-25T02:10:02.751847+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:10:02.751847+0000","last_undegraded":"2024-04-25T02:10:02.751847+0000","last_fullsized":"2024-04-25T02:10:02.751847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.742731+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:10:02.742731+0000","last_peered":"2024-04-25T02:10:02.742731+0000","last_clean":"2024-04-25T02:10:02.742731+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:10:02.742731+0000","last_undegraded":"2024-04-25T02:10:02.742731+0000","last_fullsized":"2024-04-25T02:10:02.742731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751522+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:10:02.751522+0000","last_peered":"2024-04-25T02:10:02.751522+0000","last_clean":"2024-04-25T02:10:02.751522+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:10:02.751522+0000","last_undegraded":"2024-04-25T02:10:02.751522+0000","last_fullsized":"2024-04-25T02:10:02.751522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751431+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:10:02.751431+0000","last_peered":"2024-04-25T02:10:02.751431+0000","last_clean":"2024-04-25T02:10:02.751431+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:10:02.751431+0000","last_undegraded":"2024-04-25T02:10:02.751431+0000","last_fullsized":"2024-04-25T02:10:02.751431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750718+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:10:02.750718+0000","last_peered":"2024-04-25T02:10:02.750718+0000","last_clean":"2024-04-25T02:10:02.750718+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:10:02.750718+0000","last_undegraded":"2024-04-25T02:10:02.750718+0000","last_fullsized":"2024-04-25T02:10:02.750718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743979+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:10:02.743979+0000","last_peered":"2024-04-25T02:10:02.743979+0000","last_clean":"2024-04-25T02:10:02.743979+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:10:02.743979+0000","last_undegraded":"2024-04-25T02:10:02.743979+0000","last_fullsized":"2024-04-25T02:10:02.743979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":45214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:10.366 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:10:10.367 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:10:10.367 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:10:10.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T02:10:10.367 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T02:10:10.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3b1018700 1 Processor -- start 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3b1018700 1 -- start start 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3b1018700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb3ac062860 0x7fb3ac1271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3b1018700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac127ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3b1018700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac095640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3b1018700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ac062c40 con 0x7fb3ac062860 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3b1018700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac096490 con 0x7fb3ac095190 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3b1018700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac091e50 con 0x7fb3ac1277a0 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3aa59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3ab59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac095640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3aad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb3ac062860 0x7fb3ac1271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3ab59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac095640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35276/0 (socket says 172.21.15.78:35276) 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3aa59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac127ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40706/0 (socket says 172.21.15.78:40706) 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3aad9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb3ac062860 0x7fb3ac1271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42798/0 (socket says 172.21.15.78:42798) 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.510+0000 7fb3ab59e700 1 -- 172.21.15.78:0/2039528352 learned_addr learned my addr 172.21.15.78:0/2039528352 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:10.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3aa59c700 1 -- 172.21.15.78:0/2039528352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 msgr2=0x7fb3ac095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3aa59c700 1 --2- 172.21.15.78:0/2039528352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac095640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3aa59c700 1 -- 172.21.15.78:0/2039528352 >> v2:172.21.15.78:3300/0 conn(0x7fb3ac062860 msgr2=0x7fb3ac1271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3aa59c700 1 --2- 172.21.15.78:0/2039528352 >> v2:172.21.15.78:3300/0 conn(0x7fb3ac062860 0x7fb3ac1271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3aa59c700 1 -- 172.21.15.78:0/2039528352 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac091b90 con 0x7fb3ac1277a0 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3ab59e700 1 --2- 172.21.15.78:0/2039528352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3aad9d700 1 --2- 172.21.15.78:0/2039528352 >> v2:172.21.15.78:3300/0 conn(0x7fb3ac062860 0x7fb3ac1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3aa59c700 1 --2- 172.21.15.78:0/2039528352 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac127ba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb3a0009760 tx=0x7fb3a0009060).ready entity=mon.2 client_cookie=1e50f929b2e8e4e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3a9d9b700 1 -- 172.21.15.78:0/2039528352 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a000d4a0 con 0x7fb3ac1277a0 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3a9d9b700 1 -- 172.21.15.78:0/2039528352 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a000d600 con 0x7fb3ac1277a0 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3a9d9b700 1 -- 172.21.15.78:0/2039528352 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a000d980 con 0x7fb3ac1277a0 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3b1018700 1 -- 172.21.15.78:0/2039528352 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 msgr2=0x7fb3ac127ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3b1018700 1 --2- 172.21.15.78:0/2039528352 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac127ba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb3a0009760 tx=0x7fb3a0009060).stop 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3b1018700 1 -- 172.21.15.78:0/2039528352 shutdown_connections 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3b1018700 1 --2- 172.21.15.78:0/2039528352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3b1018700 1 --2- 172.21.15.78:0/2039528352 >> v2:172.21.15.78:3300/0 conn(0x7fb3ac062860 0x7fb3ac1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3b1018700 1 --2- 172.21.15.78:0/2039528352 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac127ba0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.511+0000 7fb3b1018700 1 -- 172.21.15.78:0/2039528352 >> 172.21.15.78:0/2039528352 conn(0x7fb3ac097450 msgr2=0x7fb3ac097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.512+0000 7fb3b1018700 1 -- 172.21.15.78:0/2039528352 shutdown_connections 2024-04-25T02:10:10.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.512+0000 7fb3b1018700 1 -- 172.21.15.78:0/2039528352 wait complete. 2024-04-25T02:10:10.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3b1018700 1 Processor -- start 2024-04-25T02:10:10.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3b1018700 1 -- start start 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3b1018700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3ac062860 0x7fb3ac126a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3b1018700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac115990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3b1018700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac115e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3b1018700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac118f20 con 0x7fb3ac062860 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3b1018700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac096d20 con 0x7fb3ac095190 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3b1018700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac127200 con 0x7fb3ac1277a0 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3aad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3ac062860 0x7fb3ac126a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3aa59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac115990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3aad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3ac062860 0x7fb3ac126a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42812/0 (socket says 172.21.15.78:42812) 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3aad9d700 1 -- 172.21.15.78:0/487922460 learned_addr learned my addr 172.21.15.78:0/487922460 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.513+0000 7fb3ab59e700 1 --2- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac115e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3aa59c700 1 -- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 msgr2=0x7fb3ac115e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3aa59c700 1 --2- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac115e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3aa59c700 1 -- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3ac062860 msgr2=0x7fb3ac126a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3aa59c700 1 --2- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3ac062860 0x7fb3ac126a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3aa59c700 1 -- 172.21.15.78:0/487922460 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0092a0 con 0x7fb3ac095190 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3aa59c700 1 --2- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac115990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb3ac06ac60 tx=0x7fb3a0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3937fe700 1 -- 172.21.15.78:0/487922460 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a000dcf0 con 0x7fb3ac095190 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3937fe700 1 -- 172.21.15.78:0/487922460 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a000de50 con 0x7fb3ac095190 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a4009ae0 con 0x7fb3ac095190 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3937fe700 1 -- 172.21.15.78:0/487922460 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a000d980 con 0x7fb3ac095190 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.514+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a00092a0 con 0x7fb3ac095190 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.515+0000 7fb3937fe700 1 -- 172.21.15.78:0/487922460 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fb3a001d640 con 0x7fb3ac095190 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.515+0000 7fb3937fe700 1 -- 172.21.15.78:0/487922460 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb3a003c790 con 0x7fb3ac095190 2024-04-25T02:10:10.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.515+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ac119930 con 0x7fb3ac095190 2024-04-25T02:10:10.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.519+0000 7fb3937fe700 1 -- 172.21.15.78:0/487922460 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fb3a001d8f0 con 0x7fb3ac095190 2024-04-25T02:10:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.718+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb3ac119bc0 con 0x7fb3ac095190 2024-04-25T02:10:10.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.719+0000 7fb3937fe700 1 -- 172.21.15.78:0/487922460 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64325 (secure 0 0 0) 0x7fb3a0010360 con 0x7fb3ac095190 2024-04-25T02:10:10.727 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 >> v1:172.21.15.78:6816/46507 conn(0x7fb39802bd00 legacy=0x7fb39802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 msgr2=0x7fb3ac115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 --2- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac115990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb3ac06ac60 tx=0x7fb3a0016000).stop 2024-04-25T02:10:10.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 shutdown_connections 2024-04-25T02:10:10.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 --2- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb3ac1277a0 0x7fb3ac115e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 --2- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3ac062860 0x7fb3ac126a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 --2- 172.21.15.78:0/487922460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3ac095190 0x7fb3ac115990 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 >> 172.21.15.78:0/487922460 conn(0x7fb3ac097450 msgr2=0x7fb3ac12ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 shutdown_connections 2024-04-25T02:10:10.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.721+0000 7fb3b1018700 1 -- 172.21.15.78:0/487922460 wait complete. 2024-04-25T02:10:10.742 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6816","nonce":46507}]},"active_addr":"172.21.15.78:6816/46507","active_change":"2024-04-25T02:09:52.189524+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2142937370}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1080180923}]}]} 2024-04-25T02:10:10.744 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T02:10:10.744 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:10:10.744 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.850+0000 7f46f6b35700 1 Processor -- start 2024-04-25T02:10:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.850+0000 7f46f6b35700 1 -- start start 2024-04-25T02:10:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f6b35700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f0091830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f6b35700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0091d20 0x7f46f0090070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f6b35700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46f0090560 0x7f46f00909f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f6b35700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f006c260 con 0x7f46f0090560 2024-04-25T02:10:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f6b35700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0093d70 con 0x7f46f0091450 2024-04-25T02:10:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f6b35700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0099570 con 0x7f46f0091d20 2024-04-25T02:10:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f50d2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46f0090560 0x7f46f00909f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f48d1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f0091830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46effff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0091d20 0x7f46f0090070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f48d1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f0091830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35290/0 (socket says 172.21.15.78:35290) 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46effff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0091d20 0x7f46f0090070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40728/0 (socket says 172.21.15.78:40728) 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f50d2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46f0090560 0x7f46f00909f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42824/0 (socket says 172.21.15.78:42824) 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f48d1700 1 -- 172.21.15.78:0/3830393063 learned_addr learned my addr 172.21.15.78:0/3830393063 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46effff700 1 -- 172.21.15.78:0/3830393063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 msgr2=0x7f46f0091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46effff700 1 --2- 172.21.15.78:0/3830393063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f0091830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46effff700 1 -- 172.21.15.78:0/3830393063 >> v2:172.21.15.78:3300/0 conn(0x7f46f0090560 msgr2=0x7f46f00909f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46effff700 1 --2- 172.21.15.78:0/3830393063 >> v2:172.21.15.78:3300/0 conn(0x7f46f0090560 0x7f46f00909f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46effff700 1 -- 172.21.15.78:0/3830393063 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0093ad0 con 0x7f46f0091d20 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f48d1700 1 --2- 172.21.15.78:0/3830393063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f0091830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46f50d2700 1 --2- 172.21.15.78:0/3830393063 >> v2:172.21.15.78:3300/0 conn(0x7f46f0090560 0x7f46f00909f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.851+0000 7f46effff700 1 --2- 172.21.15.78:0/3830393063 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0091d20 0x7f46f0090070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f46dc009790 tx=0x7f46dc009060).ready entity=mon.2 client_cookie=ddb3f6c22d4e4fa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46ef7fe700 1 -- 172.21.15.78:0/3830393063 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0090d0 con 0x7f46f0091d20 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46ef7fe700 1 -- 172.21.15.78:0/3830393063 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00d4a0 con 0x7f46f0091d20 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46ef7fe700 1 -- 172.21.15.78:0/3830393063 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00d820 con 0x7f46f0091d20 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46f6b35700 1 -- 172.21.15.78:0/3830393063 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0091d20 msgr2=0x7f46f0090070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46f6b35700 1 --2- 172.21.15.78:0/3830393063 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0091d20 0x7f46f0090070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f46dc009790 tx=0x7f46dc009060).stop 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46f6b35700 1 -- 172.21.15.78:0/3830393063 shutdown_connections 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46f6b35700 1 --2- 172.21.15.78:0/3830393063 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f0091830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46f6b35700 1 --2- 172.21.15.78:0/3830393063 >> v2:172.21.15.78:3300/0 conn(0x7f46f0090560 0x7f46f00909f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46f6b35700 1 --2- 172.21.15.78:0/3830393063 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0091d20 0x7f46f0090070 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46f6b35700 1 -- 172.21.15.78:0/3830393063 >> 172.21.15.78:0/3830393063 conn(0x7f46f00974d0 msgr2=0x7f46f0099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46f6b35700 1 -- 172.21.15.78:0/3830393063 shutdown_connections 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.852+0000 7f46f6b35700 1 -- 172.21.15.78:0/3830393063 wait complete. 2024-04-25T02:10:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.853+0000 7f46f6b35700 1 Processor -- start 2024-04-25T02:10:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.853+0000 7f46f6b35700 1 -- start start 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f6b35700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0090560 0x7f46f012caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f6b35700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f012cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f6b35700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46f0091d20 0x7f46f012d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f6b35700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f012d9c0 con 0x7f46f0091d20 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f6b35700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0120ef0 con 0x7f46f0091450 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f6b35700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0121db0 con 0x7f46f0090560 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46effff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f012cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f48d1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0090560 0x7f46f012caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f50d2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46f0091d20 0x7f46f012d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46effff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f012cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35298/0 (socket says 172.21.15.78:35298) 2024-04-25T02:10:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f48d1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0090560 0x7f46f012caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40736/0 (socket says 172.21.15.78:40736) 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46effff700 1 -- 172.21.15.78:0/884870753 learned_addr learned my addr 172.21.15.78:0/884870753 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f50d2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46f0091d20 0x7f46f012d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42838/0 (socket says 172.21.15.78:42838) 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46effff700 1 -- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0090560 msgr2=0x7f46f012caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46effff700 1 --2- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0090560 0x7f46f012caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46effff700 1 -- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46f0091d20 msgr2=0x7f46f012d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46effff700 1 --2- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46f0091d20 0x7f46f012d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46effff700 1 -- 172.21.15.78:0/884870753 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e8009a20 con 0x7f46f0091450 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f50d2700 1 --2- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46f0091d20 0x7f46f012d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46effff700 1 --2- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f012cfe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f46f0099700 tx=0x7f46dc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46ed7fa700 1 -- 172.21.15.78:0/884870753 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0128a0 con 0x7f46f0091450 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46ed7fa700 1 -- 172.21.15.78:0/884870753 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc012a00 con 0x7f46f0091450 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e4009370 con 0x7f46f0091450 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46ed7fa700 1 -- 172.21.15.78:0/884870753 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc012dc0 con 0x7f46f0091450 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.854+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc0092a0 con 0x7f46f0091450 2024-04-25T02:10:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.855+0000 7f46ed7fa700 1 -- 172.21.15.78:0/884870753 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f46dc01c630 con 0x7f46f0091450 2024-04-25T02:10:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.855+0000 7f46ed7fa700 1 -- 172.21.15.78:0/884870753 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f46dc03c5f0 con 0x7f46f0091450 2024-04-25T02:10:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.856+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f0121030 con 0x7f46f0091450 2024-04-25T02:10:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:10.860+0000 7f46ed7fa700 1 -- 172.21.15.78:0/884870753 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f46f0121030 con 0x7f46f0091450 2024-04-25T02:10:11.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.018+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46f0121030 con 0x7f46f0091450 2024-04-25T02:10:11.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.019+0000 7f46ed7fa700 1 -- 172.21.15.78:0/884870753 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11309 (secure 0 0 0) 0x7f46f0121030 con 0x7f46f0091450 2024-04-25T02:10:11.026 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:11.027 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:03.700137+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 >> v1:172.21.15.78:6816/46507 conn(0x7f46d402bd30 legacy=0x7f46d402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 msgr2=0x7f46f012cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 --2- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f012cfe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f46f0099700 tx=0x7f46dc016000).stop 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 shutdown_connections 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 --2- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46f0091d20 0x7f46f012d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 --2- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f46f0090560 0x7f46f012caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 --2- 172.21.15.78:0/884870753 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46f0091450 0x7f46f012cfe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 >> 172.21.15.78:0/884870753 conn(0x7f46f00974d0 msgr2=0x7f46f0068860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 shutdown_connections 2024-04-25T02:10:11.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.021+0000 7f46f6b35700 1 -- 172.21.15.78:0/884870753 wait complete. 2024-04-25T02:10:11.040 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:10:11.040 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.145+0000 7efdbb5cc700 1 Processor -- start 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.145+0000 7efdbb5cc700 1 -- start start 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdbb5cc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efdb4062860 0x7efdb41271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdbb5cc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb4131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdbb5cc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb4096490 con 0x7efdb41277a0 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdbb5cc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb4062c40 con 0x7efdb4062860 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdbb5cc700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4091b90 con 0x7efdb412fb30 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb9368700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efdb4062860 0x7efdb41271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb9b69700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb4131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb8b67700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efdb41277a0 0x7efdb4127ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59998/0 (socket says 172.21.15.78:59998) 2024-04-25T02:10:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb8b67700 1 -- 172.21.15.78:0/3725603222 learned_addr learned my addr 172.21.15.78:0/3725603222 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb9b69700 1 --2- 172.21.15.78:0/3725603222 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb4131f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40752/0 (socket says 172.21.15.78:40752) 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb9368700 1 --2- 172.21.15.78:0/3725603222 >> v2:172.21.15.78:3300/0 conn(0x7efdb4062860 0x7efdb41271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42854/0 (socket says 172.21.15.78:42854) 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb9368700 1 -- 172.21.15.78:0/3725603222 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 msgr2=0x7efdb4131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb9368700 1 --2- 172.21.15.78:0/3725603222 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb4131f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb9368700 1 -- 172.21.15.78:0/3725603222 >> v1:172.21.15.78:6789/0 conn(0x7efdb41277a0 legacy=0x7efdb4127ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb9368700 1 -- 172.21.15.78:0/3725603222 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4091e50 con 0x7efdb4062860 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdabfff700 1 -- 172.21.15.78:0/3725603222 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603626830 0 0) 0x7efdb4096490 con 0x7efdb41277a0 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.146+0000 7efdb9368700 1 --2- 172.21.15.78:0/3725603222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 0x7efdb41271f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efda4009760 tx=0x7efda4009060).ready entity=mon.0 client_cookie=4481a07f229aae94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdabfff700 1 -- 172.21.15.78:0/3725603222 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda400f510 con 0x7efdb4062860 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdabfff700 1 -- 172.21.15.78:0/3725603222 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda400f670 con 0x7efdb4062860 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdabfff700 1 -- 172.21.15.78:0/3725603222 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda400f9f0 con 0x7efdb4062860 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdbb5cc700 1 -- 172.21.15.78:0/3725603222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 msgr2=0x7efdb41271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdbb5cc700 1 --2- 172.21.15.78:0/3725603222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 0x7efdb41271f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efda4009760 tx=0x7efda4009060).stop 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdbb5cc700 1 -- 172.21.15.78:0/3725603222 shutdown_connections 2024-04-25T02:10:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdbb5cc700 1 --2- 172.21.15.78:0/3725603222 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb4131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdbb5cc700 1 --2- 172.21.15.78:0/3725603222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 0x7efdb41271f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdbb5cc700 1 -- 172.21.15.78:0/3725603222 >> 172.21.15.78:0/3725603222 conn(0x7efdb4097450 msgr2=0x7efdb4097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdbb5cc700 1 -- 172.21.15.78:0/3725603222 shutdown_connections 2024-04-25T02:10:11.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.147+0000 7efdbb5cc700 1 -- 172.21.15.78:0/3725603222 wait complete. 2024-04-25T02:10:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.148+0000 7efdbb5cc700 1 Processor -- start 2024-04-25T02:10:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.148+0000 7efdbb5cc700 1 -- start start 2024-04-25T02:10:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.148+0000 7efdbb5cc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 0x7efdb4110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.148+0000 7efdbb5cc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efdb41277a0 0x7efdb412bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.148+0000 7efdbb5cc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb412c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.148+0000 7efdbb5cc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4096d20 con 0x7efdb4062860 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.148+0000 7efdbb5cc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4124ed0 con 0x7efdb41277a0 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.148+0000 7efdbb5cc700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdb412f290 con 0x7efdb412fb30 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9368700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 0x7efdb4110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9368700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 0x7efdb4110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42866/0 (socket says 172.21.15.78:42866) 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9368700 1 -- 172.21.15.78:0/2999029580 learned_addr learned my addr 172.21.15.78:0/2999029580 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb8b67700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efdb41277a0 0x7efdb412bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9b69700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb412c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9368700 1 -- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 msgr2=0x7efdb412c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9368700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb412c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9368700 1 -- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efdb41277a0 msgr2=0x7efdb412bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9368700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efdb41277a0 0x7efdb412bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9368700 1 -- 172.21.15.78:0/2999029580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40092a0 con 0x7efdb4062860 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9b69700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb412c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdb9368700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 0x7efdb4110df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7efda4006d90 tx=0x7efda4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efda9ffb700 1 -- 172.21.15.78:0/2999029580 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda400f7e0 con 0x7efdb4062860 2024-04-25T02:10:11.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efda9ffb700 1 -- 172.21.15.78:0/2999029580 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda400f940 con 0x7efdb4062860 2024-04-25T02:10:11.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb412dde0 con 0x7efdb4062860 2024-04-25T02:10:11.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efda9ffb700 1 -- 172.21.15.78:0/2999029580 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda401b660 con 0x7efdb4062860 2024-04-25T02:10:11.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.149+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb412d5f0 con 0x7efdb4062860 2024-04-25T02:10:11.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.150+0000 7efda9ffb700 1 -- 172.21.15.78:0/2999029580 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7efda401ba50 con 0x7efdb4062860 2024-04-25T02:10:11.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.150+0000 7efda9ffb700 1 -- 172.21.15.78:0/2999029580 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7efda403caa0 con 0x7efdb4062860 2024-04-25T02:10:11.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.150+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb412ef30 con 0x7efdb4062860 2024-04-25T02:10:11.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.155+0000 7efda9ffb700 1 -- 172.21.15.78:0/2999029580 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7efdb412ef30 con 0x7efdb4062860 2024-04-25T02:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.312+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdb412f0f0 con 0x7efdb4062860 2024-04-25T02:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.313+0000 7efda9ffb700 1 -- 172.21.15.78:0/2999029580 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11309 (secure 0 0 0) 0x7efdb412f0f0 con 0x7efdb4062860 2024-04-25T02:10:11.321 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:11.321 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:03.700137+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:11.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 >> v1:172.21.15.78:6816/46507 conn(0x7efd9802bd00 legacy=0x7efd9802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 msgr2=0x7efdb4110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 0x7efdb4110df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7efda4006d90 tx=0x7efda4017000).stop 2024-04-25T02:10:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 shutdown_connections 2024-04-25T02:10:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efdb412fb30 0x7efdb412c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb4062860 0x7efdb4110df0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 --2- 172.21.15.78:0/2999029580 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efdb41277a0 0x7efdb412bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 >> 172.21.15.78:0/2999029580 conn(0x7efdb4097450 msgr2=0x7efdb4092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 shutdown_connections 2024-04-25T02:10:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.315+0000 7efdbb5cc700 1 -- 172.21.15.78:0/2999029580 wait complete. 2024-04-25T02:10:11.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T02:10:11.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T02:10:11.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T02:10:11.336 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T02:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f8127106700 1 Processor -- start 2024-04-25T02:10:11.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f8127106700 1 -- start start 2024-04-25T02:10:11.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f48f1f7c700 1 Processor -- start 2024-04-25T02:10:11.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f48f1f7c700 1 -- start start 2024-04-25T02:10:11.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f8127106700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120069030 0x7f81200962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f8127106700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f81200967d0 0x7f8120096bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f8127106700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f812012d0b0 0x7f812012f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f8127106700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8120069410 con 0x7f81200967d0 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f8127106700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8120069f80 con 0x7f8120069030 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.452+0000 7f8127106700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81200688a0 con 0x7f812012d0b0 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48f1f7c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec124000 0x7f48ec0961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48f1f7c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f48ec0937a0 0x7f48ec1243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48f1f7c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48ec1274e0 0x7f48ec127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48f1f7c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec096cf0 con 0x7f48ec0937a0 2024-04-25T02:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48f1f7c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec093ba0 con 0x7f48ec1274e0 2024-04-25T02:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48f1f7c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec092d00 con 0x7f48ec124000 2024-04-25T02:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f8124ea2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120069030 0x7f81200962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f8124ea2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120069030 0x7f81200962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35312/0 (socket says 172.21.15.78:35312) 2024-04-25T02:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f8124ea2700 1 -- 172.21.15.78:0/2820286313 learned_addr learned my addr 172.21.15.78:0/2820286313 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec124000 0x7f48ec0961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec124000 0x7f48ec0961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40774/0 (socket says 172.21.15.78:40774) 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48eb7fe700 1 -- 172.21.15.78:0/2566932856 learned_addr learned my addr 172.21.15.78:0/2566932856 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48ebfff700 1 --2- 172.21.15.78:0/2566932856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48ec1274e0 0x7f48ec127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f8124ea2700 1 -- 172.21.15.78:0/2820286313 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f812012d0b0 msgr2=0x7f812012f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f8124ea2700 1 --2- 172.21.15.78:0/2820286313 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f812012d0b0 0x7f812012f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f8124ea2700 1 -- 172.21.15.78:0/2820286313 >> v2:172.21.15.78:3300/0 conn(0x7f81200967d0 msgr2=0x7f8120096bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f8124ea2700 1 --2- 172.21.15.78:0/2820286313 >> v2:172.21.15.78:3300/0 conn(0x7f81200967d0 0x7f8120096bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f8124ea2700 1 -- 172.21.15.78:0/2820286313 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120068b10 con 0x7f8120069030 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48eb7fe700 1 -- 172.21.15.78:0/2566932856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48ec1274e0 msgr2=0x7f48ec127990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48eb7fe700 1 --2- 172.21.15.78:0/2566932856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48ec1274e0 0x7f48ec127990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48eb7fe700 1 -- 172.21.15.78:0/2566932856 >> v2:172.21.15.78:3300/0 conn(0x7f48ec0937a0 msgr2=0x7f48ec1243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48eb7fe700 1 --2- 172.21.15.78:0/2566932856 >> v2:172.21.15.78:3300/0 conn(0x7f48ec0937a0 0x7f48ec1243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48eb7fe700 1 -- 172.21.15.78:0/2566932856 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0933a0 con 0x7f48ec124000 2024-04-25T02:10:11.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f8124ea2700 1 --2- 172.21.15.78:0/2820286313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120069030 0x7f81200962e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8114009860 tx=0x7f81140090f0).ready entity=mon.1 client_cookie=d818fe534175f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48eb7fe700 1 --2- 172.21.15.78:0/2566932856 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec124000 0x7f48ec0961a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f48dc009830 tx=0x7f48dc0090f0).ready entity=mon.2 client_cookie=139b341b96877836 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f811f7fe700 1 -- 172.21.15.78:0/2820286313 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400b600 con 0x7f8120069030 2024-04-25T02:10:11.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.453+0000 7f48ea7fc700 1 -- 172.21.15.78:0/2566932856 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00b580 con 0x7f48ec124000 2024-04-25T02:10:11.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f811f7fe700 1 -- 172.21.15.78:0/2820286313 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811400b760 con 0x7f8120069030 2024-04-25T02:10:11.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f811f7fe700 1 -- 172.21.15.78:0/2820286313 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400bae0 con 0x7f8120069030 2024-04-25T02:10:11.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48ea7fc700 1 -- 172.21.15.78:0/2566932856 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc00b6e0 con 0x7f48ec124000 2024-04-25T02:10:11.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48ea7fc700 1 -- 172.21.15.78:0/2566932856 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00ba60 con 0x7f48ec124000 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f8127106700 1 -- 172.21.15.78:0/2820286313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120069030 msgr2=0x7f81200962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f8127106700 1 --2- 172.21.15.78:0/2820286313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120069030 0x7f81200962e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8114009860 tx=0x7f81140090f0).stop 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f8127106700 1 -- 172.21.15.78:0/2820286313 shutdown_connections 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f8127106700 1 --2- 172.21.15.78:0/2820286313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120069030 0x7f81200962e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f8127106700 1 --2- 172.21.15.78:0/2820286313 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f812012d0b0 0x7f812012f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f8127106700 1 --2- 172.21.15.78:0/2820286313 >> v2:172.21.15.78:3300/0 conn(0x7f81200967d0 0x7f8120096bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f8127106700 1 -- 172.21.15.78:0/2820286313 >> 172.21.15.78:0/2820286313 conn(0x7f812009c550 msgr2=0x7f81200983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48f1f7c700 1 -- 172.21.15.78:0/2566932856 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec124000 msgr2=0x7f48ec0961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48f1f7c700 1 --2- 172.21.15.78:0/2566932856 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec124000 0x7f48ec0961a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f48dc009830 tx=0x7f48dc0090f0).stop 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f8127106700 1 -- 172.21.15.78:0/2820286313 shutdown_connections 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48f1f7c700 1 -- 172.21.15.78:0/2566932856 shutdown_connections 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48f1f7c700 1 --2- 172.21.15.78:0/2566932856 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48ec1274e0 0x7f48ec127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48f1f7c700 1 --2- 172.21.15.78:0/2566932856 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec124000 0x7f48ec0961a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48f1f7c700 1 --2- 172.21.15.78:0/2566932856 >> v2:172.21.15.78:3300/0 conn(0x7f48ec0937a0 0x7f48ec1243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f8127106700 1 -- 172.21.15.78:0/2820286313 wait complete. 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48f1f7c700 1 -- 172.21.15.78:0/2566932856 >> 172.21.15.78:0/2566932856 conn(0x7f48ec097450 msgr2=0x7f48ec097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48f1f7c700 1 -- 172.21.15.78:0/2566932856 shutdown_connections 2024-04-25T02:10:11.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.454+0000 7f48f1f7c700 1 -- 172.21.15.78:0/2566932856 wait complete. 2024-04-25T02:10:11.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.455+0000 7f48f1f7c700 1 Processor -- start 2024-04-25T02:10:11.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.455+0000 7f48f1f7c700 1 -- start start 2024-04-25T02:10:11.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f8127106700 1 Processor -- start 2024-04-25T02:10:11.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f8127106700 1 -- start start 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48f1f7c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec0937a0 0x7f48ec068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48f1f7c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48ec124000 0x7f48ec0692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48f1f7c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48ec1274e0 0x7f48ec0697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48f1f7c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec092440 con 0x7f48ec124000 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48f1f7c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec068b20 con 0x7f48ec1274e0 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48f1f7c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec116d50 con 0x7f48ec0937a0 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec0937a0 0x7f48ec068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec0937a0 0x7f48ec068de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40788/0 (socket says 172.21.15.78:40788) 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48eb7fe700 1 -- 172.21.15.78:0/3004841354 learned_addr learned my addr 172.21.15.78:0/3004841354 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48eaffd700 1 --2- 172.21.15.78:0/3004841354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48ec124000 0x7f48ec0692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f8127106700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f81200967d0 0x7f812013a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f8127106700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f812012d0b0 0x7f812013add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f8127106700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120064200 0x7f8120064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f8127106700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8120065670 con 0x7f812012d0b0 2024-04-25T02:10:11.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f8127106700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812011db40 con 0x7f8120064200 2024-04-25T02:10:11.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f8127106700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f812012d610 con 0x7f81200967d0 2024-04-25T02:10:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.456+0000 7f48ebfff700 1 --2- 172.21.15.78:0/3004841354 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48ec1274e0 0x7f48ec0697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8124ea2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f81200967d0 0x7f812013a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8124ea2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f81200967d0 0x7f812013a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40796/0 (socket says 172.21.15.78:40796) 2024-04-25T02:10:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8124ea2700 1 -- 172.21.15.78:0/272563291 learned_addr learned my addr 172.21.15.78:0/272563291 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48eaffd700 1 -- 172.21.15.78:0/3004841354 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec0937a0 msgr2=0x7f48ec068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48eaffd700 1 --2- 172.21.15.78:0/3004841354 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48ec0937a0 0x7f48ec068de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48eaffd700 1 -- 172.21.15.78:0/3004841354 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48ec1274e0 msgr2=0x7f48ec0697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48eaffd700 1 --2- 172.21.15.78:0/3004841354 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48ec1274e0 0x7f48ec0697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48eaffd700 1 -- 172.21.15.78:0/3004841354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc009370 con 0x7f48ec124000 2024-04-25T02:10:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8124ea2700 1 -- 172.21.15.78:0/272563291 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120064200 msgr2=0x7f8120064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8124ea2700 1 --2- 172.21.15.78:0/272563291 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8120064200 0x7f8120064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8124ea2700 1 -- 172.21.15.78:0/272563291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f812012d0b0 msgr2=0x7f812013add0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:10:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8124ea2700 1 --2- 172.21.15.78:0/272563291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f812012d0b0 0x7f812013add0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8124ea2700 1 -- 172.21.15.78:0/272563291 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114009370 con 0x7f81200967d0 2024-04-25T02:10:11.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48eaffd700 1 --2- 172.21.15.78:0/3004841354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48ec124000 0x7f48ec0692d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f48ec092c30 tx=0x7f48e0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8124ea2700 1 --2- 172.21.15.78:0/272563291 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f81200967d0 0x7f812013a8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8114009fb0 tx=0x7f8114017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48d3fff700 1 -- 172.21.15.78:0/3004841354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e000be00 con 0x7f48ec124000 2024-04-25T02:10:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec117710 con 0x7f48ec124000 2024-04-25T02:10:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48d3fff700 1 -- 172.21.15.78:0/3004841354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0002320 con 0x7f48ec124000 2024-04-25T02:10:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48d3fff700 1 -- 172.21.15.78:0/3004841354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e00026e0 con 0x7f48ec124000 2024-04-25T02:10:11.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec115b80 con 0x7f48ec124000 2024-04-25T02:10:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f811d7fa700 1 -- 172.21.15.78:0/272563291 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114006a40 con 0x7f81200967d0 2024-04-25T02:10:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f811d7fa700 1 -- 172.21.15.78:0/272563291 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811400b8d0 con 0x7f81200967d0 2024-04-25T02:10:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f811d7fa700 1 -- 172.21.15.78:0/272563291 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140246a0 con 0x7f81200967d0 2024-04-25T02:10:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812011c6e0 con 0x7f81200967d0 2024-04-25T02:10:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.457+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812013b2c0 con 0x7f81200967d0 2024-04-25T02:10:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.458+0000 7f48d3fff700 1 -- 172.21.15.78:0/3004841354 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f48e0002a50 con 0x7f48ec124000 2024-04-25T02:10:11.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.458+0000 7f48d3fff700 1 -- 172.21.15.78:0/3004841354 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f48e003afa0 con 0x7f48ec124000 2024-04-25T02:10:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.459+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f812009a830 con 0x7f81200967d0 2024-04-25T02:10:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.459+0000 7f811d7fa700 1 -- 172.21.15.78:0/272563291 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f8114021070 con 0x7f81200967d0 2024-04-25T02:10:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.459+0000 7f811d7fa700 1 -- 172.21.15.78:0/272563291 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f811403d300 con 0x7f81200967d0 2024-04-25T02:10:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.459+0000 7f811d7fa700 1 -- 172.21.15.78:0/272563291 --> v1:172.21.15.78:6808/47116 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8104038510 con 0x7f8104034820 2024-04-25T02:10:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.459+0000 7f811d7fa700 1 -- 172.21.15.78:0/272563291 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f811403d4c0 con 0x7f81200967d0 2024-04-25T02:10:11.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.460+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 --> v1:172.21.15.78:6809/47117 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48ec05a130 con 0x7f48ec139e00 2024-04-25T02:10:11.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.460+0000 7f811d7fa700 1 -- 172.21.15.78:0/272563291 <== osd.2 v1:172.21.15.78:6808/47116 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f8104038510 con 0x7f8104034820 2024-04-25T02:10:11.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.461+0000 7fa785a16700 1 Processor -- start 2024-04-25T02:10:11.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.461+0000 7fa785a16700 1 -- start start 2024-04-25T02:10:11.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7f48d3fff700 1 -- 172.21.15.78:0/3004841354 <== osd.3 v1:172.21.15.78:6809/47117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f48ec05a130 con 0x7f48ec139e00 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa785a16700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa780098e40 0x7fa780099220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa785a16700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa780099710 0x7fa78012f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa785a16700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 0x7fa780131a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa785a16700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa780092ff0 con 0x7fa780099710 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa785a16700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa780092070 con 0x7fa78012f630 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa785a16700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7800978e0 con 0x7fa780098e40 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa77e7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa780099710 0x7fa78012f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa77e7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa780099710 0x7fa78012f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42904/0 (socket says 172.21.15.78:42904) 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa77e7fc700 1 -- 172.21.15.78:0/2965331827 learned_addr learned my addr 172.21.15.78:0/2965331827 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa77f7fe700 1 --2- 172.21.15.78:0/2965331827 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 0x7fa780131a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa77f7fe700 1 -- 172.21.15.78:0/2965331827 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa780098e40 msgr2=0x7fa780099220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.462+0000 7fa77f7fe700 1 --2- 172.21.15.78:0/2965331827 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa780098e40 0x7fa780099220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa77f7fe700 1 -- 172.21.15.78:0/2965331827 >> v2:172.21.15.78:3300/0 conn(0x7fa780099710 msgr2=0x7fa78012f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa77f7fe700 1 --2- 172.21.15.78:0/2965331827 >> v2:172.21.15.78:3300/0 conn(0x7fa780099710 0x7fa78012f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa77f7fe700 1 -- 172.21.15.78:0/2965331827 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa780090e50 con 0x7fa78012f630 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa77e7fc700 1 --2- 172.21.15.78:0/2965331827 >> v2:172.21.15.78:3300/0 conn(0x7fa780099710 0x7fa78012f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa77f7fe700 1 --2- 172.21.15.78:0/2965331827 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 0x7fa780131a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa778009e60 tx=0x7fa778009780).ready entity=mon.1 client_cookie=5e99246bb5e932da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa77dffb700 1 -- 172.21.15.78:0/2965331827 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77800e070 con 0x7fa78012f630 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa77dffb700 1 -- 172.21.15.78:0/2965331827 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77800bb60 con 0x7fa78012f630 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa77dffb700 1 -- 172.21.15.78:0/2965331827 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778012410 con 0x7fa78012f630 2024-04-25T02:10:11.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7ff373b54700 1 Processor -- start 2024-04-25T02:10:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7ff373b54700 1 -- start start 2024-04-25T02:10:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa785a16700 1 -- 172.21.15.78:0/2965331827 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 msgr2=0x7fa780131a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.463+0000 7fa785a16700 1 --2- 172.21.15.78:0/2965331827 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 0x7fa780131a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa778009e60 tx=0x7fa778009780).stop 2024-04-25T02:10:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7fa785a16700 1 -- 172.21.15.78:0/2965331827 shutdown_connections 2024-04-25T02:10:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7fa785a16700 1 --2- 172.21.15.78:0/2965331827 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 0x7fa780131a20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7fa785a16700 1 --2- 172.21.15.78:0/2965331827 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa780098e40 0x7fa780099220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7fa785a16700 1 --2- 172.21.15.78:0/2965331827 >> v2:172.21.15.78:3300/0 conn(0x7fa780099710 0x7fa78012f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7fa785a16700 1 -- 172.21.15.78:0/2965331827 >> 172.21.15.78:0/2965331827 conn(0x7fa7800974d0 msgr2=0x7fa780099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7fa785a16700 1 -- 172.21.15.78:0/2965331827 shutdown_connections 2024-04-25T02:10:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7fa785a16700 1 -- 172.21.15.78:0/2965331827 wait complete. 2024-04-25T02:10:11.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7ff373b54700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff36c05e960 0x7ff36c098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7ff373b54700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff36c12e130 0x7ff36c130520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7ff373b54700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c0682e0 con 0x7ff36c099330 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7ff373b54700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c06ad80 con 0x7ff36c05e960 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7ff373b54700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c05ed40 con 0x7ff36c12e130 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7ff3710ef700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff36c099330 0x7ff36c099730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60014/0 (socket says 172.21.15.78:60014) 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.464+0000 7ff3710ef700 1 -- 172.21.15.78:0/537421865 learned_addr learned my addr 172.21.15.78:0/537421865 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3720f1700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff36c12e130 0x7ff36c130520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865372853 0 0) 0x7ff36c0682e0 con 0x7ff36c099330 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3580033f0 con 0x7ff36c099330 2024-04-25T02:10:11.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7fa785a16700 1 Processor -- start 2024-04-25T02:10:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3718f0700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff36c05e960 0x7ff36c098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 894266817 0 0) 0x7ff3580033f0 con 0x7ff36c099330 2024-04-25T02:10:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff36c12e130 msgr2=0x7ff36c130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff36c12e130 0x7ff36c130520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff36c05e960 msgr2=0x7ff36c098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff36c05e960 0x7ff36c098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c069060 con 0x7ff36c099330 2024-04-25T02:10:11.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2200755921 0 0) 0x7ff35c001470 con 0x7ff36c099330 2024-04-25T02:10:11.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 >> v1:172.21.15.78:6789/0 conn(0x7ff36c099330 legacy=0x7ff36c099730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7fa785a16700 1 -- start start 2024-04-25T02:10:11.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff358003990 0x7ff358003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff358004690 0x7ff358004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff36c12e130 0x7ff358005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c06ad80 con 0x7ff358004690 2024-04-25T02:10:11.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c05ed40 con 0x7ff358003990 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff35800ba10 con 0x7ff36c12e130 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3710ef700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff358004690 0x7ff358004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7ff3720f1700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff36c12e130 0x7ff358005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3718f0700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff358003990 0x7ff358003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3710ef700 1 -- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff36c12e130 msgr2=0x7ff358005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3710ef700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff36c12e130 0x7ff358005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3710ef700 1 -- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff358003990 msgr2=0x7ff358003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3710ef700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff358003990 0x7ff358003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3710ef700 1 -- 172.21.15.78:0/537421865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c069060 con 0x7ff358004690 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3710ef700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff358004690 0x7ff358004b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff36c0658f0 tx=0x7ff35c001e40).ready entity=mon.0 client_cookie=22ee25bef6284d57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c007a60 con 0x7ff358004690 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c00cae0 con 0x7ff358004690 2024-04-25T02:10:11.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7ff3708ee700 1 -- 172.21.15.78:0/537421865 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00ce80 con 0x7ff358004690 2024-04-25T02:10:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7fa785a16700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa780098e40 0x7fa780085ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7fa785a16700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa780099710 0x7fa780082fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7fa785a16700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 0x7fa780083490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7fa785a16700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa780087020 con 0x7fa780098e40 2024-04-25T02:10:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7fa785a16700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa780091ac0 con 0x7fa78012f630 2024-04-25T02:10:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.465+0000 7fa785a16700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7800864c0 con 0x7fa780099710 2024-04-25T02:10:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77e7fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa780099710 0x7fa780082fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77e7fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa780099710 0x7fa780082fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40848/0 (socket says 172.21.15.78:40848) 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77e7fc700 1 -- 172.21.15.78:0/2719324786 learned_addr learned my addr 172.21.15.78:0/2719324786 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77effd700 1 --2- 172.21.15.78:0/2719324786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa780098e40 0x7fa780085ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77f7fe700 1 --2- 172.21.15.78:0/2719324786 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 0x7fa780083490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77effd700 1 -- 172.21.15.78:0/2719324786 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa780099710 msgr2=0x7fa780082fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77effd700 1 --2- 172.21.15.78:0/2719324786 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa780099710 0x7fa780082fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77effd700 1 -- 172.21.15.78:0/2719324786 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 msgr2=0x7fa780083490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77effd700 1 --2- 172.21.15.78:0/2719324786 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa78012f630 0x7fa780083490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77effd700 1 -- 172.21.15.78:0/2719324786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa774009370 con 0x7fa780098e40 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.466+0000 7fa77effd700 1 --2- 172.21.15.78:0/2719324786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa780098e40 0x7fa780085ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa77000b490 tx=0x7fa770006f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.467+0000 7ff373b54700 1 -- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff358004690 msgr2=0x7ff358004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.467+0000 7ff373b54700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff358004690 0x7ff358004b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff36c0658f0 tx=0x7ff35c001e40).stop 2024-04-25T02:10:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.467+0000 7fa7677fe700 1 -- 172.21.15.78:0/2719324786 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770012410 con 0x7fa780098e40 2024-04-25T02:10:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.467+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa778009a20 con 0x7fa780098e40 2024-04-25T02:10:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.467+0000 7fa7677fe700 1 -- 172.21.15.78:0/2719324786 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa770012590 con 0x7fa780098e40 2024-04-25T02:10:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.467+0000 7fa7677fe700 1 -- 172.21.15.78:0/2719324786 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770012950 con 0x7fa780098e40 2024-04-25T02:10:11.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.467+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa780084b50 con 0x7fa780098e40 2024-04-25T02:10:11.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.468+0000 7ff373b54700 1 -- 172.21.15.78:0/537421865 shutdown_connections 2024-04-25T02:10:11.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.468+0000 7ff373b54700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff36c12e130 0x7ff358005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.468+0000 7ff373b54700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff358004690 0x7ff358004b10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.468+0000 7ff373b54700 1 --2- 172.21.15.78:0/537421865 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff358003990 0x7ff358003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.468+0000 7ff373b54700 1 -- 172.21.15.78:0/537421865 >> 172.21.15.78:0/537421865 conn(0x7ff36c0974d0 msgr2=0x7ff36c099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.468+0000 7ff373b54700 1 -- 172.21.15.78:0/537421865 shutdown_connections 2024-04-25T02:10:11.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.468+0000 7ff373b54700 1 -- 172.21.15.78:0/537421865 wait complete. 2024-04-25T02:10:11.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.468+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa78009a660 con 0x7fa780098e40 2024-04-25T02:10:11.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.468+0000 7fa7677fe700 1 -- 172.21.15.78:0/2719324786 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fa77001b3e0 con 0x7fa780098e40 2024-04-25T02:10:11.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.469+0000 7fa7677fe700 1 -- 172.21.15.78:0/2719324786 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa77003b1f0 con 0x7fa780098e40 2024-04-25T02:10:11.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.469+0000 7fa7677fe700 1 -- 172.21.15.78:0/2719324786 --> v1:172.21.15.78:6800/47106 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa76c038600 con 0x7fa76c034910 2024-04-25T02:10:11.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7ff373b54700 1 Processor -- start 2024-04-25T02:10:11.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7fa7677fe700 1 -- 172.21.15.78:0/2719324786 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa77000f8b0 con 0x7fa780098e40 2024-04-25T02:10:11.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7ff373b54700 1 -- start start 2024-04-25T02:10:11.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7fa7677fe700 1 -- 172.21.15.78:0/2719324786 <== osd.1 v1:172.21.15.78:6800/47106 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7fa76c038600 con 0x7fa76c034910 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7ff373b54700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff358003990 0x7ff36c08dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7ff373b54700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff358004690 0x7ff36c12d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7ff373b54700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff36c099330 0x7ff36c12d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7ff373b54700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c08c360 con 0x7ff36c099330 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7ff373b54700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c0684a0 con 0x7ff358004690 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.470+0000 7ff373b54700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c08d230 con 0x7ff358003990 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3718f0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff358003990 0x7ff36c08dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3718f0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff358003990 0x7ff36c08dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40854/0 (socket says 172.21.15.78:40854) 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3718f0700 1 -- 172.21.15.78:0/1894519606 learned_addr learned my addr 172.21.15.78:0/1894519606 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3720f1700 1 --2- 172.21.15.78:0/1894519606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff36c099330 0x7ff36c12d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3718f0700 1 -- 172.21.15.78:0/1894519606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff358004690 msgr2=0x7ff36c12d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3718f0700 1 --2- 172.21.15.78:0/1894519606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff358004690 0x7ff36c12d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3718f0700 1 -- 172.21.15.78:0/1894519606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff36c099330 msgr2=0x7ff36c12d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3718f0700 1 --2- 172.21.15.78:0/1894519606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff36c099330 0x7ff36c12d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3718f0700 1 -- 172.21.15.78:0/1894519606 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c08d7d0 con 0x7ff358003990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3718f0700 1 --2- 172.21.15.78:0/1894519606 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff358003990 0x7ff36c08dcd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff36800f510 tx=0x7ff368008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3627fc700 1 -- 172.21.15.78:0/1894519606 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800fe90 con 0x7ff358003990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3627fc700 1 -- 172.21.15.78:0/1894519606 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff368013610 con 0x7ff358003990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff3627fc700 1 -- 172.21.15.78:0/1894519606 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368013990 con 0x7ff358003990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.471+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c0960b0 con 0x7ff358003990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.472+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c08ba80 con 0x7ff358003990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.472+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff36c05ef70 con 0x7ff358003990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.473+0000 7ff3627fc700 1 -- 172.21.15.78:0/1894519606 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7ff368013d00 con 0x7ff358003990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.474+0000 7ff3627fc700 1 -- 172.21.15.78:0/1894519606 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff36803bb00 con 0x7ff358003990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.474+0000 7ff3627fc700 1 -- 172.21.15.78:0/1894519606 --> v1:172.21.15.78:6804/47107 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff350038680 con 0x7ff350034990 2024-04-25T02:10:11.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.474+0000 7ff3627fc700 1 -- 172.21.15.78:0/1894519606 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff36803be30 con 0x7ff358003990 2024-04-25T02:10:11.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.475+0000 7ff3627fc700 1 -- 172.21.15.78:0/1894519606 <== osd.0 v1:172.21.15.78:6804/47107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7ff350038680 con 0x7ff350034990 2024-04-25T02:10:11.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.479+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 --> v1:172.21.15.78:6809/47117 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f48ec091b30 con 0x7f48ec139e00 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.479+0000 7f48d3fff700 1 -- 172.21.15.78:0/3004841354 <== osd.3 v1:172.21.15.78:6809/47117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7f48ec091b30 con 0x7f48ec139e00 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.479+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 >> v1:172.21.15.78:6809/47117 conn(0x7f48ec139e00 legacy=0x7f48ec13a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.480+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 >> v1:172.21.15.78:6816/46507 conn(0x7f48d802bd00 legacy=0x7f48d802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.480+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48ec124000 msgr2=0x7f48ec0692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.480+0000 7f48f1f7c700 1 --2- 172.21.15.78:0/3004841354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48ec124000 0x7f48ec0692d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f48ec092c30 tx=0x7f48e0009060).stop 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.480+0000 7f48ebfff700 1 -- 172.21.15.78:0/3004841354 reap_dead start 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.480+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 shutdown_connections 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.480+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 >> 172.21.15.78:0/3004841354 conn(0x7f48ec097450 msgr2=0x7f48ec0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.481+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 shutdown_connections 2024-04-25T02:10:11.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.481+0000 7f48f1f7c700 1 -- 172.21.15.78:0/3004841354 wait complete. 2024-04-25T02:10:11.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.485+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 --> v1:172.21.15.78:6800/47106 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa780086ab0 con 0x7fa76c034910 2024-04-25T02:10:11.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa7677fe700 1 -- 172.21.15.78:0/2719324786 <== osd.1 v1:172.21.15.78:6800/47106 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fa780086ab0 con 0x7fa76c034910 2024-04-25T02:10:11.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 >> v1:172.21.15.78:6800/47106 conn(0x7fa76c034910 legacy=0x7fa76c036d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 >> v1:172.21.15.78:6816/46507 conn(0x7fa76c02bd00 legacy=0x7fa76c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa780098e40 msgr2=0x7fa780085ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa785a16700 1 --2- 172.21.15.78:0/2719324786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa780098e40 0x7fa780085ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa77000b490 tx=0x7fa770006f10).stop 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa77f7fe700 1 -- 172.21.15.78:0/2719324786 reap_dead start 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 shutdown_connections 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 >> 172.21.15.78:0/2719324786 conn(0x7fa7800974d0 msgr2=0x7fa780068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 shutdown_connections 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.486+0000 7fa785a16700 1 -- 172.21.15.78:0/2719324786 wait complete. 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.488+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 --> v1:172.21.15.78:6808/47116 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f812009afc0 con 0x7f8104034820 2024-04-25T02:10:11.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.488+0000 7f811d7fa700 1 -- 172.21.15.78:0/272563291 <== osd.2 v1:172.21.15.78:6808/47116 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f812009afc0 con 0x7f8104034820 2024-04-25T02:10:11.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.489+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 >> v1:172.21.15.78:6808/47116 conn(0x7f8104034820 legacy=0x7f8104036ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.489+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 >> v1:172.21.15.78:6816/46507 conn(0x7f810402bd00 legacy=0x7f810402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.489+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f81200967d0 msgr2=0x7f812013a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.489+0000 7f8127106700 1 --2- 172.21.15.78:0/272563291 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f81200967d0 0x7f812013a8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8114009fb0 tx=0x7f8114017000).stop 2024-04-25T02:10:11.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.489+0000 7f81256a3700 1 -- 172.21.15.78:0/272563291 reap_dead start 2024-04-25T02:10:11.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.489+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 shutdown_connections 2024-04-25T02:10:11.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.489+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 >> 172.21.15.78:0/272563291 conn(0x7f8120069030 msgr2=0x7f8120111f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.489+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 shutdown_connections 2024-04-25T02:10:11.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.489+0000 7f8127106700 1 -- 172.21.15.78:0/272563291 wait complete. 2024-04-25T02:10:11.503 INFO:teuthology.orchestra.run.smithi078.stdout:38654705668 2024-04-25T02:10:11.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:10:11.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.497+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 --> v1:172.21.15.78:6804/47107 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff36c12de40 con 0x7ff350034990 2024-04-25T02:10:11.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.497+0000 7ff3627fc700 1 -- 172.21.15.78:0/1894519606 <== osd.0 v1:172.21.15.78:6804/47107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7ff36c12de40 con 0x7ff350034990 2024-04-25T02:10:11.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.497+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 >> v1:172.21.15.78:6804/47107 conn(0x7ff350034990 legacy=0x7ff350036e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.498+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 >> v1:172.21.15.78:6816/46507 conn(0x7ff35002bd00 legacy=0x7ff35002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.498+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff358003990 msgr2=0x7ff36c08dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.498+0000 7ff373b54700 1 --2- 172.21.15.78:0/1894519606 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff358003990 0x7ff36c08dcd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff36800f510 tx=0x7ff368008040).stop 2024-04-25T02:10:11.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.498+0000 7ff3720f1700 1 -- 172.21.15.78:0/1894519606 reap_dead start 2024-04-25T02:10:11.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.498+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 shutdown_connections 2024-04-25T02:10:11.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.498+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 >> 172.21.15.78:0/1894519606 conn(0x7ff36c0974d0 msgr2=0x7ff36c0953b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.498+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 shutdown_connections 2024-04-25T02:10:11.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.498+0000 7ff373b54700 1 -- 172.21.15.78:0/1894519606 wait complete. 2024-04-25T02:10:11.507 INFO:teuthology.orchestra.run.smithi078.stdout:38654705669 2024-04-25T02:10:11.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:10:11.510 INFO:teuthology.orchestra.run.smithi078.stdout:38654705669 2024-04-25T02:10:11.510 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:10:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:38654705668 2024-04-25T02:10:11.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:10:11.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.622+0000 7fd33b4dd700 1 Processor -- start 2024-04-25T02:10:11.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.622+0000 7fd33b4dd700 1 -- start start 2024-04-25T02:10:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd33b4dd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd33405e960 0x7fd334098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd33b4dd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd334099330 0x7fd334099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd33b4dd700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3340682e0 con 0x7fd33412d120 2024-04-25T02:10:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd33b4dd700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33406ad80 con 0x7fd33405e960 2024-04-25T02:10:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd33b4dd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33405ed40 con 0x7fd334099330 2024-04-25T02:10:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd339279700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd33405e960 0x7fd334098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd339a7a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd33412d120 0x7fd33412f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60028/0 (socket says 172.21.15.78:60028) 2024-04-25T02:10:11.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd339a7a700 1 -- 172.21.15.78:0/3105984907 learned_addr learned my addr 172.21.15.78:0/3105984907 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd338a78700 1 --2- 172.21.15.78:0/3105984907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd334099330 0x7fd334099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd339279700 1 -- 172.21.15.78:0/3105984907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd334099330 msgr2=0x7fd334099730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd339279700 1 --2- 172.21.15.78:0/3105984907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd334099330 0x7fd334099730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd339279700 1 -- 172.21.15.78:0/3105984907 >> v1:172.21.15.78:6789/0 conn(0x7fd33412d120 legacy=0x7fd33412f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd32bfff700 1 -- 172.21.15.78:0/3105984907 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43147482 0 0) 0x7fd3340682e0 con 0x7fd33412d120 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd339279700 1 -- 172.21.15.78:0/3105984907 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334069060 con 0x7fd33405e960 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd338a78700 1 --2- 172.21.15.78:0/3105984907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd334099330 0x7fd334099730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd339279700 1 --2- 172.21.15.78:0/3105984907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33405e960 0x7fd334098e40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd330009760 tx=0x7fd330009060).ready entity=mon.0 client_cookie=c155ca94c979e33a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd32bfff700 1 -- 172.21.15.78:0/3105984907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33000f510 con 0x7fd33405e960 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.623+0000 7fd32bfff700 1 -- 172.21.15.78:0/3105984907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33000f670 con 0x7fd33405e960 2024-04-25T02:10:11.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.624+0000 7fd32bfff700 1 -- 172.21.15.78:0/3105984907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33000f9f0 con 0x7fd33405e960 2024-04-25T02:10:11.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.624+0000 7fd33b4dd700 1 -- 172.21.15.78:0/3105984907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33405e960 msgr2=0x7fd334098e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.624+0000 7fd33b4dd700 1 --2- 172.21.15.78:0/3105984907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33405e960 0x7fd334098e40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd330009760 tx=0x7fd330009060).stop 2024-04-25T02:10:11.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.624+0000 7fd33b4dd700 1 -- 172.21.15.78:0/3105984907 shutdown_connections 2024-04-25T02:10:11.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.624+0000 7fd33b4dd700 1 --2- 172.21.15.78:0/3105984907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33405e960 0x7fd334098e40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.624+0000 7fd33b4dd700 1 --2- 172.21.15.78:0/3105984907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd334099330 0x7fd334099730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.624+0000 7fd33b4dd700 1 -- 172.21.15.78:0/3105984907 >> 172.21.15.78:0/3105984907 conn(0x7fd3340974d0 msgr2=0x7fd334099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.625+0000 7fd33b4dd700 1 -- 172.21.15.78:0/3105984907 shutdown_connections 2024-04-25T02:10:11.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.625+0000 7fd33b4dd700 1 -- 172.21.15.78:0/3105984907 wait complete. 2024-04-25T02:10:11.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.626+0000 7fd33b4dd700 1 Processor -- start 2024-04-25T02:10:11.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.626+0000 7fd33b4dd700 1 -- start start 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd33b4dd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd33405e960 0x7fd33412cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd33b4dd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd334099330 0x7fd334123c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd33b4dd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33412d120 0x7fd334124160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd33b4dd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340684a0 con 0x7fd33412d120 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd33b4dd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3341274e0 con 0x7fd33405e960 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd33b4dd700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340986b0 con 0x7fd334099330 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd338a78700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd334099330 0x7fd334123c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd339a7a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33412d120 0x7fd334124160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd338a78700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd334099330 0x7fd334123c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40862/0 (socket says 172.21.15.78:40862) 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd339279700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd33405e960 0x7fd33412cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd338a78700 1 -- 172.21.15.78:0/209182223 learned_addr learned my addr 172.21.15.78:0/209182223 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd339279700 1 -- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd334099330 msgr2=0x7fd334123c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd339279700 1 --2- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd334099330 0x7fd334123c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd339279700 1 -- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33412d120 msgr2=0x7fd334124160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd339279700 1 --2- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33412d120 0x7fd334124160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd339279700 1 -- 172.21.15.78:0/209182223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32400d740 con 0x7fd33405e960 2024-04-25T02:10:11.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd338a78700 1 --2- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd334099330 0x7fd334123c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:11.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd339a7a700 1 --2- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33412d120 0x7fd334124160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:11.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.627+0000 7fd339279700 1 --2- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd33405e960 0x7fd33412cbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd330014000 tx=0x7fd330017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.628+0000 7fd329ffb700 1 -- 172.21.15.78:0/209182223 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33000f7e0 con 0x7fd33405e960 2024-04-25T02:10:11.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.628+0000 7fd329ffb700 1 -- 172.21.15.78:0/209182223 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33000f940 con 0x7fd33405e960 2024-04-25T02:10:11.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.628+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3300092a0 con 0x7fd33405e960 2024-04-25T02:10:11.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.628+0000 7fd329ffb700 1 -- 172.21.15.78:0/209182223 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33001b660 con 0x7fd33405e960 2024-04-25T02:10:11.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.629+0000 7fd329ffb700 1 -- 172.21.15.78:0/209182223 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fd33001b9d0 con 0x7fd33405e960 2024-04-25T02:10:11.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.629+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3341280d0 con 0x7fd33405e960 2024-04-25T02:10:11.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.629+0000 7fd329ffb700 1 -- 172.21.15.78:0/209182223 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd330010560 con 0x7fd33405e960 2024-04-25T02:10:11.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.630+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33409a660 con 0x7fd33405e960 2024-04-25T02:10:11.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.634+0000 7fd329ffb700 1 -- 172.21.15.78:0/209182223 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fd33001f070 con 0x7fd33405e960 2024-04-25T02:10:11.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.643+0000 7f2fa47a8700 1 Processor -- start 2024-04-25T02:10:11.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.644+0000 7f2fa47a8700 1 -- start start 2024-04-25T02:10:11.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.644+0000 7f2fa47a8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f9c095340 0x7f2f9c133f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.644+0000 7f2fa47a8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 0x7f2f9c136800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa47a8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c0964c0 con 0x7f2f9c092700 2024-04-25T02:10:11.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa47a8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c091f00 con 0x7f2f9c095340 2024-04-25T02:10:11.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa47a8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c091c40 con 0x7f2f9c134410 2024-04-25T02:10:11.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa1d43700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f9c095340 0x7f2f9c133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa2544700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2f9c092700 0x7f2f9c095960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60032/0 (socket says 172.21.15.78:60032) 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa2544700 1 -- 172.21.15.78:0/3380868251 learned_addr learned my addr 172.21.15.78:0/3380868251 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa2d45700 1 --2- 172.21.15.78:0/3380868251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 0x7f2f9c136800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa1d43700 1 -- 172.21.15.78:0/3380868251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 msgr2=0x7f2f9c136800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa1d43700 1 --2- 172.21.15.78:0/3380868251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 0x7f2f9c136800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa1d43700 1 -- 172.21.15.78:0/3380868251 >> v1:172.21.15.78:6789/0 conn(0x7f2f9c092700 legacy=0x7f2f9c095960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa1542700 1 -- 172.21.15.78:0/3380868251 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829578039 0 0) 0x7f2f9c0964c0 con 0x7f2f9c092700 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa1d43700 1 -- 172.21.15.78:0/3380868251 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c096910 con 0x7f2f9c095340 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.645+0000 7f2fa1d43700 1 --2- 172.21.15.78:0/3380868251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c095340 0x7f2f9c133f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2f8c009760 tx=0x7f2f8c009060).ready entity=mon.0 client_cookie=f963a785958b8f09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.646+0000 7f2fa1542700 1 -- 172.21.15.78:0/3380868251 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0090d0 con 0x7f2f9c095340 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.646+0000 7f2fa1542700 1 -- 172.21.15.78:0/3380868251 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c00b580 con 0x7f2f9c095340 2024-04-25T02:10:11.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.646+0000 7f2fa1542700 1 -- 172.21.15.78:0/3380868251 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00b900 con 0x7f2f9c095340 2024-04-25T02:10:11.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.646+0000 7f2fa47a8700 1 -- 172.21.15.78:0/3380868251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c095340 msgr2=0x7f2f9c133f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.646+0000 7f2fa47a8700 1 --2- 172.21.15.78:0/3380868251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c095340 0x7f2f9c133f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2f8c009760 tx=0x7f2f8c009060).stop 2024-04-25T02:10:11.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.647+0000 7f2fa47a8700 1 -- 172.21.15.78:0/3380868251 shutdown_connections 2024-04-25T02:10:11.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.647+0000 7f2fa47a8700 1 --2- 172.21.15.78:0/3380868251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 0x7f2f9c136800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.647+0000 7f2fa47a8700 1 --2- 172.21.15.78:0/3380868251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c095340 0x7f2f9c133f20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.647+0000 7f2fa47a8700 1 -- 172.21.15.78:0/3380868251 >> 172.21.15.78:0/3380868251 conn(0x7f2f9c097450 msgr2=0x7f2f9c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.647+0000 7f2fa47a8700 1 -- 172.21.15.78:0/3380868251 shutdown_connections 2024-04-25T02:10:11.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.647+0000 7f2fa47a8700 1 -- 172.21.15.78:0/3380868251 wait complete. 2024-04-25T02:10:11.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.648+0000 7f2fa47a8700 1 Processor -- start 2024-04-25T02:10:11.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.648+0000 7f2fa47a8700 1 -- start start 2024-04-25T02:10:11.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa47a8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c092700 0x7f2f9c112e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa47a8700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2f9c095340 0x7f2f9c1322c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa47a8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 0x7f2f9c1327b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa47a8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c115370 con 0x7f2f9c092700 2024-04-25T02:10:11.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa47a8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c132040 con 0x7f2f9c134410 2024-04-25T02:10:11.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa47a8700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c1378c0 con 0x7f2f9c095340 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2d45700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 0x7f2f9c1327b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2d45700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 0x7f2f9c1327b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35434/0 (socket says 172.21.15.78:35434) 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2d45700 1 -- 172.21.15.78:0/2208793456 learned_addr learned my addr 172.21.15.78:0/2208793456 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2544700 1 --2- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c092700 0x7f2f9c112e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa1d43700 1 --2- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2f9c095340 0x7f2f9c1322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2544700 1 -- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2f9c095340 msgr2=0x7f2f9c1322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2544700 1 --2- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2f9c095340 0x7f2f9c1322c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2544700 1 -- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 msgr2=0x7f2f9c1327b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2544700 1 --2- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 0x7f2f9c1327b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2544700 1 -- 172.21.15.78:0/2208793456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0092a0 con 0x7f2f9c092700 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.649+0000 7f2fa2544700 1 --2- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c092700 0x7f2f9c112e30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2f98000c00 tx=0x7f2f98007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.650+0000 7f2f92ffd700 1 -- 172.21.15.78:0/2208793456 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980070d0 con 0x7f2f9c092700 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.650+0000 7f2f92ffd700 1 -- 172.21.15.78:0/2208793456 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98007250 con 0x7f2f9c092700 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.650+0000 7f2f92ffd700 1 -- 172.21.15.78:0/2208793456 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98007610 con 0x7f2f9c092700 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.650+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c096b40 con 0x7f2f9c092700 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.650+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c113a00 con 0x7f2f9c092700 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.651+0000 7f2f92ffd700 1 -- 172.21.15.78:0/2208793456 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f2f980059b0 con 0x7f2f9c092700 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.651+0000 7f2f92ffd700 1 -- 172.21.15.78:0/2208793456 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2f9803a7c0 con 0x7f2f9c092700 2024-04-25T02:10:11.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.651+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c115870 con 0x7f2f9c092700 2024-04-25T02:10:11.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.660+0000 7f2f92ffd700 1 -- 172.21.15.78:0/2208793456 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f2f98013970 con 0x7f2f9c092700 2024-04-25T02:10:11.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.677+0000 7f7388bc9700 1 Processor -- start 2024-04-25T02:10:11.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.677+0000 7f7388bc9700 1 -- start start 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7388bc9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7384124000 0x7f73840961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7388bc9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73840937a0 0x7f73841243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7388bc9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7384096cf0 con 0x7f73841274e0 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7388bc9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7384093ba0 con 0x7f73840937a0 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7388bc9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7384092d00 con 0x7f7384124000 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7381d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73840937a0 0x7f73841243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7381d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73840937a0 0x7f73841243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42974/0 (socket says 172.21.15.78:42974) 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7381d9b700 1 -- 172.21.15.78:0/4126249193 learned_addr learned my addr 172.21.15.78:0/4126249193 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7382d9d700 1 --1- 172.21.15.78:0/4126249193 >> v1:172.21.15.78:6789/0 conn(0x7f73841274e0 0x7f7384127950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60040/0 (socket says 172.21.15.78:60040) 2024-04-25T02:10:11.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f738259c700 1 --2- 172.21.15.78:0/4126249193 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7384124000 0x7f73840961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7381d9b700 1 -- 172.21.15.78:0/4126249193 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7384124000 msgr2=0x7f73840961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7381d9b700 1 --2- 172.21.15.78:0/4126249193 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7384124000 0x7f73840961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7381d9b700 1 -- 172.21.15.78:0/4126249193 >> v1:172.21.15.78:6789/0 conn(0x7f73841274e0 legacy=0x7f7384127950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f738159a700 1 -- 172.21.15.78:0/4126249193 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517044797 0 0) 0x7f7384096cf0 con 0x7f73841274e0 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7381d9b700 1 -- 172.21.15.78:0/4126249193 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73840933a0 con 0x7f73840937a0 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.678+0000 7f7381d9b700 1 --2- 172.21.15.78:0/4126249193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73840937a0 0x7f73841243e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7378006fd0 tx=0x7f737800b3b0).ready entity=mon.0 client_cookie=59aa48578e3f125d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f738159a700 1 -- 172.21.15.78:0/4126249193 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737800da70 con 0x7f73840937a0 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f738159a700 1 -- 172.21.15.78:0/4126249193 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737800dbd0 con 0x7f73840937a0 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f738159a700 1 -- 172.21.15.78:0/4126249193 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378010470 con 0x7f73840937a0 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f7388bc9700 1 -- 172.21.15.78:0/4126249193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73840937a0 msgr2=0x7f73841243e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f7388bc9700 1 --2- 172.21.15.78:0/4126249193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73840937a0 0x7f73841243e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7378006fd0 tx=0x7f737800b3b0).stop 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f7388bc9700 1 -- 172.21.15.78:0/4126249193 shutdown_connections 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f7388bc9700 1 --2- 172.21.15.78:0/4126249193 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7384124000 0x7f73840961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f7388bc9700 1 --2- 172.21.15.78:0/4126249193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73840937a0 0x7f73841243e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f7388bc9700 1 -- 172.21.15.78:0/4126249193 >> 172.21.15.78:0/4126249193 conn(0x7f7384097450 msgr2=0x7f7384097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f7388bc9700 1 -- 172.21.15.78:0/4126249193 shutdown_connections 2024-04-25T02:10:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.679+0000 7f7388bc9700 1 -- 172.21.15.78:0/4126249193 wait complete. 2024-04-25T02:10:11.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.681+0000 7f7388bc9700 1 Processor -- start 2024-04-25T02:10:11.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.681+0000 7f7388bc9700 1 -- start start 2024-04-25T02:10:11.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7388bc9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73840937a0 0x7f7384068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7388bc9700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7384124000 0x7f7384069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7388bc9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73841274e0 0x7f7384069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7388bc9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7384115f30 con 0x7f73841274e0 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7388bc9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73841155f0 con 0x7f73840937a0 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7388bc9700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73841169b0 con 0x7f7384124000 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7382d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73841274e0 0x7f7384069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7382d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73841274e0 0x7f7384069610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42986/0 (socket says 172.21.15.78:42986) 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7382d9d700 1 -- 172.21.15.78:0/3483438166 learned_addr learned my addr 172.21.15.78:0/3483438166 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7381d9b700 1 --2- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7384124000 0x7f7384069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f738259c700 1 --2- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73840937a0 0x7f7384068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7382d9d700 1 -- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7384124000 msgr2=0x7f7384069120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7382d9d700 1 --2- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7384124000 0x7f7384069120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7382d9d700 1 -- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73840937a0 msgr2=0x7f7384068c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7382d9d700 1 --2- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73840937a0 0x7f7384068c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7382d9d700 1 -- 172.21.15.78:0/3483438166 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737800b610 con 0x7f73841274e0 2024-04-25T02:10:11.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7382d9d700 1 --2- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73841274e0 0x7f7384069610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f737c00c7e0 tx=0x7f737c007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.682+0000 7f7372ffd700 1 -- 172.21.15.78:0/3483438166 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c005c70 con 0x7f73841274e0 2024-04-25T02:10:11.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.683+0000 7f7372ffd700 1 -- 172.21.15.78:0/3483438166 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c005dd0 con 0x7f73841274e0 2024-04-25T02:10:11.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.683+0000 7f7372ffd700 1 -- 172.21.15.78:0/3483438166 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c007340 con 0x7f73841274e0 2024-04-25T02:10:11.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.683+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7384116c70 con 0x7f73841274e0 2024-04-25T02:10:11.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.683+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7384117630 con 0x7f73841274e0 2024-04-25T02:10:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.684+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7384097f70 con 0x7f73841274e0 2024-04-25T02:10:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.684+0000 7f7372ffd700 1 -- 172.21.15.78:0/3483438166 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f737c0076f0 con 0x7f73841274e0 2024-04-25T02:10:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.684+0000 7f7372ffd700 1 -- 172.21.15.78:0/3483438166 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f737c03b310 con 0x7f73841274e0 2024-04-25T02:10:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.686+0000 7f1790eb6700 1 Processor -- start 2024-04-25T02:10:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.686+0000 7f1790eb6700 1 -- start start 2024-04-25T02:10:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f1790eb6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 0x7f178c12ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f1790eb6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f178c12f440 0x7f178c12f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f1790eb6700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c0989e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f1790eb6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c064eb0 con 0x7f178c12f440 2024-04-25T02:10:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f1790eb6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c12ed20 con 0x7f178c064ad0 2024-04-25T02:10:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f1790eb6700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f178c065c10 con 0x7f178c098530 2024-04-25T02:10:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f178ad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c0989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f178ad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c0989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40880/0 (socket says 172.21.15.78:40880) 2024-04-25T02:10:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f178ad9d700 1 -- 172.21.15.78:0/529649308 learned_addr learned my addr 172.21.15.78:0/529649308 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f178a59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 0x7f178c12ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f1789d9b700 1 --2- 172.21.15.78:0/529649308 >> v2:172.21.15.78:3300/0 conn(0x7f178c12f440 0x7f178c12f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f178ad9d700 1 -- 172.21.15.78:0/529649308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 msgr2=0x7f178c12ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f178ad9d700 1 --2- 172.21.15.78:0/529649308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 0x7f178c12ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f178ad9d700 1 -- 172.21.15.78:0/529649308 >> v2:172.21.15.78:3300/0 conn(0x7f178c12f440 msgr2=0x7f178c12f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f178ad9d700 1 --2- 172.21.15.78:0/529649308 >> v2:172.21.15.78:3300/0 conn(0x7f178c12f440 0x7f178c12f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.687+0000 7f178ad9d700 1 -- 172.21.15.78:0/529649308 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c0663a0 con 0x7f178c098530 2024-04-25T02:10:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.688+0000 7f178ad9d700 1 --2- 172.21.15.78:0/529649308 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c0989e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1784009f50 tx=0x7f1784009840).ready entity=mon.2 client_cookie=f9aee26e2a6fd1b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.688+0000 7f178959a700 1 -- 172.21.15.78:0/529649308 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400e070 con 0x7f178c098530 2024-04-25T02:10:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.688+0000 7f178959a700 1 -- 172.21.15.78:0/529649308 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178400b910 con 0x7f178c098530 2024-04-25T02:10:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.688+0000 7f178959a700 1 -- 172.21.15.78:0/529649308 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400bc90 con 0x7f178c098530 2024-04-25T02:10:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.689+0000 7f1790eb6700 1 -- 172.21.15.78:0/529649308 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 msgr2=0x7f178c0989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.689+0000 7f1790eb6700 1 --2- 172.21.15.78:0/529649308 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c0989e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1784009f50 tx=0x7f1784009840).stop 2024-04-25T02:10:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.689+0000 7f1790eb6700 1 -- 172.21.15.78:0/529649308 shutdown_connections 2024-04-25T02:10:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.689+0000 7f1790eb6700 1 --2- 172.21.15.78:0/529649308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 0x7f178c12ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.689+0000 7f1790eb6700 1 --2- 172.21.15.78:0/529649308 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c0989e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.689+0000 7f1790eb6700 1 --2- 172.21.15.78:0/529649308 >> v2:172.21.15.78:3300/0 conn(0x7f178c12f440 0x7f178c12f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.689+0000 7f1790eb6700 1 -- 172.21.15.78:0/529649308 >> 172.21.15.78:0/529649308 conn(0x7f178c09a630 msgr2=0x7f178c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.689+0000 7f1790eb6700 1 -- 172.21.15.78:0/529649308 shutdown_connections 2024-04-25T02:10:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.689+0000 7f1790eb6700 1 -- 172.21.15.78:0/529649308 wait complete. 2024-04-25T02:10:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.690+0000 7f7372ffd700 1 -- 172.21.15.78:0/3483438166 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f737c013e40 con 0x7f73841274e0 2024-04-25T02:10:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.690+0000 7f1790eb6700 1 Processor -- start 2024-04-25T02:10:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.690+0000 7f1790eb6700 1 -- start start 2024-04-25T02:10:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f1790eb6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 0x7f178c121260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f1790eb6700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c11d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f1790eb6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c12f440 0x7f178c11d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f1790eb6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c12e390 con 0x7f178c12f440 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f1790eb6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c09d4d0 con 0x7f178c064ad0 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f1790eb6700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f178c099d40 con 0x7f178c098530 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f1789d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c11d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f1789d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c11d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40892/0 (socket says 172.21.15.78:40892) 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f1789d9b700 1 -- 172.21.15.78:0/1048153395 learned_addr learned my addr 172.21.15.78:0/1048153395 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f178ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c12f440 0x7f178c11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.691+0000 7f178a59c700 1 --2- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 0x7f178c121260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.692+0000 7f178a59c700 1 -- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 msgr2=0x7f178c11d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.692+0000 7f178a59c700 1 --2- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c11d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.692+0000 7f178a59c700 1 -- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c12f440 msgr2=0x7f178c11d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.692+0000 7f178a59c700 1 --2- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c12f440 0x7f178c11d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.692+0000 7f178a59c700 1 -- 172.21.15.78:0/1048153395 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784009ae0 con 0x7f178c064ad0 2024-04-25T02:10:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.692+0000 7f178a59c700 1 --2- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 0x7f178c121260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f177c00e930 tx=0x7f177c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.693+0000 7f177affd700 1 -- 172.21.15.78:0/1048153395 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c012600 con 0x7f178c064ad0 2024-04-25T02:10:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.693+0000 7f177affd700 1 -- 172.21.15.78:0/1048153395 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c012760 con 0x7f178c064ad0 2024-04-25T02:10:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.693+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c120d60 con 0x7f178c064ad0 2024-04-25T02:10:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.693+0000 7f177affd700 1 -- 172.21.15.78:0/1048153395 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c012ae0 con 0x7f178c064ad0 2024-04-25T02:10:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.693+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c11f010 con 0x7f178c064ad0 2024-04-25T02:10:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.694+0000 7f177affd700 1 -- 172.21.15.78:0/1048153395 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f177c01b400 con 0x7f178c064ad0 2024-04-25T02:10:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.694+0000 7f177affd700 1 -- 172.21.15.78:0/1048153395 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f177c03b720 con 0x7f178c064ad0 2024-04-25T02:10:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.694+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c09cb40 con 0x7f178c064ad0 2024-04-25T02:10:11.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.703+0000 7f177affd700 1 -- 172.21.15.78:0/1048153395 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f177c019900 con 0x7f178c064ad0 2024-04-25T02:10:11.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.810+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd334067050 con 0x7fd33405e960 2024-04-25T02:10:11.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.810+0000 7fd329ffb700 1 -- 172.21.15.78:0/209182223 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd33001f020 con 0x7fd33405e960 2024-04-25T02:10:11.818 INFO:teuthology.orchestra.run.smithi078.stdout:38654705667 2024-04-25T02:10:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.812+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 >> v1:172.21.15.78:6816/46507 conn(0x7fd31802bd30 legacy=0x7fd31802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.812+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd33405e960 msgr2=0x7fd33412cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.812+0000 7fd33b4dd700 1 --2- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd33405e960 0x7fd33412cbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd330014000 tx=0x7fd330017000).stop 2024-04-25T02:10:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.813+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 shutdown_connections 2024-04-25T02:10:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.813+0000 7fd33b4dd700 1 --2- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd33412d120 0x7fd334124160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.813+0000 7fd33b4dd700 1 --2- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd33405e960 0x7fd33412cbe0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.813+0000 7fd33b4dd700 1 --2- 172.21.15.78:0/209182223 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd334099330 0x7fd334123c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.813+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 >> 172.21.15.78:0/209182223 conn(0x7fd3340974d0 msgr2=0x7fd334093c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.813+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 shutdown_connections 2024-04-25T02:10:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.813+0000 7fd33b4dd700 1 -- 172.21.15.78:0/209182223 wait complete. 2024-04-25T02:10:11.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2024-04-25T02:10:11.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.838+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f9c097f70 con 0x7f2f9c092700 2024-04-25T02:10:11.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.838+0000 7f2f92ffd700 1 -- 172.21.15.78:0/2208793456 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f98012e40 con 0x7f2f9c092700 2024-04-25T02:10:11.846 INFO:teuthology.orchestra.run.smithi078.stdout:38654705668 2024-04-25T02:10:11.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 >> v1:172.21.15.78:6816/46507 conn(0x7f2f8002bd00 legacy=0x7f2f8002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c092700 msgr2=0x7f2f9c112e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 --2- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c092700 0x7f2f9c112e30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2f98000c00 tx=0x7f2f98007b90).stop 2024-04-25T02:10:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 shutdown_connections 2024-04-25T02:10:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 --2- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f9c134410 0x7f2f9c1327b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 --2- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c092700 0x7f2f9c112e30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 --2- 172.21.15.78:0/2208793456 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2f9c095340 0x7f2f9c1322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 >> 172.21.15.78:0/2208793456 conn(0x7f2f9c097450 msgr2=0x7f2f9c099500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 shutdown_connections 2024-04-25T02:10:11.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.840+0000 7f2fa47a8700 1 -- 172.21.15.78:0/2208793456 wait complete. 2024-04-25T02:10:11.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-04-25T02:10:11.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.861+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7384091b30 con 0x7f73841274e0 2024-04-25T02:10:11.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.861+0000 7f7372ffd700 1 -- 172.21.15.78:0/3483438166 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f737c01a300 con 0x7f73841274e0 2024-04-25T02:10:11.869 INFO:teuthology.orchestra.run.smithi078.stdout:38654705668 2024-04-25T02:10:11.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 >> v1:172.21.15.78:6816/46507 conn(0x7f736402bd30 legacy=0x7f736402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73841274e0 msgr2=0x7f7384069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 --2- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73841274e0 0x7f7384069610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f737c00c7e0 tx=0x7f737c007f60).stop 2024-04-25T02:10:11.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 shutdown_connections 2024-04-25T02:10:11.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 --2- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73841274e0 0x7f7384069610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 --2- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73840937a0 0x7f7384068c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 --2- 172.21.15.78:0/3483438166 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7384124000 0x7f7384069120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 >> 172.21.15.78:0/3483438166 conn(0x7f7384097450 msgr2=0x7f73840627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 shutdown_connections 2024-04-25T02:10:11.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.863+0000 7f7388bc9700 1 -- 172.21.15.78:0/3483438166 wait complete. 2024-04-25T02:10:11.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.870+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f178c09b120 con 0x7f178c064ad0 2024-04-25T02:10:11.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.871+0000 7f177affd700 1 -- 172.21.15.78:0/1048153395 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f177c023350 con 0x7f178c064ad0 2024-04-25T02:10:11.879 INFO:teuthology.orchestra.run.smithi078.stdout:38654705667 2024-04-25T02:10:11.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.873+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 >> v1:172.21.15.78:6816/46507 conn(0x7f176c02bd00 legacy=0x7f176c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.873+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 msgr2=0x7f178c121260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:11.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.873+0000 7f1790eb6700 1 --2- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 0x7f178c121260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f177c00e930 tx=0x7f177c009060).stop 2024-04-25T02:10:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.873+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 shutdown_connections 2024-04-25T02:10:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.873+0000 7f1790eb6700 1 --2- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c12f440 0x7f178c11d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.873+0000 7f1790eb6700 1 --2- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f178c064ad0 0x7f178c121260 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.873+0000 7f1790eb6700 1 --2- 172.21.15.78:0/1048153395 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f178c098530 0x7f178c11d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.873+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 >> 172.21.15.78:0/1048153395 conn(0x7f178c09a630 msgr2=0x7f178c069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.874+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 shutdown_connections 2024-04-25T02:10:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:11.874+0000 7f1790eb6700 1 -- 172.21.15.78:0/1048153395 wait complete. 2024-04-25T02:10:11.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-04-25T02:10:11.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-04-25T02:10:12.833 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:10:12.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:10:12.883 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:10:12.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:10:12.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.961+0000 7f1a48460700 1 Processor -- start 2024-04-25T02:10:12.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.961+0000 7f1a48460700 1 -- start start 2024-04-25T02:10:12.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a48460700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a40064ad0 0x7f1a4012abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:12.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a48460700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a4012a750 0x7f1a4012b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:12.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a48460700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1a40098530 0x7f1a400989e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a48460700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a40064eb0 con 0x7f1a40098530 2024-04-25T02:10:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a48460700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40099930 con 0x7f1a4012a750 2024-04-25T02:10:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a48460700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40065750 con 0x7f1a40064ad0 2024-04-25T02:10:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a461fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a40064ad0 0x7f1a4012abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a469fd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1a40098530 0x7f1a400989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a461fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a40064ad0 0x7f1a4012abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:40900/0 (socket says 172.21.15.78:40900) 2024-04-25T02:10:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a461fc700 1 -- 172.21.15.78:0/1901237335 learned_addr learned my addr 172.21.15.78:0/1901237335 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:12.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a459fb700 1 --2- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a4012a750 0x7f1a4012b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a469fd700 1 -- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a40064ad0 msgr2=0x7f1a4012abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a469fd700 1 --2- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a40064ad0 0x7f1a4012abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:12.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a469fd700 1 -- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a4012a750 msgr2=0x7f1a4012b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a469fd700 1 --2- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a4012a750 0x7f1a4012b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a469fd700 1 -- 172.21.15.78:0/1901237335 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a40065b40 con 0x7f1a40098530 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a459fb700 1 --2- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a4012a750 0x7f1a4012b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.962+0000 7f1a469fd700 1 --2- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 0x7f1a400989e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1a38009e60 tx=0x7f1a38009780).ready entity=mon.0 client_cookie=479befeafed9eafb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a451fa700 1 -- 172.21.15.78:0/1901237335 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800e070 con 0x7f1a40098530 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a451fa700 1 -- 172.21.15.78:0/1901237335 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800ba50 con 0x7f1a40098530 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a451fa700 1 -- 172.21.15.78:0/1901237335 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800bdd0 con 0x7f1a40098530 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a48460700 1 -- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 msgr2=0x7f1a400989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a48460700 1 --2- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 0x7f1a400989e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1a38009e60 tx=0x7f1a38009780).stop 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a48460700 1 -- 172.21.15.78:0/1901237335 shutdown_connections 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a48460700 1 --2- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 0x7f1a400989e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a48460700 1 --2- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a40064ad0 0x7f1a4012abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a48460700 1 --2- 172.21.15.78:0/1901237335 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a4012a750 0x7f1a4012b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a48460700 1 -- 172.21.15.78:0/1901237335 >> 172.21.15.78:0/1901237335 conn(0x7f1a4009a630 msgr2=0x7f1a4009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a48460700 1 -- 172.21.15.78:0/1901237335 shutdown_connections 2024-04-25T02:10:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.963+0000 7f1a48460700 1 -- 172.21.15.78:0/1901237335 wait complete. 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.964+0000 7f1a48460700 1 Processor -- start 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.964+0000 7f1a48460700 1 -- start start 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a48460700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a40064ad0 0x7f1a40139ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a48460700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 0x7f1a4013a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a48460700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a4013a8a0 0x7f1a40114410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a48460700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40116aa0 con 0x7f1a40098530 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a48460700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4009d3b0 con 0x7f1a40064ad0 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a48460700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40116760 con 0x7f1a4013a8a0 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a459fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 0x7f1a4013a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a469fd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a4013a8a0 0x7f1a40114410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a459fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 0x7f1a4013a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43032/0 (socket says 172.21.15.78:43032) 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a459fb700 1 -- 172.21.15.78:0/1654083777 learned_addr learned my addr 172.21.15.78:0/1654083777 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a461fc700 1 --2- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a40064ad0 0x7f1a40139ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a459fb700 1 -- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a4013a8a0 msgr2=0x7f1a40114410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a459fb700 1 --2- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a4013a8a0 0x7f1a40114410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a459fb700 1 -- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a40064ad0 msgr2=0x7f1a40139ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a459fb700 1 --2- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a40064ad0 0x7f1a40139ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.965+0000 7f1a459fb700 1 -- 172.21.15.78:0/1654083777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a300092a0 con 0x7f1a40098530 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.966+0000 7f1a459fb700 1 --2- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 0x7f1a4013a3b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1a3000e9a0 tx=0x7f1a30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.966+0000 7f1a36ffd700 1 -- 172.21.15.78:0/1654083777 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000ee90 con 0x7f1a40098530 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.966+0000 7f1a36ffd700 1 -- 172.21.15.78:0/1654083777 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3000c850 con 0x7f1a40098530 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.966+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a38009a20 con 0x7f1a40098530 2024-04-25T02:10:12.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.966+0000 7f1a36ffd700 1 -- 172.21.15.78:0/1654083777 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000cbd0 con 0x7f1a40098530 2024-04-25T02:10:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.967+0000 7f1a36ffd700 1 -- 172.21.15.78:0/1654083777 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f1a300123f0 con 0x7f1a40098530 2024-04-25T02:10:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.967+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a401158c0 con 0x7f1a40098530 2024-04-25T02:10:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.967+0000 7f1a36ffd700 1 -- 172.21.15.78:0/1654083777 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1a300126a0 con 0x7f1a40098530 2024-04-25T02:10:12.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.968+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4009cbb0 con 0x7f1a40098530 2024-04-25T02:10:12.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:12.973+0000 7f1a36ffd700 1 -- 172.21.15.78:0/1654083777 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f1a30040060 con 0x7f1a40098530 2024-04-25T02:10:13.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.009+0000 7f9d8cd0e700 1 Processor -- start 2024-04-25T02:10:13.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.009+0000 7f9d8cd0e700 1 -- start start 2024-04-25T02:10:13.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8cd0e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d88062860 0x7f9d881271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8cd0e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d881277a0 0x7f9d88127ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8cd0e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88095190 0x7f9d88095640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8cd0e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d88062c40 con 0x7f9d881277a0 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8cd0e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88096490 con 0x7f9d88062860 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8cd0e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88091e50 con 0x7f9d88095190 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d88062860 0x7f9d881271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d88062860 0x7f9d881271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:35498/0 (socket says 172.21.15.78:35498) 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8659c700 1 -- 172.21.15.78:0/573587490 learned_addr learned my addr 172.21.15.78:0/573587490 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d86d9d700 1 --2- 172.21.15.78:0/573587490 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88095190 0x7f9d88095640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d85d9b700 1 --2- 172.21.15.78:0/573587490 >> v2:172.21.15.78:3300/0 conn(0x7f9d881277a0 0x7f9d88127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8659c700 1 -- 172.21.15.78:0/573587490 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88095190 msgr2=0x7f9d88095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8659c700 1 --2- 172.21.15.78:0/573587490 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88095190 0x7f9d88095640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8659c700 1 -- 172.21.15.78:0/573587490 >> v2:172.21.15.78:3300/0 conn(0x7f9d881277a0 msgr2=0x7f9d88127ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8659c700 1 --2- 172.21.15.78:0/573587490 >> v2:172.21.15.78:3300/0 conn(0x7f9d881277a0 0x7f9d88127ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8659c700 1 -- 172.21.15.78:0/573587490 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88091b90 con 0x7f9d88062860 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.010+0000 7f9d8659c700 1 --2- 172.21.15.78:0/573587490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d88062860 0x7f9d881271f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9d78009830 tx=0x7f9d780090f0).ready entity=mon.1 client_cookie=a5d67a3230899fc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8559a700 1 -- 172.21.15.78:0/573587490 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800f510 con 0x7f9d88062860 2024-04-25T02:10:13.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8559a700 1 -- 172.21.15.78:0/573587490 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800f670 con 0x7f9d88062860 2024-04-25T02:10:13.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8559a700 1 -- 172.21.15.78:0/573587490 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800f9f0 con 0x7f9d88062860 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/573587490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d88062860 msgr2=0x7f9d881271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8cd0e700 1 --2- 172.21.15.78:0/573587490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d88062860 0x7f9d881271f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9d78009830 tx=0x7f9d780090f0).stop 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/573587490 shutdown_connections 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8cd0e700 1 --2- 172.21.15.78:0/573587490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d88062860 0x7f9d881271f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8cd0e700 1 --2- 172.21.15.78:0/573587490 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88095190 0x7f9d88095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8cd0e700 1 --2- 172.21.15.78:0/573587490 >> v2:172.21.15.78:3300/0 conn(0x7f9d881277a0 0x7f9d88127ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/573587490 >> 172.21.15.78:0/573587490 conn(0x7f9d88097450 msgr2=0x7f9d88097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/573587490 shutdown_connections 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.011+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/573587490 wait complete. 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.013+0000 7f9d8cd0e700 1 Processor -- start 2024-04-25T02:10:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.013+0000 7f9d8cd0e700 1 -- start start 2024-04-25T02:10:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d8cd0e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88062860 0x7f9d88113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d8cd0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88095190 0x7f9d88113c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d8cd0e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d881277a0 0x7f9d88114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d8cd0e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88096d20 con 0x7f9d88095190 2024-04-25T02:10:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d8cd0e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881248d0 con 0x7f9d881277a0 2024-04-25T02:10:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d8cd0e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881172a0 con 0x7f9d88062860 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d85d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88095190 0x7f9d88113c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d8659c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88062860 0x7f9d88113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d85d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88095190 0x7f9d88113c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43044/0 (socket says 172.21.15.78:43044) 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d85d9b700 1 -- 172.21.15.78:0/3505632154 learned_addr learned my addr 172.21.15.78:0/3505632154 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d86d9d700 1 --2- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d881277a0 0x7f9d88114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d85d9b700 1 -- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88062860 msgr2=0x7f9d88113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d85d9b700 1 --2- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88062860 0x7f9d88113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d85d9b700 1 -- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d881277a0 msgr2=0x7f9d88114150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d85d9b700 1 --2- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d881277a0 0x7f9d88114150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.014+0000 7f9d85d9b700 1 -- 172.21.15.78:0/3505632154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78009370 con 0x7f9d88095190 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.015+0000 7f9d85d9b700 1 --2- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88095190 0x7f9d88113c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9d7c00e900 tx=0x7f9d7c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.015+0000 7f9d76ffd700 1 -- 172.21.15.78:0/3505632154 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c012600 con 0x7f9d88095190 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.015+0000 7f9d76ffd700 1 -- 172.21.15.78:0/3505632154 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c012760 con 0x7f9d88095190 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.015+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d88116d00 con 0x7f9d88095190 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.015+0000 7f9d76ffd700 1 -- 172.21.15.78:0/3505632154 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c012ae0 con 0x7f9d88095190 2024-04-25T02:10:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.015+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d88117b40 con 0x7f9d88095190 2024-04-25T02:10:13.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.016+0000 7f9d76ffd700 1 -- 172.21.15.78:0/3505632154 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9d7c01b400 con 0x7f9d88095190 2024-04-25T02:10:13.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.016+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d88097f70 con 0x7f9d88095190 2024-04-25T02:10:13.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.016+0000 7f9d76ffd700 1 -- 172.21.15.78:0/3505632154 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9d7c03b520 con 0x7f9d88095190 2024-04-25T02:10:13.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.021+0000 7f9d76ffd700 1 -- 172.21.15.78:0/3505632154 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f9d7c019310 con 0x7f9d88095190 2024-04-25T02:10:13.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.042+0000 7f4e02f9e700 1 Processor -- start 2024-04-25T02:10:13.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.042+0000 7f4e02f9e700 1 -- start start 2024-04-25T02:10:13.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e02f9e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4dfc091e50 0x7f4dfc12c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e02f9e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc12c630 0x7f4dfc12ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e02f9e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc092c80 con 0x7f4dfc091360 2024-04-25T02:10:13.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e02f9e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc096120 con 0x7f4dfc091e50 2024-04-25T02:10:13.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e02f9e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc09ac60 con 0x7f4dfc12c630 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e01f9c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4dfc091360 0x7f4dfc091740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60044/0 (socket says 172.21.15.78:60044) 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e01f9c700 1 -- 172.21.15.78:0/2446421376 learned_addr learned my addr 172.21.15.78:0/2446421376 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e0179b700 1 --2- 172.21.15.78:0/2446421376 >> v2:172.21.15.78:3300/0 conn(0x7f4dfc091e50 0x7f4dfc12c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e0279d700 1 --2- 172.21.15.78:0/2446421376 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc12c630 0x7f4dfc12ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e0179b700 1 -- 172.21.15.78:0/2446421376 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc12c630 msgr2=0x7f4dfc12ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e0179b700 1 --2- 172.21.15.78:0/2446421376 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc12c630 0x7f4dfc12ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e0179b700 1 -- 172.21.15.78:0/2446421376 >> v1:172.21.15.78:6789/0 conn(0x7f4dfc091360 legacy=0x7f4dfc091740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.043+0000 7f4e0179b700 1 -- 172.21.15.78:0/2446421376 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0976e0 con 0x7f4dfc091e50 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.044+0000 7f4e0179b700 1 --2- 172.21.15.78:0/2446421376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 0x7f4dfc12c140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4dec009760 tx=0x7f4dec009060).ready entity=mon.0 client_cookie=4c8a9c290dfb73f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.044+0000 7f4e00f9a700 1 -- 172.21.15.78:0/2446421376 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec00b580 con 0x7f4dfc091e50 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.044+0000 7f4e00f9a700 1 -- 172.21.15.78:0/2446421376 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec00b6e0 con 0x7f4dfc091e50 2024-04-25T02:10:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.044+0000 7f4e00f9a700 1 -- 172.21.15.78:0/2446421376 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec00ba60 con 0x7f4dfc091e50 2024-04-25T02:10:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.045+0000 7f4e02f9e700 1 -- 172.21.15.78:0/2446421376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 msgr2=0x7f4dfc12c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.045+0000 7f4e02f9e700 1 --2- 172.21.15.78:0/2446421376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 0x7f4dfc12c140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4dec009760 tx=0x7f4dec009060).stop 2024-04-25T02:10:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.045+0000 7f4e02f9e700 1 -- 172.21.15.78:0/2446421376 shutdown_connections 2024-04-25T02:10:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.045+0000 7f4e02f9e700 1 --2- 172.21.15.78:0/2446421376 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc12c630 0x7f4dfc12ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.045+0000 7f4e02f9e700 1 --2- 172.21.15.78:0/2446421376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 0x7f4dfc12c140 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.045+0000 7f4e02f9e700 1 -- 172.21.15.78:0/2446421376 >> 172.21.15.78:0/2446421376 conn(0x7f4dfc09a850 msgr2=0x7f4dfc0968d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.045+0000 7f4e02f9e700 1 -- 172.21.15.78:0/2446421376 shutdown_connections 2024-04-25T02:10:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.045+0000 7f4e02f9e700 1 -- 172.21.15.78:0/2446421376 wait complete. 2024-04-25T02:10:13.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.046+0000 7f4e02f9e700 1 Processor -- start 2024-04-25T02:10:13.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.046+0000 7f4e02f9e700 1 -- start start 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e02f9e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc091360 0x7f4dfc125a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e02f9e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 0x7f4dfc126120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e0179b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 0x7f4dfc126120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e0179b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 0x7f4dfc126120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43052/0 (socket says 172.21.15.78:43052) 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e01f9c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc091360 0x7f4dfc125a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e02f9e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dfc12c630 0x7f4dfc126610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e02f9e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc099460 con 0x7f4dfc091e50 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e02f9e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc11f2c0 con 0x7f4dfc12c630 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e02f9e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc120b90 con 0x7f4dfc091360 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e0179b700 1 -- 172.21.15.78:0/3672036698 learned_addr learned my addr 172.21.15.78:0/3672036698 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.047+0000 7f4e0279d700 1 --2- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dfc12c630 0x7f4dfc126610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4e0279d700 1 -- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc091360 msgr2=0x7f4dfc125a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4e0279d700 1 --2- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc091360 0x7f4dfc125a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4e0279d700 1 -- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 msgr2=0x7f4dfc126120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4e0279d700 1 --2- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 0x7f4dfc126120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4e0279d700 1 -- 172.21.15.78:0/3672036698 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0092a0 con 0x7f4dfc12c630 2024-04-25T02:10:13.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4e0279d700 1 --2- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dfc12c630 0x7f4dfc126610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4df4007ed0 tx=0x7f4df4009850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4df27fc700 1 -- 172.21.15.78:0/3672036698 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400eb90 con 0x7f4dfc12c630 2024-04-25T02:10:13.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4df27fc700 1 -- 172.21.15.78:0/3672036698 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df400ecf0 con 0x7f4dfc12c630 2024-04-25T02:10:13.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc120e50 con 0x7f4dfc12c630 2024-04-25T02:10:13.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4df27fc700 1 -- 172.21.15.78:0/3672036698 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4014630 con 0x7f4dfc12c630 2024-04-25T02:10:13.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.048+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc1280d0 con 0x7f4dfc12c630 2024-04-25T02:10:13.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.049+0000 7f4df27fc700 1 -- 172.21.15.78:0/3672036698 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f4df401d3b0 con 0x7f4dfc12c630 2024-04-25T02:10:13.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.049+0000 7f4df27fc700 1 -- 172.21.15.78:0/3672036698 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4df403b600 con 0x7f4dfc12c630 2024-04-25T02:10:13.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.051+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc05a310 con 0x7f4dfc12c630 2024-04-25T02:10:13.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.055+0000 7f2c46154700 1 Processor -- start 2024-04-25T02:10:13.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.055+0000 7f2c46154700 1 -- start start 2024-04-25T02:10:13.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c46154700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c40091450 0x7f2c40091830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c46154700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40090780 0x7f2c40090bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c46154700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c40093d70 con 0x7f2c40091d20 2024-04-25T02:10:13.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c46154700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4006c260 con 0x7f2c40091450 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c46154700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c40099570 con 0x7f2c40090780 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c3effd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2c40091d20 0x7f2c40090070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60058/0 (socket says 172.21.15.78:60058) 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c3ffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40090780 0x7f2c40090bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c3effd700 1 -- 172.21.15.78:0/791177429 learned_addr learned my addr 172.21.15.78:0/791177429 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c3f7fe700 1 --2- 172.21.15.78:0/791177429 >> v2:172.21.15.78:3300/0 conn(0x7f2c40091450 0x7f2c40091830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c3ffff700 1 -- 172.21.15.78:0/791177429 >> v2:172.21.15.78:3300/0 conn(0x7f2c40091450 msgr2=0x7f2c40091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c3ffff700 1 --2- 172.21.15.78:0/791177429 >> v2:172.21.15.78:3300/0 conn(0x7f2c40091450 0x7f2c40091830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c3ffff700 1 -- 172.21.15.78:0/791177429 >> v1:172.21.15.78:6789/0 conn(0x7f2c40091d20 legacy=0x7f2c40090070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c3ffff700 1 -- 172.21.15.78:0/791177429 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40093ad0 con 0x7f2c40090780 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.056+0000 7f2c3e7fc700 1 -- 172.21.15.78:0/791177429 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776682660 0 0) 0x7f2c40093d70 con 0x7f2c40091d20 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c3ffff700 1 --2- 172.21.15.78:0/791177429 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40090780 0x7f2c40090bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2c3800d0d0 tx=0x7f2c3800b990).ready entity=mon.2 client_cookie=97958e32d9019ac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c3e7fc700 1 -- 172.21.15.78:0/791177429 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38010070 con 0x7f2c40090780 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c3e7fc700 1 -- 172.21.15.78:0/791177429 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3800b2e0 con 0x7f2c40090780 2024-04-25T02:10:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c3e7fc700 1 -- 172.21.15.78:0/791177429 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800dd40 con 0x7f2c40090780 2024-04-25T02:10:13.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c46154700 1 -- 172.21.15.78:0/791177429 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40090780 msgr2=0x7f2c40090bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c46154700 1 --2- 172.21.15.78:0/791177429 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40090780 0x7f2c40090bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2c3800d0d0 tx=0x7f2c3800b990).stop 2024-04-25T02:10:13.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c46154700 1 -- 172.21.15.78:0/791177429 shutdown_connections 2024-04-25T02:10:13.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c46154700 1 --2- 172.21.15.78:0/791177429 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40090780 0x7f2c40090bf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c46154700 1 --2- 172.21.15.78:0/791177429 >> v2:172.21.15.78:3300/0 conn(0x7f2c40091450 0x7f2c40091830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c46154700 1 -- 172.21.15.78:0/791177429 >> 172.21.15.78:0/791177429 conn(0x7f2c400974d0 msgr2=0x7f2c40099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c46154700 1 -- 172.21.15.78:0/791177429 shutdown_connections 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.057+0000 7f2c46154700 1 -- 172.21.15.78:0/791177429 wait complete. 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.058+0000 7f2c46154700 1 Processor -- start 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.058+0000 7f2c46154700 1 -- start start 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c46154700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c40090780 0x7f2c40082fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c46154700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c40091450 0x7f2c40083490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c46154700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40091d20 0x7f2c40083980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c46154700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c40083e70 con 0x7f2c40090780 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c46154700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400959b0 con 0x7f2c40091450 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c46154700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c40086f20 con 0x7f2c40091d20 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c40090780 0x7f2c40082fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c40090780 0x7f2c40082fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43076/0 (socket says 172.21.15.78:43076) 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3f7fe700 1 -- 172.21.15.78:0/500507755 learned_addr learned my addr 172.21.15.78:0/500507755 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:13.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3ffff700 1 --2- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40091d20 0x7f2c40083980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3effd700 1 --2- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c40091450 0x7f2c40083490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3ffff700 1 -- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c40091450 msgr2=0x7f2c40083490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3ffff700 1 --2- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c40091450 0x7f2c40083490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3ffff700 1 -- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c40090780 msgr2=0x7f2c40082fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3ffff700 1 --2- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c40090780 0x7f2c40082fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.059+0000 7f2c3ffff700 1 -- 172.21.15.78:0/500507755 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3800bc30 con 0x7f2c40091d20 2024-04-25T02:10:13.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.060+0000 7f2c3ffff700 1 --2- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40091d20 0x7f2c40083980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2c38015000 tx=0x7f2c3800b990).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.060+0000 7f4df27fc700 1 -- 172.21.15.78:0/3672036698 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f4df400ee60 con 0x7f4dfc12c630 2024-04-25T02:10:13.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.060+0000 7f2c27fff700 1 -- 172.21.15.78:0/500507755 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c380229f0 con 0x7f2c40091d20 2024-04-25T02:10:13.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.060+0000 7f2c27fff700 1 -- 172.21.15.78:0/500507755 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38022b50 con 0x7f2c40091d20 2024-04-25T02:10:13.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.060+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c40085a90 con 0x7f2c40091d20 2024-04-25T02:10:13.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.060+0000 7f2c27fff700 1 -- 172.21.15.78:0/500507755 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38022d00 con 0x7f2c40091d20 2024-04-25T02:10:13.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.060+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c400843c0 con 0x7f2c40091d20 2024-04-25T02:10:13.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.061+0000 7f2c27fff700 1 -- 172.21.15.78:0/500507755 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f2c38028020 con 0x7f2c40091d20 2024-04-25T02:10:13.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.061+0000 7f2c27fff700 1 -- 172.21.15.78:0/500507755 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2c38044de0 con 0x7f2c40091d20 2024-04-25T02:10:13.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.061+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c400905e0 con 0x7f2c40091d20 2024-04-25T02:10:13.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.070+0000 7f2c27fff700 1 -- 172.21.15.78:0/500507755 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f2c400905e0 con 0x7f2c40091d20 2024-04-25T02:10:13.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.151+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a4009b150 con 0x7f1a40098530 2024-04-25T02:10:13.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.151+0000 7f1a36ffd700 1 -- 172.21.15.78:0/1654083777 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a300108a0 con 0x7f1a40098530 2024-04-25T02:10:13.159 INFO:teuthology.orchestra.run.smithi078.stdout:38654705668 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 >> v1:172.21.15.78:6816/46507 conn(0x7f1a2402bd00 legacy=0x7f1a2402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 msgr2=0x7f1a4013a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 --2- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 0x7f1a4013a3b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1a3000e9a0 tx=0x7f1a30009060).stop 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 shutdown_connections 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 --2- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1a4013a8a0 0x7f1a40114410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 --2- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a40064ad0 0x7f1a40139ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 --2- 172.21.15.78:0/1654083777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a40098530 0x7f1a4013a3b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 >> 172.21.15.78:0/1654083777 conn(0x7f1a4009a630 msgr2=0x7f1a4009b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 shutdown_connections 2024-04-25T02:10:13.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.154+0000 7f1a48460700 1 -- 172.21.15.78:0/1654083777 wait complete. 2024-04-25T02:10:13.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.3 2024-04-25T02:10:13.173 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.202+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d88117b40 con 0x7f9d88095190 2024-04-25T02:10:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.203+0000 7f9d76ffd700 1 -- 172.21.15.78:0/3505632154 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d88117b40 con 0x7f9d88095190 2024-04-25T02:10:13.210 INFO:teuthology.orchestra.run.smithi078.stdout:38654705669 2024-04-25T02:10:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 >> v1:172.21.15.78:6816/46507 conn(0x7f9d6802bd00 legacy=0x7f9d6802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88095190 msgr2=0x7f9d88113c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 --2- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88095190 0x7f9d88113c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9d7c00e900 tx=0x7f9d7c009060).stop 2024-04-25T02:10:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 shutdown_connections 2024-04-25T02:10:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 --2- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d881277a0 0x7f9d88114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 --2- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9d88062860 0x7f9d88113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 --2- 172.21.15.78:0/3505632154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88095190 0x7f9d88113c60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 >> 172.21.15.78:0/3505632154 conn(0x7f9d88097450 msgr2=0x7f9d88092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 shutdown_connections 2024-04-25T02:10:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.204+0000 7f9d8cd0e700 1 -- 172.21.15.78:0/3505632154 wait complete. 2024-04-25T02:10:13.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-04-25T02:10:13.224 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.228+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4dfc046ce0 con 0x7f4dfc12c630 2024-04-25T02:10:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.228+0000 7f4df27fc700 1 -- 172.21.15.78:0/3672036698 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4df4012af0 con 0x7f4dfc12c630 2024-04-25T02:10:13.236 INFO:teuthology.orchestra.run.smithi078.stdout:38654705668 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 >> v1:172.21.15.78:6816/46507 conn(0x7f4de002bd00 legacy=0x7f4de002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dfc12c630 msgr2=0x7f4dfc126610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 --2- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dfc12c630 0x7f4dfc126610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4df4007ed0 tx=0x7f4df4009850).stop 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 shutdown_connections 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 --2- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dfc12c630 0x7f4dfc126610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 --2- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dfc091360 0x7f4dfc125a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 --2- 172.21.15.78:0/3672036698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dfc091e50 0x7f4dfc126120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 >> 172.21.15.78:0/3672036698 conn(0x7f4dfc09a850 msgr2=0x7f4dfc097cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 shutdown_connections 2024-04-25T02:10:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.230+0000 7f4e02f9e700 1 -- 172.21.15.78:0/3672036698 wait complete. 2024-04-25T02:10:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.239+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2c400905e0 con 0x7f2c40091d20 2024-04-25T02:10:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.240+0000 7f2c27fff700 1 -- 172.21.15.78:0/500507755 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c400905e0 con 0x7f2c40091d20 2024-04-25T02:10:13.247 INFO:teuthology.orchestra.run.smithi078.stdout:38654705669 2024-04-25T02:10:13.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-04-25T02:10:13.250 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 >> v1:172.21.15.78:6816/46507 conn(0x7f2c2c02bd00 legacy=0x7f2c2c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40091d20 msgr2=0x7f2c40083980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 --2- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40091d20 0x7f2c40083980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2c38015000 tx=0x7f2c3800b990).stop 2024-04-25T02:10:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 shutdown_connections 2024-04-25T02:10:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 --2- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c40091d20 0x7f2c40083980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 --2- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c40090780 0x7f2c40082fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 --2- 172.21.15.78:0/500507755 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c40091450 0x7f2c40083490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 >> 172.21.15.78:0/500507755 conn(0x7f2c400974d0 msgr2=0x7f2c40094930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 shutdown_connections 2024-04-25T02:10:13.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.242+0000 7f2c46154700 1 -- 172.21.15.78:0/500507755 wait complete. 2024-04-25T02:10:13.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-04-25T02:10:13.261 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:13.261 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:10:13.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:13.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d725f8700 1 Processor -- start 2024-04-25T02:10:13.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d725f8700 1 -- start start 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d725f8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d6c127eb0 0x7f8d6c1271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d725f8700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c12fb30 0x7f8d6c131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d725f8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c096490 con 0x7f8d6c062860 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d725f8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c062c40 con 0x7f8d6c127eb0 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d725f8700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c091b90 con 0x7f8d6c12fb30 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d70b95700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c12fb30 0x7f8d6c131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d6b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d6c127eb0 0x7f8d6c1271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d70b95700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c12fb30 0x7f8d6c131f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51074/0 (socket says 172.21.15.78:51074) 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d6b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d6c127eb0 0x7f8d6c1271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38356/0 (socket says 172.21.15.78:38356) 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.408+0000 7f8d70b95700 1 -- 172.21.15.78:0/434977254 learned_addr learned my addr 172.21.15.78:0/434977254 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d6b7fe700 1 -- 172.21.15.78:0/434977254 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c12fb30 msgr2=0x7f8d6c131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d6b7fe700 1 --2- 172.21.15.78:0/434977254 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c12fb30 0x7f8d6c131f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d6b7fe700 1 -- 172.21.15.78:0/434977254 >> v1:172.21.15.78:6789/0 conn(0x7f8d6c062860 legacy=0x7f8d6c1277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d6b7fe700 1 -- 172.21.15.78:0/434977254 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c091e50 con 0x7f8d6c127eb0 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d6affd700 1 -- 172.21.15.78:0/434977254 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929146400 0 0) 0x7f8d6c096490 con 0x7f8d6c062860 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d70b95700 1 --2- 172.21.15.78:0/434977254 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c12fb30 0x7f8d6c131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d6b7fe700 1 --2- 172.21.15.78:0/434977254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 0x7f8d6c1271f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8d60009760 tx=0x7f8d60009060).ready entity=mon.0 client_cookie=55055b26d132ac15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d6affd700 1 -- 172.21.15.78:0/434977254 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000f510 con 0x7f8d6c127eb0 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d6affd700 1 -- 172.21.15.78:0/434977254 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6000f670 con 0x7f8d6c127eb0 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d6affd700 1 -- 172.21.15.78:0/434977254 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000f9f0 con 0x7f8d6c127eb0 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d725f8700 1 -- 172.21.15.78:0/434977254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 msgr2=0x7f8d6c1271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d725f8700 1 --2- 172.21.15.78:0/434977254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 0x7f8d6c1271f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8d60009760 tx=0x7f8d60009060).stop 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d725f8700 1 -- 172.21.15.78:0/434977254 shutdown_connections 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d725f8700 1 --2- 172.21.15.78:0/434977254 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c12fb30 0x7f8d6c131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d725f8700 1 --2- 172.21.15.78:0/434977254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 0x7f8d6c1271f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d725f8700 1 -- 172.21.15.78:0/434977254 >> 172.21.15.78:0/434977254 conn(0x7f8d6c097450 msgr2=0x7f8d6c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d725f8700 1 -- 172.21.15.78:0/434977254 shutdown_connections 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.409+0000 7f8d725f8700 1 -- 172.21.15.78:0/434977254 wait complete. 2024-04-25T02:10:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.410+0000 7f8d725f8700 1 Processor -- start 2024-04-25T02:10:13.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.410+0000 7f8d725f8700 1 -- start start 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d725f8700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c062860 0x7f8d6c110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d725f8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 0x7f8d6c12bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d725f8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d6c12fb30 0x7f8d6c12c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d725f8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c12d060 con 0x7f8d6c127eb0 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d725f8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c12efb0 con 0x7f8d6c12fb30 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d725f8700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c12ebe0 con 0x7f8d6c062860 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c062860 0x7f8d6c110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 0x7f8d6c12bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c062860 0x7f8d6c110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51082/0 (socket says 172.21.15.78:51082) 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d70b95700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d6c12fb30 0x7f8d6c12c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6bfff700 1 -- 172.21.15.78:0/1385062880 learned_addr learned my addr 172.21.15.78:0/1385062880 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6b7fe700 1 -- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c062860 msgr2=0x7f8d6c110df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6b7fe700 1 --2- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c062860 0x7f8d6c110df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6b7fe700 1 -- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d6c12fb30 msgr2=0x7f8d6c12c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6b7fe700 1 --2- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d6c12fb30 0x7f8d6c12c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6b7fe700 1 -- 172.21.15.78:0/1385062880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64009ae0 con 0x7f8d6c127eb0 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6bfff700 1 --2- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c062860 0x7f8d6c110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d70b95700 1 --2- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d6c12fb30 0x7f8d6c12c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.411+0000 7f8d6b7fe700 1 --2- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 0x7f8d6c12bbc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f8d60014000 tx=0x7f8d60017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.412+0000 7f8d68ff9700 1 -- 172.21.15.78:0/1385062880 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000f7e0 con 0x7f8d6c127eb0 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.412+0000 7f8d68ff9700 1 -- 172.21.15.78:0/1385062880 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6000f940 con 0x7f8d6c127eb0 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.412+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d600092a0 con 0x7f8d6c127eb0 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.412+0000 7f8d68ff9700 1 -- 172.21.15.78:0/1385062880 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6001b660 con 0x7f8d6c127eb0 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.412+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c096d20 con 0x7f8d6c127eb0 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.412+0000 7f8d68ff9700 1 -- 172.21.15.78:0/1385062880 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f8d6001ba10 con 0x7f8d6c127eb0 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.412+0000 7f8d68ff9700 1 -- 172.21.15.78:0/1385062880 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8d6003c960 con 0x7f8d6c127eb0 2024-04-25T02:10:13.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.413+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c097f70 con 0x7f8d6c127eb0 2024-04-25T02:10:13.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.417+0000 7f8d68ff9700 1 -- 172.21.15.78:0/1385062880 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f8d60029020 con 0x7f8d6c127eb0 2024-04-25T02:10:13.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.570+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d6c12f4b0 con 0x7f8d5802bd00 2024-04-25T02:10:13.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.577+0000 7f8d68ff9700 1 -- 172.21.15.78:0/1385062880 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249918 (unknown 2965378022 0 1222265020) 0x7f8d5c001670 con 0x7f8d5802bd00 2024-04-25T02:10:13.587 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:13.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 >> v1:172.21.15.78:6816/46507 conn(0x7f8d5802bd00 legacy=0x7f8d5802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 msgr2=0x7f8d6c12bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 --2- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 0x7f8d6c12bbc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f8d60014000 tx=0x7f8d60017000).stop 2024-04-25T02:10:13.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 shutdown_connections 2024-04-25T02:10:13.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 --2- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d6c12fb30 0x7f8d6c12c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 --2- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8d6c062860 0x7f8d6c110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 --2- 172.21.15.78:0/1385062880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d6c127eb0 0x7f8d6c12bbc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 >> 172.21.15.78:0/1385062880 conn(0x7f8d6c097450 msgr2=0x7f8d6c092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 shutdown_connections 2024-04-25T02:10:13.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.580+0000 7f8d725f8700 1 -- 172.21.15.78:0/1385062880 wait complete. 2024-04-25T02:10:13.590 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:10:13.599 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T02:10:12.198719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188992,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298368,"statfs":{"total":386547056640,"available":385329528832,"internally_reserved":0,"allocated":622592,"data_stored":182668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000797"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752012+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:10:02.752012+0000","last_peered":"2024-04-25T02:10:02.752012+0000","last_clean":"2024-04-25T02:10:02.752012+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:10:02.752012+0000","last_undegraded":"2024-04-25T02:10:02.752012+0000","last_fullsized":"2024-04-25T02:10:02.752012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751974+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:10:02.751974+0000","last_peered":"2024-04-25T02:10:02.751974+0000","last_clean":"2024-04-25T02:10:02.751974+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:10:02.751974+0000","last_undegraded":"2024-04-25T02:10:02.751974+0000","last_fullsized":"2024-04-25T02:10:02.751974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750337+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:10:02.750337+0000","last_peered":"2024-04-25T02:10:02.750337+0000","last_clean":"2024-04-25T02:10:02.750337+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:10:02.750337+0000","last_undegraded":"2024-04-25T02:10:02.750337+0000","last_fullsized":"2024-04-25T02:10:02.750337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751731+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:10:02.751731+0000","last_peered":"2024-04-25T02:10:02.751731+0000","last_clean":"2024-04-25T02:10:02.751731+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:10:02.751731+0000","last_undegraded":"2024-04-25T02:10:02.751731+0000","last_fullsized":"2024-04-25T02:10:02.751731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751364+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:10:02.751364+0000","last_peered":"2024-04-25T02:10:02.751364+0000","last_clean":"2024-04-25T02:10:02.751364+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:10:02.751364+0000","last_undegraded":"2024-04-25T02:10:02.751364+0000","last_fullsized":"2024-04-25T02:10:02.751364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750560+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:10:02.750560+0000","last_peered":"2024-04-25T02:10:02.750560+0000","last_clean":"2024-04-25T02:10:02.750560+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:10:02.750560+0000","last_undegraded":"2024-04-25T02:10:02.750560+0000","last_fullsized":"2024-04-25T02:10:02.750560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750799+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:10:02.750799+0000","last_peered":"2024-04-25T02:10:02.750799+0000","last_clean":"2024-04-25T02:10:02.750799+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:10:02.750799+0000","last_undegraded":"2024-04-25T02:10:02.750799+0000","last_fullsized":"2024-04-25T02:10:02.750799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.740931+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:10:02.740931+0000","last_peered":"2024-04-25T02:10:02.740931+0000","last_clean":"2024-04-25T02:10:02.740931+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:10:02.740931+0000","last_undegraded":"2024-04-25T02:10:02.740931+0000","last_fullsized":"2024-04-25T02:10:02.740931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751938+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:10:02.751938+0000","last_peered":"2024-04-25T02:10:02.751938+0000","last_clean":"2024-04-25T02:10:02.751938+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:10:02.751938+0000","last_undegraded":"2024-04-25T02:10:02.751938+0000","last_fullsized":"2024-04-25T02:10:02.751938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743408+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:10:02.743408+0000","last_peered":"2024-04-25T02:10:02.743408+0000","last_clean":"2024-04-25T02:10:02.743408+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:10:02.743408+0000","last_undegraded":"2024-04-25T02:10:02.743408+0000","last_fullsized":"2024-04-25T02:10:02.743408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.742455+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:10:02.742455+0000","last_peered":"2024-04-25T02:10:02.742455+0000","last_clean":"2024-04-25T02:10:02.742455+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:10:02.742455+0000","last_undegraded":"2024-04-25T02:10:02.742455+0000","last_fullsized":"2024-04-25T02:10:02.742455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752082+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:10:02.752082+0000","last_peered":"2024-04-25T02:10:02.752082+0000","last_clean":"2024-04-25T02:10:02.752082+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:10:02.752082+0000","last_undegraded":"2024-04-25T02:10:02.752082+0000","last_fullsized":"2024-04-25T02:10:02.752082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751894+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:10:02.751894+0000","last_peered":"2024-04-25T02:10:02.751894+0000","last_clean":"2024-04-25T02:10:02.751894+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:10:02.751894+0000","last_undegraded":"2024-04-25T02:10:02.751894+0000","last_fullsized":"2024-04-25T02:10:02.751894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.741478+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:10:02.741478+0000","last_peered":"2024-04-25T02:10:02.741478+0000","last_clean":"2024-04-25T02:10:02.741478+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:10:02.741478+0000","last_undegraded":"2024-04-25T02:10:02.741478+0000","last_fullsized":"2024-04-25T02:10:02.741478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.735925+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:10:02.735925+0000","last_peered":"2024-04-25T02:10:02.735925+0000","last_clean":"2024-04-25T02:10:02.735925+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:10:02.735925+0000","last_undegraded":"2024-04-25T02:10:02.735925+0000","last_fullsized":"2024-04-25T02:10:02.735925+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750880+0000","last_change":"2024-04-25T02:10:02.735597+0000","last_active":"2024-04-25T02:10:02.750880+0000","last_peered":"2024-04-25T02:10:02.750880+0000","last_clean":"2024-04-25T02:10:02.750880+0000","last_became_active":"2024-04-25T02:10:02.735267+0000","last_became_peered":"2024-04-25T02:10:02.735267+0000","last_unstale":"2024-04-25T02:10:02.750880+0000","last_undegraded":"2024-04-25T02:10:02.750880+0000","last_fullsized":"2024-04-25T02:10:02.750880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751917+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:10:02.751917+0000","last_peered":"2024-04-25T02:10:02.751917+0000","last_clean":"2024-04-25T02:10:02.751917+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:10:02.751917+0000","last_undegraded":"2024-04-25T02:10:02.751917+0000","last_fullsized":"2024-04-25T02:10:02.751917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.733646+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:10:02.733646+0000","last_peered":"2024-04-25T02:10:02.733646+0000","last_clean":"2024-04-25T02:10:02.733646+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:10:02.733646+0000","last_undegraded":"2024-04-25T02:10:02.733646+0000","last_fullsized":"2024-04-25T02:10:02.733646+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752004+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:10:02.752004+0000","last_peered":"2024-04-25T02:10:02.752004+0000","last_clean":"2024-04-25T02:10:02.752004+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:10:02.752004+0000","last_undegraded":"2024-04-25T02:10:02.752004+0000","last_fullsized":"2024-04-25T02:10:02.752004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.744013+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:10:02.744013+0000","last_peered":"2024-04-25T02:10:02.744013+0000","last_clean":"2024-04-25T02:10:02.744013+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:10:02.744013+0000","last_undegraded":"2024-04-25T02:10:02.744013+0000","last_fullsized":"2024-04-25T02:10:02.744013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743911+0000","last_change":"2024-04-25T02:10:02.737504+0000","last_active":"2024-04-25T02:10:02.743911+0000","last_peered":"2024-04-25T02:10:02.743911+0000","last_clean":"2024-04-25T02:10:02.743911+0000","last_became_active":"2024-04-25T02:10:02.737240+0000","last_became_peered":"2024-04-25T02:10:02.737240+0000","last_unstale":"2024-04-25T02:10:02.743911+0000","last_undegraded":"2024-04-25T02:10:02.743911+0000","last_fullsized":"2024-04-25T02:10:02.743911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.735754+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:10:02.735754+0000","last_peered":"2024-04-25T02:10:02.735754+0000","last_clean":"2024-04-25T02:10:02.735754+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:10:02.735754+0000","last_undegraded":"2024-04-25T02:10:02.735754+0000","last_fullsized":"2024-04-25T02:10:02.735754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751571+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:10:02.751571+0000","last_peered":"2024-04-25T02:10:02.751571+0000","last_clean":"2024-04-25T02:10:02.751571+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:10:02.751571+0000","last_undegraded":"2024-04-25T02:10:02.751571+0000","last_fullsized":"2024-04-25T02:10:02.751571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.742751+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:10:02.742751+0000","last_peered":"2024-04-25T02:10:02.742751+0000","last_clean":"2024-04-25T02:10:02.742751+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:10:02.742751+0000","last_undegraded":"2024-04-25T02:10:02.742751+0000","last_fullsized":"2024-04-25T02:10:02.742751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750687+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:10:02.750687+0000","last_peered":"2024-04-25T02:10:02.750687+0000","last_clean":"2024-04-25T02:10:02.750687+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:10:02.750687+0000","last_undegraded":"2024-04-25T02:10:02.750687+0000","last_fullsized":"2024-04-25T02:10:02.750687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743438+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:10:02.743438+0000","last_peered":"2024-04-25T02:10:02.743438+0000","last_clean":"2024-04-25T02:10:02.743438+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:10:02.743438+0000","last_undegraded":"2024-04-25T02:10:02.743438+0000","last_fullsized":"2024-04-25T02:10:02.743438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751844+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:10:02.751844+0000","last_peered":"2024-04-25T02:10:02.751844+0000","last_clean":"2024-04-25T02:10:02.751844+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:10:02.751844+0000","last_undegraded":"2024-04-25T02:10:02.751844+0000","last_fullsized":"2024-04-25T02:10:02.751844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.730800+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:10:02.730800+0000","last_peered":"2024-04-25T02:10:02.730800+0000","last_clean":"2024-04-25T02:10:02.730800+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:10:02.730800+0000","last_undegraded":"2024-04-25T02:10:02.730800+0000","last_fullsized":"2024-04-25T02:10:02.730800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750605+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:10:02.750605+0000","last_peered":"2024-04-25T02:10:02.750605+0000","last_clean":"2024-04-25T02:10:02.750605+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:10:02.750605+0000","last_undegraded":"2024-04-25T02:10:02.750605+0000","last_fullsized":"2024-04-25T02:10:02.750605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.711548+0000","last_change":"2024-04-25T02:10:02.370405+0000","last_active":"2024-04-25T02:10:02.711548+0000","last_peered":"2024-04-25T02:10:02.711548+0000","last_clean":"2024-04-25T02:10:02.711548+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:10:02.711548+0000","last_undegraded":"2024-04-25T02:10:02.711548+0000","last_fullsized":"2024-04-25T02:10:02.711548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750370+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:10:02.750370+0000","last_peered":"2024-04-25T02:10:02.750370+0000","last_clean":"2024-04-25T02:10:02.750370+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:10:02.750370+0000","last_undegraded":"2024-04-25T02:10:02.750370+0000","last_fullsized":"2024-04-25T02:10:02.750370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.709328+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:10:02.709328+0000","last_peered":"2024-04-25T02:10:02.709328+0000","last_clean":"2024-04-25T02:10:02.709328+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:10:02.709328+0000","last_undegraded":"2024-04-25T02:10:02.709328+0000","last_fullsized":"2024-04-25T02:10:02.709328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751527+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:10:02.751527+0000","last_peered":"2024-04-25T02:10:02.751527+0000","last_clean":"2024-04-25T02:10:02.751527+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:10:02.751527+0000","last_undegraded":"2024-04-25T02:10:02.751527+0000","last_fullsized":"2024-04-25T02:10:02.751527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.713945+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:10:02.713945+0000","last_peered":"2024-04-25T02:10:02.713945+0000","last_clean":"2024-04-25T02:10:02.713945+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:10:02.713945+0000","last_undegraded":"2024-04-25T02:10:02.713945+0000","last_fullsized":"2024-04-25T02:10:02.713945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750844+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:10:02.750844+0000","last_peered":"2024-04-25T02:10:02.750844+0000","last_clean":"2024-04-25T02:10:02.750844+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:10:02.750844+0000","last_undegraded":"2024-04-25T02:10:02.750844+0000","last_fullsized":"2024-04-25T02:10:02.750844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.712697+0000","last_change":"2024-04-25T02:10:02.367526+0000","last_active":"2024-04-25T02:10:02.712697+0000","last_peered":"2024-04-25T02:10:02.712697+0000","last_clean":"2024-04-25T02:10:02.712697+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:10:02.712697+0000","last_undegraded":"2024-04-25T02:10:02.712697+0000","last_fullsized":"2024-04-25T02:10:02.712697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751541+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:10:02.751541+0000","last_peered":"2024-04-25T02:10:02.751541+0000","last_clean":"2024-04-25T02:10:02.751541+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:10:02.751541+0000","last_undegraded":"2024-04-25T02:10:02.751541+0000","last_fullsized":"2024-04-25T02:10:02.751541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751247+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:10:02.751247+0000","last_peered":"2024-04-25T02:10:02.751247+0000","last_clean":"2024-04-25T02:10:02.751247+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:10:02.751247+0000","last_undegraded":"2024-04-25T02:10:02.751247+0000","last_fullsized":"2024-04-25T02:10:02.751247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.747657+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:10:02.747657+0000","last_peered":"2024-04-25T02:10:02.747657+0000","last_clean":"2024-04-25T02:10:02.747657+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:10:02.747657+0000","last_undegraded":"2024-04-25T02:10:02.747657+0000","last_fullsized":"2024-04-25T02:10:02.747657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.754250+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:10:02.754250+0000","last_peered":"2024-04-25T02:10:02.754250+0000","last_clean":"2024-04-25T02:10:02.754250+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:10:02.754250+0000","last_undegraded":"2024-04-25T02:10:02.754250+0000","last_fullsized":"2024-04-25T02:10:02.754250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751878+0000","last_change":"2024-04-25T02:10:02.742932+0000","last_active":"2024-04-25T02:10:02.751878+0000","last_peered":"2024-04-25T02:10:02.751878+0000","last_clean":"2024-04-25T02:10:02.751878+0000","last_became_active":"2024-04-25T02:10:02.742365+0000","last_became_peered":"2024-04-25T02:10:02.742365+0000","last_unstale":"2024-04-25T02:10:02.751878+0000","last_undegraded":"2024-04-25T02:10:02.751878+0000","last_fullsized":"2024-04-25T02:10:02.751878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750666+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:10:02.750666+0000","last_peered":"2024-04-25T02:10:02.750666+0000","last_clean":"2024-04-25T02:10:02.750666+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:10:02.750666+0000","last_undegraded":"2024-04-25T02:10:02.750666+0000","last_fullsized":"2024-04-25T02:10:02.750666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751840+0000","last_change":"2024-04-25T02:10:02.739416+0000","last_active":"2024-04-25T02:10:02.751840+0000","last_peered":"2024-04-25T02:10:02.751840+0000","last_clean":"2024-04-25T02:10:02.751840+0000","last_became_active":"2024-04-25T02:10:02.739082+0000","last_became_peered":"2024-04-25T02:10:02.739082+0000","last_unstale":"2024-04-25T02:10:02.751840+0000","last_undegraded":"2024-04-25T02:10:02.751840+0000","last_fullsized":"2024-04-25T02:10:02.751840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.713109+0000","last_change":"2024-04-25T02:10:02.370169+0000","last_active":"2024-04-25T02:10:02.713109+0000","last_peered":"2024-04-25T02:10:02.713109+0000","last_clean":"2024-04-25T02:10:02.713109+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:10:02.713109+0000","last_undegraded":"2024-04-25T02:10:02.713109+0000","last_fullsized":"2024-04-25T02:10:02.713109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751863+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:10:02.751863+0000","last_peered":"2024-04-25T02:10:02.751863+0000","last_clean":"2024-04-25T02:10:02.751863+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:10:02.751863+0000","last_undegraded":"2024-04-25T02:10:02.751863+0000","last_fullsized":"2024-04-25T02:10:02.751863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.718278+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:10:02.718278+0000","last_peered":"2024-04-25T02:10:02.718278+0000","last_clean":"2024-04-25T02:10:02.718278+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:10:02.718278+0000","last_undegraded":"2024-04-25T02:10:02.718278+0000","last_fullsized":"2024-04-25T02:10:02.718278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751409+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:10:02.751409+0000","last_peered":"2024-04-25T02:10:02.751409+0000","last_clean":"2024-04-25T02:10:02.751409+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:10:02.751409+0000","last_undegraded":"2024-04-25T02:10:02.751409+0000","last_fullsized":"2024-04-25T02:10:02.751409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.737251+0000","last_change":"2024-04-25T02:10:02.360557+0000","last_active":"2024-04-25T02:10:02.737251+0000","last_peered":"2024-04-25T02:10:02.737251+0000","last_clean":"2024-04-25T02:10:02.737251+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:10:02.737251+0000","last_undegraded":"2024-04-25T02:10:02.737251+0000","last_fullsized":"2024-04-25T02:10:02.737251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750758+0000","last_change":"2024-04-25T02:10:02.738439+0000","last_active":"2024-04-25T02:10:02.750758+0000","last_peered":"2024-04-25T02:10:02.750758+0000","last_clean":"2024-04-25T02:10:02.750758+0000","last_became_active":"2024-04-25T02:10:02.738074+0000","last_became_peered":"2024-04-25T02:10:02.738074+0000","last_unstale":"2024-04-25T02:10:02.750758+0000","last_undegraded":"2024-04-25T02:10:02.750758+0000","last_fullsized":"2024-04-25T02:10:02.750758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.740833+0000","last_change":"2024-04-25T02:10:02.370637+0000","last_active":"2024-04-25T02:10:02.740833+0000","last_peered":"2024-04-25T02:10:02.740833+0000","last_clean":"2024-04-25T02:10:02.740833+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:10:02.740833+0000","last_undegraded":"2024-04-25T02:10:02.740833+0000","last_fullsized":"2024-04-25T02:10:02.740833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750862+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:10:02.750862+0000","last_peered":"2024-04-25T02:10:02.750862+0000","last_clean":"2024-04-25T02:10:02.750862+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:10:02.750862+0000","last_undegraded":"2024-04-25T02:10:02.750862+0000","last_fullsized":"2024-04-25T02:10:02.750862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.728279+0000","last_change":"2024-04-25T02:10:02.358829+0000","last_active":"2024-04-25T02:10:02.728279+0000","last_peered":"2024-04-25T02:10:02.728279+0000","last_clean":"2024-04-25T02:10:02.728279+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:10:02.728279+0000","last_undegraded":"2024-04-25T02:10:02.728279+0000","last_fullsized":"2024-04-25T02:10:02.728279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.745845+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:10:02.745845+0000","last_peered":"2024-04-25T02:10:02.745845+0000","last_clean":"2024-04-25T02:10:02.745845+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:10:02.745845+0000","last_undegraded":"2024-04-25T02:10:02.745845+0000","last_fullsized":"2024-04-25T02:10:02.745845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750283+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:10:02.750283+0000","last_peered":"2024-04-25T02:10:02.750283+0000","last_clean":"2024-04-25T02:10:02.750283+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:10:02.750283+0000","last_undegraded":"2024-04-25T02:10:02.750283+0000","last_fullsized":"2024-04-25T02:10:02.750283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752036+0000","last_change":"2024-04-25T02:10:02.744548+0000","last_active":"2024-04-25T02:10:02.752036+0000","last_peered":"2024-04-25T02:10:02.752036+0000","last_clean":"2024-04-25T02:10:02.752036+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:10:02.752036+0000","last_undegraded":"2024-04-25T02:10:02.752036+0000","last_fullsized":"2024-04-25T02:10:02.752036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.719975+0000","last_change":"2024-04-25T02:10:02.371223+0000","last_active":"2024-04-25T02:10:02.719975+0000","last_peered":"2024-04-25T02:10:02.719975+0000","last_clean":"2024-04-25T02:10:02.719975+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:10:02.719975+0000","last_undegraded":"2024-04-25T02:10:02.719975+0000","last_fullsized":"2024-04-25T02:10:02.719975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751343+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:10:02.751343+0000","last_peered":"2024-04-25T02:10:02.751343+0000","last_clean":"2024-04-25T02:10:02.751343+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:10:02.751343+0000","last_undegraded":"2024-04-25T02:10:02.751343+0000","last_fullsized":"2024-04-25T02:10:02.751343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750444+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:10:02.750444+0000","last_peered":"2024-04-25T02:10:02.750444+0000","last_clean":"2024-04-25T02:10:02.750444+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:10:02.750444+0000","last_undegraded":"2024-04-25T02:10:02.750444+0000","last_fullsized":"2024-04-25T02:10:02.750444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751251+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:10:02.751251+0000","last_peered":"2024-04-25T02:10:02.751251+0000","last_clean":"2024-04-25T02:10:02.751251+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:10:02.751251+0000","last_undegraded":"2024-04-25T02:10:02.751251+0000","last_fullsized":"2024-04-25T02:10:02.751251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715303+0000","last_change":"2024-04-25T02:10:02.367348+0000","last_active":"2024-04-25T02:10:02.715303+0000","last_peered":"2024-04-25T02:10:02.715303+0000","last_clean":"2024-04-25T02:10:02.715303+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:10:02.715303+0000","last_undegraded":"2024-04-25T02:10:02.715303+0000","last_fullsized":"2024-04-25T02:10:02.715303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751592+0000","last_change":"2024-04-25T02:10:02.738639+0000","last_active":"2024-04-25T02:10:02.751592+0000","last_peered":"2024-04-25T02:10:02.751592+0000","last_clean":"2024-04-25T02:10:02.751592+0000","last_became_active":"2024-04-25T02:10:02.738040+0000","last_became_peered":"2024-04-25T02:10:02.738040+0000","last_unstale":"2024-04-25T02:10:02.751592+0000","last_undegraded":"2024-04-25T02:10:02.751592+0000","last_fullsized":"2024-04-25T02:10:02.751592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.716182+0000","last_change":"2024-04-25T02:10:02.360699+0000","last_active":"2024-04-25T02:10:02.716182+0000","last_peered":"2024-04-25T02:10:02.716182+0000","last_clean":"2024-04-25T02:10:02.716182+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:10:02.716182+0000","last_undegraded":"2024-04-25T02:10:02.716182+0000","last_fullsized":"2024-04-25T02:10:02.716182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751951+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:10:02.751951+0000","last_peered":"2024-04-25T02:10:02.751951+0000","last_clean":"2024-04-25T02:10:02.751951+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:10:02.751951+0000","last_undegraded":"2024-04-25T02:10:02.751951+0000","last_fullsized":"2024-04-25T02:10:02.751951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708856+0000","last_change":"2024-04-25T02:10:02.365974+0000","last_active":"2024-04-25T02:10:02.708856+0000","last_peered":"2024-04-25T02:10:02.708856+0000","last_clean":"2024-04-25T02:10:02.708856+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:10:02.708856+0000","last_undegraded":"2024-04-25T02:10:02.708856+0000","last_fullsized":"2024-04-25T02:10:02.708856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750664+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:10:02.750664+0000","last_peered":"2024-04-25T02:10:02.750664+0000","last_clean":"2024-04-25T02:10:02.750664+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:10:02.750664+0000","last_undegraded":"2024-04-25T02:10:02.750664+0000","last_fullsized":"2024-04-25T02:10:02.750664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.711566+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:10:02.711566+0000","last_peered":"2024-04-25T02:10:02.711566+0000","last_clean":"2024-04-25T02:10:02.711566+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:10:02.711566+0000","last_undegraded":"2024-04-25T02:10:02.711566+0000","last_fullsized":"2024-04-25T02:10:02.711566+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.711916+0000","last_change":"2024-04-25T02:10:02.367538+0000","last_active":"2024-04-25T02:10:02.711916+0000","last_peered":"2024-04-25T02:10:02.711916+0000","last_clean":"2024-04-25T02:10:02.711916+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:10:02.711916+0000","last_undegraded":"2024-04-25T02:10:02.711916+0000","last_fullsized":"2024-04-25T02:10:02.711916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.747676+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:10:02.747676+0000","last_peered":"2024-04-25T02:10:02.747676+0000","last_clean":"2024-04-25T02:10:02.747676+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:10:02.747676+0000","last_undegraded":"2024-04-25T02:10:02.747676+0000","last_fullsized":"2024-04-25T02:10:02.747676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715220+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:02.715220+0000","last_peered":"2024-04-25T02:10:02.715220+0000","last_clean":"2024-04-25T02:10:02.715220+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:02.715220+0000","last_undegraded":"2024-04-25T02:10:02.715220+0000","last_fullsized":"2024-04-25T02:10:02.715220+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.719601+0000","last_change":"2024-04-25T02:10:02.360464+0000","last_active":"2024-04-25T02:10:02.719601+0000","last_peered":"2024-04-25T02:10:02.719601+0000","last_clean":"2024-04-25T02:10:02.719601+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:10:02.719601+0000","last_undegraded":"2024-04-25T02:10:02.719601+0000","last_fullsized":"2024-04-25T02:10:02.719601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743997+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:10:02.743997+0000","last_peered":"2024-04-25T02:10:02.743997+0000","last_clean":"2024-04-25T02:10:02.743997+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:10:02.743997+0000","last_undegraded":"2024-04-25T02:10:02.743997+0000","last_fullsized":"2024-04-25T02:10:02.743997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708934+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:10:02.708934+0000","last_peered":"2024-04-25T02:10:02.708934+0000","last_clean":"2024-04-25T02:10:02.708934+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:10:02.708934+0000","last_undegraded":"2024-04-25T02:10:02.708934+0000","last_fullsized":"2024-04-25T02:10:02.708934+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708931+0000","last_change":"2024-04-25T02:10:02.361010+0000","last_active":"2024-04-25T02:10:02.708931+0000","last_peered":"2024-04-25T02:10:02.708931+0000","last_clean":"2024-04-25T02:10:02.708931+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:10:02.708931+0000","last_undegraded":"2024-04-25T02:10:02.708931+0000","last_fullsized":"2024-04-25T02:10:02.708931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.740726+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:10:02.740726+0000","last_peered":"2024-04-25T02:10:02.740726+0000","last_clean":"2024-04-25T02:10:02.740726+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:10:02.740726+0000","last_undegraded":"2024-04-25T02:10:02.740726+0000","last_fullsized":"2024-04-25T02:10:02.740726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715234+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:02.715234+0000","last_peered":"2024-04-25T02:10:02.715234+0000","last_clean":"2024-04-25T02:10:02.715234+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:02.715234+0000","last_undegraded":"2024-04-25T02:10:02.715234+0000","last_fullsized":"2024-04-25T02:10:02.715234+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708832+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:10:02.708832+0000","last_peered":"2024-04-25T02:10:02.708832+0000","last_clean":"2024-04-25T02:10:02.708832+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:10:02.708832+0000","last_undegraded":"2024-04-25T02:10:02.708832+0000","last_fullsized":"2024-04-25T02:10:02.708832+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715074+0000","last_change":"2024-04-25T02:10:02.364629+0000","last_active":"2024-04-25T02:10:02.715074+0000","last_peered":"2024-04-25T02:10:02.715074+0000","last_clean":"2024-04-25T02:10:02.715074+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:10:02.715074+0000","last_undegraded":"2024-04-25T02:10:02.715074+0000","last_fullsized":"2024-04-25T02:10:02.715074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751605+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:10:02.751605+0000","last_peered":"2024-04-25T02:10:02.751605+0000","last_clean":"2024-04-25T02:10:02.751605+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:10:02.751605+0000","last_undegraded":"2024-04-25T02:10:02.751605+0000","last_fullsized":"2024-04-25T02:10:02.751605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.709238+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:02.709238+0000","last_peered":"2024-04-25T02:10:02.709238+0000","last_clean":"2024-04-25T02:10:02.709238+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:02.709238+0000","last_undegraded":"2024-04-25T02:10:02.709238+0000","last_fullsized":"2024-04-25T02:10:02.709238+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.712258+0000","last_change":"2024-04-25T02:10:02.356105+0000","last_active":"2024-04-25T02:10:02.712258+0000","last_peered":"2024-04-25T02:10:02.712258+0000","last_clean":"2024-04-25T02:10:02.712258+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:10:02.712258+0000","last_undegraded":"2024-04-25T02:10:02.712258+0000","last_fullsized":"2024-04-25T02:10:02.712258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750390+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:10:02.750390+0000","last_peered":"2024-04-25T02:10:02.750390+0000","last_clean":"2024-04-25T02:10:02.750390+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:10:02.750390+0000","last_undegraded":"2024-04-25T02:10:02.750390+0000","last_fullsized":"2024-04-25T02:10:02.750390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.714745+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:02.714745+0000","last_peered":"2024-04-25T02:10:02.714745+0000","last_clean":"2024-04-25T02:10:02.714745+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:02.714745+0000","last_undegraded":"2024-04-25T02:10:02.714745+0000","last_fullsized":"2024-04-25T02:10:02.714745+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.710292+0000","last_change":"2024-04-25T02:10:02.360478+0000","last_active":"2024-04-25T02:10:02.710292+0000","last_peered":"2024-04-25T02:10:02.710292+0000","last_clean":"2024-04-25T02:10:02.710292+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:10:02.710292+0000","last_undegraded":"2024-04-25T02:10:02.710292+0000","last_fullsized":"2024-04-25T02:10:02.710292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.733559+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:10:02.733559+0000","last_peered":"2024-04-25T02:10:02.733559+0000","last_clean":"2024-04-25T02:10:02.733559+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:10:02.733559+0000","last_undegraded":"2024-04-25T02:10:02.733559+0000","last_fullsized":"2024-04-25T02:10:02.733559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743700+0000","last_change":"2024-04-25T02:10:02.370193+0000","last_active":"2024-04-25T02:10:02.743700+0000","last_peered":"2024-04-25T02:10:02.743700+0000","last_clean":"2024-04-25T02:10:02.743700+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:10:02.743700+0000","last_undegraded":"2024-04-25T02:10:02.743700+0000","last_fullsized":"2024-04-25T02:10:02.743700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.714484+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:10:02.714484+0000","last_peered":"2024-04-25T02:10:02.714484+0000","last_clean":"2024-04-25T02:10:02.714484+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:10:02.714484+0000","last_undegraded":"2024-04-25T02:10:02.714484+0000","last_fullsized":"2024-04-25T02:10:02.714484+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750824+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:10:02.750824+0000","last_peered":"2024-04-25T02:10:02.750824+0000","last_clean":"2024-04-25T02:10:02.750824+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:10:02.750824+0000","last_undegraded":"2024-04-25T02:10:02.750824+0000","last_fullsized":"2024-04-25T02:10:02.750824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.714476+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:02.714476+0000","last_peered":"2024-04-25T02:10:02.714476+0000","last_clean":"2024-04-25T02:10:02.714476+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:02.714476+0000","last_undegraded":"2024-04-25T02:10:02.714476+0000","last_fullsized":"2024-04-25T02:10:02.714476+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T02:10:03.707731+0000","last_change":"2024-04-25T02:10:02.370537+0000","last_active":"2024-04-25T02:10:03.707731+0000","last_peered":"2024-04-25T02:10:03.707731+0000","last_clean":"2024-04-25T02:10:03.707731+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:10:03.707731+0000","last_undegraded":"2024-04-25T02:10:03.707731+0000","last_fullsized":"2024-04-25T02:10:03.707731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752025+0000","last_change":"2024-04-25T02:10:02.748709+0000","last_active":"2024-04-25T02:10:02.752025+0000","last_peered":"2024-04-25T02:10:02.752025+0000","last_clean":"2024-04-25T02:10:02.752025+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:10:02.752025+0000","last_undegraded":"2024-04-25T02:10:02.752025+0000","last_fullsized":"2024-04-25T02:10:02.752025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750585+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:10:02.750585+0000","last_peered":"2024-04-25T02:10:02.750585+0000","last_clean":"2024-04-25T02:10:02.750585+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:10:02.750585+0000","last_undegraded":"2024-04-25T02:10:02.750585+0000","last_fullsized":"2024-04-25T02:10:02.750585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750180+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:10:02.750180+0000","last_peered":"2024-04-25T02:10:02.750180+0000","last_clean":"2024-04-25T02:10:02.750180+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:10:02.750180+0000","last_undegraded":"2024-04-25T02:10:02.750180+0000","last_fullsized":"2024-04-25T02:10:02.750180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.737684+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:10:02.737684+0000","last_peered":"2024-04-25T02:10:02.737684+0000","last_clean":"2024-04-25T02:10:02.737684+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:10:02.737684+0000","last_undegraded":"2024-04-25T02:10:02.737684+0000","last_fullsized":"2024-04-25T02:10:02.737684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751910+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:10:02.751910+0000","last_peered":"2024-04-25T02:10:02.751910+0000","last_clean":"2024-04-25T02:10:02.751910+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:10:02.751910+0000","last_undegraded":"2024-04-25T02:10:02.751910+0000","last_fullsized":"2024-04-25T02:10:02.751910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.745989+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:10:02.745989+0000","last_peered":"2024-04-25T02:10:02.745989+0000","last_clean":"2024-04-25T02:10:02.745989+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:10:02.745989+0000","last_undegraded":"2024-04-25T02:10:02.745989+0000","last_fullsized":"2024-04-25T02:10:02.745989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752054+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:10:02.752054+0000","last_peered":"2024-04-25T02:10:02.752054+0000","last_clean":"2024-04-25T02:10:02.752054+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:10:02.752054+0000","last_undegraded":"2024-04-25T02:10:02.752054+0000","last_fullsized":"2024-04-25T02:10:02.752054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.741785+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:10:02.741785+0000","last_peered":"2024-04-25T02:10:02.741785+0000","last_clean":"2024-04-25T02:10:02.741785+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:10:02.741785+0000","last_undegraded":"2024-04-25T02:10:02.741785+0000","last_fullsized":"2024-04-25T02:10:02.741785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751558+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:10:02.751558+0000","last_peered":"2024-04-25T02:10:02.751558+0000","last_clean":"2024-04-25T02:10:02.751558+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:10:02.751558+0000","last_undegraded":"2024-04-25T02:10:02.751558+0000","last_fullsized":"2024-04-25T02:10:02.751558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.744528+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:10:02.744528+0000","last_peered":"2024-04-25T02:10:02.744528+0000","last_clean":"2024-04-25T02:10:02.744528+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:10:02.744528+0000","last_undegraded":"2024-04-25T02:10:02.744528+0000","last_fullsized":"2024-04-25T02:10:02.744528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751847+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:10:02.751847+0000","last_peered":"2024-04-25T02:10:02.751847+0000","last_clean":"2024-04-25T02:10:02.751847+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:10:02.751847+0000","last_undegraded":"2024-04-25T02:10:02.751847+0000","last_fullsized":"2024-04-25T02:10:02.751847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.742731+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:10:02.742731+0000","last_peered":"2024-04-25T02:10:02.742731+0000","last_clean":"2024-04-25T02:10:02.742731+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:10:02.742731+0000","last_undegraded":"2024-04-25T02:10:02.742731+0000","last_fullsized":"2024-04-25T02:10:02.742731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751522+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:10:02.751522+0000","last_peered":"2024-04-25T02:10:02.751522+0000","last_clean":"2024-04-25T02:10:02.751522+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:10:02.751522+0000","last_undegraded":"2024-04-25T02:10:02.751522+0000","last_fullsized":"2024-04-25T02:10:02.751522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751431+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:10:02.751431+0000","last_peered":"2024-04-25T02:10:02.751431+0000","last_clean":"2024-04-25T02:10:02.751431+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:10:02.751431+0000","last_undegraded":"2024-04-25T02:10:02.751431+0000","last_fullsized":"2024-04-25T02:10:02.751431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750718+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:10:02.750718+0000","last_peered":"2024-04-25T02:10:02.750718+0000","last_clean":"2024-04-25T02:10:02.750718+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:10:02.750718+0000","last_undegraded":"2024-04-25T02:10:02.750718+0000","last_fullsized":"2024-04-25T02:10:02.750718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743979+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:10:02.743979+0000","last_peered":"2024-04-25T02:10:02.743979+0000","last_clean":"2024-04-25T02:10:02.743979+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:10:02.743979+0000","last_undegraded":"2024-04-25T02:10:02.743979+0000","last_fullsized":"2024-04-25T02:10:02.743979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]}]},{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":45214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:13.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:10:13.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48d63ad700 1 Processor -- start 2024-04-25T02:10:13.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48d63ad700 1 -- start start 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48d63ad700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f48d0065d90 0x7f48d00962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48d63ad700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d0096c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48d63ad700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d0064640 con 0x7f48d012f0d0 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48d63ad700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d0066170 con 0x7f48d0065d90 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48d63ad700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d0065040 con 0x7f48d00967d0 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48cf7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d0096c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48cf7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d0096c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57748/0 (socket says 172.21.15.78:57748) 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48cffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f48d0065d90 0x7f48d00962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.748+0000 7f48cf7fe700 1 -- 172.21.15.78:0/2596710628 learned_addr learned my addr 172.21.15.78:0/2596710628 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48cffff700 1 -- 172.21.15.78:0/2596710628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 msgr2=0x7f48d0096c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48cffff700 1 --2- 172.21.15.78:0/2596710628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d0096c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48cffff700 1 -- 172.21.15.78:0/2596710628 >> v1:172.21.15.78:6789/0 conn(0x7f48d012f0d0 legacy=0x7f48d01314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48ceffd700 1 -- 172.21.15.78:0/2596710628 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649478686 0 0) 0x7f48d0064640 con 0x7f48d012f0d0 2024-04-25T02:10:13.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48cffff700 1 -- 172.21.15.78:0/2596710628 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00652d0 con 0x7f48d0065d90 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48cffff700 1 --2- 172.21.15.78:0/2596710628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d0065d90 0x7f48d00962e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f48c0009760 tx=0x7f48c0009060).ready entity=mon.0 client_cookie=c6a03a1e6811c48c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48ceffd700 1 -- 172.21.15.78:0/2596710628 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00090d0 con 0x7f48d0065d90 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48ceffd700 1 -- 172.21.15.78:0/2596710628 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c000f510 con 0x7f48d0065d90 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48ceffd700 1 -- 172.21.15.78:0/2596710628 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000f890 con 0x7f48d0065d90 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48d63ad700 1 -- 172.21.15.78:0/2596710628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d0065d90 msgr2=0x7f48d00962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.749+0000 7f48d63ad700 1 --2- 172.21.15.78:0/2596710628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d0065d90 0x7f48d00962e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f48c0009760 tx=0x7f48c0009060).stop 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.750+0000 7f48d63ad700 1 -- 172.21.15.78:0/2596710628 shutdown_connections 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.750+0000 7f48d63ad700 1 --2- 172.21.15.78:0/2596710628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d0065d90 0x7f48d00962e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.750+0000 7f48d63ad700 1 --2- 172.21.15.78:0/2596710628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d0096c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.750+0000 7f48d63ad700 1 -- 172.21.15.78:0/2596710628 >> 172.21.15.78:0/2596710628 conn(0x7f48d009c550 msgr2=0x7f48d00983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.750+0000 7f48d63ad700 1 -- 172.21.15.78:0/2596710628 shutdown_connections 2024-04-25T02:10:13.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.750+0000 7f48d63ad700 1 -- 172.21.15.78:0/2596710628 wait complete. 2024-04-25T02:10:13.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.750+0000 7f48d63ad700 1 Processor -- start 2024-04-25T02:10:13.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48d63ad700 1 -- start start 2024-04-25T02:10:13.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48d63ad700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d011dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48d63ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d012f0d0 0x7f48d0119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48d63ad700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48d011a2a0 0x7f48d011a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48d63ad700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d011ac10 con 0x7f48d012f0d0 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48d63ad700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d011d260 con 0x7f48d00967d0 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48d63ad700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00676c0 con 0x7f48d011a2a0 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d011dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d011dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57750/0 (socket says 172.21.15.78:57750) 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cffff700 1 -- 172.21.15.78:0/2493558907 learned_addr learned my addr 172.21.15.78:0/2493558907 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48d494a700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48d011a2a0 0x7f48d011a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cf7fe700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d012f0d0 0x7f48d0119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cffff700 1 -- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48d011a2a0 msgr2=0x7f48d011a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cffff700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48d011a2a0 0x7f48d011a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cffff700 1 -- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d012f0d0 msgr2=0x7f48d0119db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cffff700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d012f0d0 0x7f48d0119db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cffff700 1 -- 172.21.15.78:0/2493558907 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c00092a0 con 0x7f48d00967d0 2024-04-25T02:10:13.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cf7fe700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d012f0d0 0x7f48d0119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:13.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.751+0000 7f48cffff700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d011dd00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f48c0009e00 tx=0x7f48c0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:13.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.752+0000 7f48ccff9700 1 -- 172.21.15.78:0/2493558907 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000f890 con 0x7f48d00967d0 2024-04-25T02:10:13.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.752+0000 7f48ccff9700 1 -- 172.21.15.78:0/2493558907 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c0006910 con 0x7f48d00967d0 2024-04-25T02:10:13.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.752+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d0064d40 con 0x7f48d00967d0 2024-04-25T02:10:13.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.752+0000 7f48ccff9700 1 -- 172.21.15.78:0/2493558907 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000fea0 con 0x7f48d00967d0 2024-04-25T02:10:13.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.752+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d011b8f0 con 0x7f48d00967d0 2024-04-25T02:10:13.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.752+0000 7f48ccff9700 1 -- 172.21.15.78:0/2493558907 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f48c001b620 con 0x7f48d00967d0 2024-04-25T02:10:13.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.753+0000 7f48ccff9700 1 -- 172.21.15.78:0/2493558907 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f48c003c950 con 0x7f48d00967d0 2024-04-25T02:10:13.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.753+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d0098af0 con 0x7f48d00967d0 2024-04-25T02:10:13.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.757+0000 7f48ccff9700 1 -- 172.21.15.78:0/2493558907 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f48c0028020 con 0x7f48d00967d0 2024-04-25T02:10:13.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.912+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48d0046ce0 con 0x7f48bc02bd00 2024-04-25T02:10:13.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.918+0000 7f48ccff9700 1 -- 172.21.15.78:0/2493558907 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249918 (unknown 2965378022 0 1222265020) 0x7f48d0046ce0 con 0x7f48bc02bd00 2024-04-25T02:10:13.928 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:13.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 >> v1:172.21.15.78:6816/46507 conn(0x7f48bc02bd00 legacy=0x7f48bc02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 msgr2=0x7f48d011dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:13.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d011dd00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f48c0009e00 tx=0x7f48c0017000).stop 2024-04-25T02:10:13.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 shutdown_connections 2024-04-25T02:10:13.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f48d011a2a0 0x7f48d011a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48d00967d0 0x7f48d011dd00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 --2- 172.21.15.78:0/2493558907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48d012f0d0 0x7f48d0119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:13.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 >> 172.21.15.78:0/2493558907 conn(0x7f48d0065d90 msgr2=0x7f48d0113f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:13.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 shutdown_connections 2024-04-25T02:10:13.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:13.921+0000 7f48d63ad700 1 -- 172.21.15.78:0/2493558907 wait complete. 2024-04-25T02:10:13.931 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:10:13.940 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T02:10:12.198719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188992,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298368,"statfs":{"total":386547056640,"available":385329528832,"internally_reserved":0,"allocated":622592,"data_stored":182668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000797"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752012+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:10:02.752012+0000","last_peered":"2024-04-25T02:10:02.752012+0000","last_clean":"2024-04-25T02:10:02.752012+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:10:02.752012+0000","last_undegraded":"2024-04-25T02:10:02.752012+0000","last_fullsized":"2024-04-25T02:10:02.752012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751974+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:10:02.751974+0000","last_peered":"2024-04-25T02:10:02.751974+0000","last_clean":"2024-04-25T02:10:02.751974+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:10:02.751974+0000","last_undegraded":"2024-04-25T02:10:02.751974+0000","last_fullsized":"2024-04-25T02:10:02.751974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750337+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:10:02.750337+0000","last_peered":"2024-04-25T02:10:02.750337+0000","last_clean":"2024-04-25T02:10:02.750337+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:10:02.750337+0000","last_undegraded":"2024-04-25T02:10:02.750337+0000","last_fullsized":"2024-04-25T02:10:02.750337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751731+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:10:02.751731+0000","last_peered":"2024-04-25T02:10:02.751731+0000","last_clean":"2024-04-25T02:10:02.751731+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:10:02.751731+0000","last_undegraded":"2024-04-25T02:10:02.751731+0000","last_fullsized":"2024-04-25T02:10:02.751731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751364+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:10:02.751364+0000","last_peered":"2024-04-25T02:10:02.751364+0000","last_clean":"2024-04-25T02:10:02.751364+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:10:02.751364+0000","last_undegraded":"2024-04-25T02:10:02.751364+0000","last_fullsized":"2024-04-25T02:10:02.751364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750560+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:10:02.750560+0000","last_peered":"2024-04-25T02:10:02.750560+0000","last_clean":"2024-04-25T02:10:02.750560+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:10:02.750560+0000","last_undegraded":"2024-04-25T02:10:02.750560+0000","last_fullsized":"2024-04-25T02:10:02.750560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750799+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:10:02.750799+0000","last_peered":"2024-04-25T02:10:02.750799+0000","last_clean":"2024-04-25T02:10:02.750799+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:10:02.750799+0000","last_undegraded":"2024-04-25T02:10:02.750799+0000","last_fullsized":"2024-04-25T02:10:02.750799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.740931+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:10:02.740931+0000","last_peered":"2024-04-25T02:10:02.740931+0000","last_clean":"2024-04-25T02:10:02.740931+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:10:02.740931+0000","last_undegraded":"2024-04-25T02:10:02.740931+0000","last_fullsized":"2024-04-25T02:10:02.740931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751938+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:10:02.751938+0000","last_peered":"2024-04-25T02:10:02.751938+0000","last_clean":"2024-04-25T02:10:02.751938+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:10:02.751938+0000","last_undegraded":"2024-04-25T02:10:02.751938+0000","last_fullsized":"2024-04-25T02:10:02.751938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743408+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:10:02.743408+0000","last_peered":"2024-04-25T02:10:02.743408+0000","last_clean":"2024-04-25T02:10:02.743408+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:10:02.743408+0000","last_undegraded":"2024-04-25T02:10:02.743408+0000","last_fullsized":"2024-04-25T02:10:02.743408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.742455+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:10:02.742455+0000","last_peered":"2024-04-25T02:10:02.742455+0000","last_clean":"2024-04-25T02:10:02.742455+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:10:02.742455+0000","last_undegraded":"2024-04-25T02:10:02.742455+0000","last_fullsized":"2024-04-25T02:10:02.742455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752082+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:10:02.752082+0000","last_peered":"2024-04-25T02:10:02.752082+0000","last_clean":"2024-04-25T02:10:02.752082+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:10:02.752082+0000","last_undegraded":"2024-04-25T02:10:02.752082+0000","last_fullsized":"2024-04-25T02:10:02.752082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751894+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:10:02.751894+0000","last_peered":"2024-04-25T02:10:02.751894+0000","last_clean":"2024-04-25T02:10:02.751894+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:10:02.751894+0000","last_undegraded":"2024-04-25T02:10:02.751894+0000","last_fullsized":"2024-04-25T02:10:02.751894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.741478+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:10:02.741478+0000","last_peered":"2024-04-25T02:10:02.741478+0000","last_clean":"2024-04-25T02:10:02.741478+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:10:02.741478+0000","last_undegraded":"2024-04-25T02:10:02.741478+0000","last_fullsized":"2024-04-25T02:10:02.741478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.735925+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:10:02.735925+0000","last_peered":"2024-04-25T02:10:02.735925+0000","last_clean":"2024-04-25T02:10:02.735925+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:10:02.735925+0000","last_undegraded":"2024-04-25T02:10:02.735925+0000","last_fullsized":"2024-04-25T02:10:02.735925+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750880+0000","last_change":"2024-04-25T02:10:02.735597+0000","last_active":"2024-04-25T02:10:02.750880+0000","last_peered":"2024-04-25T02:10:02.750880+0000","last_clean":"2024-04-25T02:10:02.750880+0000","last_became_active":"2024-04-25T02:10:02.735267+0000","last_became_peered":"2024-04-25T02:10:02.735267+0000","last_unstale":"2024-04-25T02:10:02.750880+0000","last_undegraded":"2024-04-25T02:10:02.750880+0000","last_fullsized":"2024-04-25T02:10:02.750880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751917+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:10:02.751917+0000","last_peered":"2024-04-25T02:10:02.751917+0000","last_clean":"2024-04-25T02:10:02.751917+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:10:02.751917+0000","last_undegraded":"2024-04-25T02:10:02.751917+0000","last_fullsized":"2024-04-25T02:10:02.751917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.733646+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:10:02.733646+0000","last_peered":"2024-04-25T02:10:02.733646+0000","last_clean":"2024-04-25T02:10:02.733646+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:10:02.733646+0000","last_undegraded":"2024-04-25T02:10:02.733646+0000","last_fullsized":"2024-04-25T02:10:02.733646+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752004+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:10:02.752004+0000","last_peered":"2024-04-25T02:10:02.752004+0000","last_clean":"2024-04-25T02:10:02.752004+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:10:02.752004+0000","last_undegraded":"2024-04-25T02:10:02.752004+0000","last_fullsized":"2024-04-25T02:10:02.752004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.744013+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:10:02.744013+0000","last_peered":"2024-04-25T02:10:02.744013+0000","last_clean":"2024-04-25T02:10:02.744013+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:10:02.744013+0000","last_undegraded":"2024-04-25T02:10:02.744013+0000","last_fullsized":"2024-04-25T02:10:02.744013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743911+0000","last_change":"2024-04-25T02:10:02.737504+0000","last_active":"2024-04-25T02:10:02.743911+0000","last_peered":"2024-04-25T02:10:02.743911+0000","last_clean":"2024-04-25T02:10:02.743911+0000","last_became_active":"2024-04-25T02:10:02.737240+0000","last_became_peered":"2024-04-25T02:10:02.737240+0000","last_unstale":"2024-04-25T02:10:02.743911+0000","last_undegraded":"2024-04-25T02:10:02.743911+0000","last_fullsized":"2024-04-25T02:10:02.743911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.735754+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:10:02.735754+0000","last_peered":"2024-04-25T02:10:02.735754+0000","last_clean":"2024-04-25T02:10:02.735754+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:10:02.735754+0000","last_undegraded":"2024-04-25T02:10:02.735754+0000","last_fullsized":"2024-04-25T02:10:02.735754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751571+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:10:02.751571+0000","last_peered":"2024-04-25T02:10:02.751571+0000","last_clean":"2024-04-25T02:10:02.751571+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:10:02.751571+0000","last_undegraded":"2024-04-25T02:10:02.751571+0000","last_fullsized":"2024-04-25T02:10:02.751571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.742751+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:10:02.742751+0000","last_peered":"2024-04-25T02:10:02.742751+0000","last_clean":"2024-04-25T02:10:02.742751+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:10:02.742751+0000","last_undegraded":"2024-04-25T02:10:02.742751+0000","last_fullsized":"2024-04-25T02:10:02.742751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750687+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:10:02.750687+0000","last_peered":"2024-04-25T02:10:02.750687+0000","last_clean":"2024-04-25T02:10:02.750687+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:10:02.750687+0000","last_undegraded":"2024-04-25T02:10:02.750687+0000","last_fullsized":"2024-04-25T02:10:02.750687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743438+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:10:02.743438+0000","last_peered":"2024-04-25T02:10:02.743438+0000","last_clean":"2024-04-25T02:10:02.743438+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:10:02.743438+0000","last_undegraded":"2024-04-25T02:10:02.743438+0000","last_fullsized":"2024-04-25T02:10:02.743438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751844+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:10:02.751844+0000","last_peered":"2024-04-25T02:10:02.751844+0000","last_clean":"2024-04-25T02:10:02.751844+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:10:02.751844+0000","last_undegraded":"2024-04-25T02:10:02.751844+0000","last_fullsized":"2024-04-25T02:10:02.751844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.730800+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:10:02.730800+0000","last_peered":"2024-04-25T02:10:02.730800+0000","last_clean":"2024-04-25T02:10:02.730800+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:10:02.730800+0000","last_undegraded":"2024-04-25T02:10:02.730800+0000","last_fullsized":"2024-04-25T02:10:02.730800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750605+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:10:02.750605+0000","last_peered":"2024-04-25T02:10:02.750605+0000","last_clean":"2024-04-25T02:10:02.750605+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:10:02.750605+0000","last_undegraded":"2024-04-25T02:10:02.750605+0000","last_fullsized":"2024-04-25T02:10:02.750605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.711548+0000","last_change":"2024-04-25T02:10:02.370405+0000","last_active":"2024-04-25T02:10:02.711548+0000","last_peered":"2024-04-25T02:10:02.711548+0000","last_clean":"2024-04-25T02:10:02.711548+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:10:02.711548+0000","last_undegraded":"2024-04-25T02:10:02.711548+0000","last_fullsized":"2024-04-25T02:10:02.711548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750370+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:10:02.750370+0000","last_peered":"2024-04-25T02:10:02.750370+0000","last_clean":"2024-04-25T02:10:02.750370+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:10:02.750370+0000","last_undegraded":"2024-04-25T02:10:02.750370+0000","last_fullsized":"2024-04-25T02:10:02.750370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.709328+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:10:02.709328+0000","last_peered":"2024-04-25T02:10:02.709328+0000","last_clean":"2024-04-25T02:10:02.709328+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:10:02.709328+0000","last_undegraded":"2024-04-25T02:10:02.709328+0000","last_fullsized":"2024-04-25T02:10:02.709328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751527+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:10:02.751527+0000","last_peered":"2024-04-25T02:10:02.751527+0000","last_clean":"2024-04-25T02:10:02.751527+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:10:02.751527+0000","last_undegraded":"2024-04-25T02:10:02.751527+0000","last_fullsized":"2024-04-25T02:10:02.751527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.713945+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:10:02.713945+0000","last_peered":"2024-04-25T02:10:02.713945+0000","last_clean":"2024-04-25T02:10:02.713945+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:10:02.713945+0000","last_undegraded":"2024-04-25T02:10:02.713945+0000","last_fullsized":"2024-04-25T02:10:02.713945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750844+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:10:02.750844+0000","last_peered":"2024-04-25T02:10:02.750844+0000","last_clean":"2024-04-25T02:10:02.750844+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:10:02.750844+0000","last_undegraded":"2024-04-25T02:10:02.750844+0000","last_fullsized":"2024-04-25T02:10:02.750844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.712697+0000","last_change":"2024-04-25T02:10:02.367526+0000","last_active":"2024-04-25T02:10:02.712697+0000","last_peered":"2024-04-25T02:10:02.712697+0000","last_clean":"2024-04-25T02:10:02.712697+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:10:02.712697+0000","last_undegraded":"2024-04-25T02:10:02.712697+0000","last_fullsized":"2024-04-25T02:10:02.712697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751541+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:10:02.751541+0000","last_peered":"2024-04-25T02:10:02.751541+0000","last_clean":"2024-04-25T02:10:02.751541+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:10:02.751541+0000","last_undegraded":"2024-04-25T02:10:02.751541+0000","last_fullsized":"2024-04-25T02:10:02.751541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751247+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:10:02.751247+0000","last_peered":"2024-04-25T02:10:02.751247+0000","last_clean":"2024-04-25T02:10:02.751247+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:10:02.751247+0000","last_undegraded":"2024-04-25T02:10:02.751247+0000","last_fullsized":"2024-04-25T02:10:02.751247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.747657+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:10:02.747657+0000","last_peered":"2024-04-25T02:10:02.747657+0000","last_clean":"2024-04-25T02:10:02.747657+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:10:02.747657+0000","last_undegraded":"2024-04-25T02:10:02.747657+0000","last_fullsized":"2024-04-25T02:10:02.747657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.754250+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:10:02.754250+0000","last_peered":"2024-04-25T02:10:02.754250+0000","last_clean":"2024-04-25T02:10:02.754250+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:10:02.754250+0000","last_undegraded":"2024-04-25T02:10:02.754250+0000","last_fullsized":"2024-04-25T02:10:02.754250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751878+0000","last_change":"2024-04-25T02:10:02.742932+0000","last_active":"2024-04-25T02:10:02.751878+0000","last_peered":"2024-04-25T02:10:02.751878+0000","last_clean":"2024-04-25T02:10:02.751878+0000","last_became_active":"2024-04-25T02:10:02.742365+0000","last_became_peered":"2024-04-25T02:10:02.742365+0000","last_unstale":"2024-04-25T02:10:02.751878+0000","last_undegraded":"2024-04-25T02:10:02.751878+0000","last_fullsized":"2024-04-25T02:10:02.751878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750666+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:10:02.750666+0000","last_peered":"2024-04-25T02:10:02.750666+0000","last_clean":"2024-04-25T02:10:02.750666+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:10:02.750666+0000","last_undegraded":"2024-04-25T02:10:02.750666+0000","last_fullsized":"2024-04-25T02:10:02.750666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751840+0000","last_change":"2024-04-25T02:10:02.739416+0000","last_active":"2024-04-25T02:10:02.751840+0000","last_peered":"2024-04-25T02:10:02.751840+0000","last_clean":"2024-04-25T02:10:02.751840+0000","last_became_active":"2024-04-25T02:10:02.739082+0000","last_became_peered":"2024-04-25T02:10:02.739082+0000","last_unstale":"2024-04-25T02:10:02.751840+0000","last_undegraded":"2024-04-25T02:10:02.751840+0000","last_fullsized":"2024-04-25T02:10:02.751840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.713109+0000","last_change":"2024-04-25T02:10:02.370169+0000","last_active":"2024-04-25T02:10:02.713109+0000","last_peered":"2024-04-25T02:10:02.713109+0000","last_clean":"2024-04-25T02:10:02.713109+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:10:02.713109+0000","last_undegraded":"2024-04-25T02:10:02.713109+0000","last_fullsized":"2024-04-25T02:10:02.713109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751863+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:10:02.751863+0000","last_peered":"2024-04-25T02:10:02.751863+0000","last_clean":"2024-04-25T02:10:02.751863+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:10:02.751863+0000","last_undegraded":"2024-04-25T02:10:02.751863+0000","last_fullsized":"2024-04-25T02:10:02.751863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.718278+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:10:02.718278+0000","last_peered":"2024-04-25T02:10:02.718278+0000","last_clean":"2024-04-25T02:10:02.718278+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:10:02.718278+0000","last_undegraded":"2024-04-25T02:10:02.718278+0000","last_fullsized":"2024-04-25T02:10:02.718278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751409+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:10:02.751409+0000","last_peered":"2024-04-25T02:10:02.751409+0000","last_clean":"2024-04-25T02:10:02.751409+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:10:02.751409+0000","last_undegraded":"2024-04-25T02:10:02.751409+0000","last_fullsized":"2024-04-25T02:10:02.751409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.737251+0000","last_change":"2024-04-25T02:10:02.360557+0000","last_active":"2024-04-25T02:10:02.737251+0000","last_peered":"2024-04-25T02:10:02.737251+0000","last_clean":"2024-04-25T02:10:02.737251+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:10:02.737251+0000","last_undegraded":"2024-04-25T02:10:02.737251+0000","last_fullsized":"2024-04-25T02:10:02.737251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750758+0000","last_change":"2024-04-25T02:10:02.738439+0000","last_active":"2024-04-25T02:10:02.750758+0000","last_peered":"2024-04-25T02:10:02.750758+0000","last_clean":"2024-04-25T02:10:02.750758+0000","last_became_active":"2024-04-25T02:10:02.738074+0000","last_became_peered":"2024-04-25T02:10:02.738074+0000","last_unstale":"2024-04-25T02:10:02.750758+0000","last_undegraded":"2024-04-25T02:10:02.750758+0000","last_fullsized":"2024-04-25T02:10:02.750758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.740833+0000","last_change":"2024-04-25T02:10:02.370637+0000","last_active":"2024-04-25T02:10:02.740833+0000","last_peered":"2024-04-25T02:10:02.740833+0000","last_clean":"2024-04-25T02:10:02.740833+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:10:02.740833+0000","last_undegraded":"2024-04-25T02:10:02.740833+0000","last_fullsized":"2024-04-25T02:10:02.740833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750862+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:10:02.750862+0000","last_peered":"2024-04-25T02:10:02.750862+0000","last_clean":"2024-04-25T02:10:02.750862+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:10:02.750862+0000","last_undegraded":"2024-04-25T02:10:02.750862+0000","last_fullsized":"2024-04-25T02:10:02.750862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.728279+0000","last_change":"2024-04-25T02:10:02.358829+0000","last_active":"2024-04-25T02:10:02.728279+0000","last_peered":"2024-04-25T02:10:02.728279+0000","last_clean":"2024-04-25T02:10:02.728279+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:10:02.728279+0000","last_undegraded":"2024-04-25T02:10:02.728279+0000","last_fullsized":"2024-04-25T02:10:02.728279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.745845+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:10:02.745845+0000","last_peered":"2024-04-25T02:10:02.745845+0000","last_clean":"2024-04-25T02:10:02.745845+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:10:02.745845+0000","last_undegraded":"2024-04-25T02:10:02.745845+0000","last_fullsized":"2024-04-25T02:10:02.745845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750283+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:10:02.750283+0000","last_peered":"2024-04-25T02:10:02.750283+0000","last_clean":"2024-04-25T02:10:02.750283+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:10:02.750283+0000","last_undegraded":"2024-04-25T02:10:02.750283+0000","last_fullsized":"2024-04-25T02:10:02.750283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752036+0000","last_change":"2024-04-25T02:10:02.744548+0000","last_active":"2024-04-25T02:10:02.752036+0000","last_peered":"2024-04-25T02:10:02.752036+0000","last_clean":"2024-04-25T02:10:02.752036+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:10:02.752036+0000","last_undegraded":"2024-04-25T02:10:02.752036+0000","last_fullsized":"2024-04-25T02:10:02.752036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.719975+0000","last_change":"2024-04-25T02:10:02.371223+0000","last_active":"2024-04-25T02:10:02.719975+0000","last_peered":"2024-04-25T02:10:02.719975+0000","last_clean":"2024-04-25T02:10:02.719975+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:10:02.719975+0000","last_undegraded":"2024-04-25T02:10:02.719975+0000","last_fullsized":"2024-04-25T02:10:02.719975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751343+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:10:02.751343+0000","last_peered":"2024-04-25T02:10:02.751343+0000","last_clean":"2024-04-25T02:10:02.751343+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:10:02.751343+0000","last_undegraded":"2024-04-25T02:10:02.751343+0000","last_fullsized":"2024-04-25T02:10:02.751343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750444+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:10:02.750444+0000","last_peered":"2024-04-25T02:10:02.750444+0000","last_clean":"2024-04-25T02:10:02.750444+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:10:02.750444+0000","last_undegraded":"2024-04-25T02:10:02.750444+0000","last_fullsized":"2024-04-25T02:10:02.750444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751251+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:10:02.751251+0000","last_peered":"2024-04-25T02:10:02.751251+0000","last_clean":"2024-04-25T02:10:02.751251+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:10:02.751251+0000","last_undegraded":"2024-04-25T02:10:02.751251+0000","last_fullsized":"2024-04-25T02:10:02.751251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715303+0000","last_change":"2024-04-25T02:10:02.367348+0000","last_active":"2024-04-25T02:10:02.715303+0000","last_peered":"2024-04-25T02:10:02.715303+0000","last_clean":"2024-04-25T02:10:02.715303+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:10:02.715303+0000","last_undegraded":"2024-04-25T02:10:02.715303+0000","last_fullsized":"2024-04-25T02:10:02.715303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751592+0000","last_change":"2024-04-25T02:10:02.738639+0000","last_active":"2024-04-25T02:10:02.751592+0000","last_peered":"2024-04-25T02:10:02.751592+0000","last_clean":"2024-04-25T02:10:02.751592+0000","last_became_active":"2024-04-25T02:10:02.738040+0000","last_became_peered":"2024-04-25T02:10:02.738040+0000","last_unstale":"2024-04-25T02:10:02.751592+0000","last_undegraded":"2024-04-25T02:10:02.751592+0000","last_fullsized":"2024-04-25T02:10:02.751592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.716182+0000","last_change":"2024-04-25T02:10:02.360699+0000","last_active":"2024-04-25T02:10:02.716182+0000","last_peered":"2024-04-25T02:10:02.716182+0000","last_clean":"2024-04-25T02:10:02.716182+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:10:02.716182+0000","last_undegraded":"2024-04-25T02:10:02.716182+0000","last_fullsized":"2024-04-25T02:10:02.716182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751951+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:10:02.751951+0000","last_peered":"2024-04-25T02:10:02.751951+0000","last_clean":"2024-04-25T02:10:02.751951+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:10:02.751951+0000","last_undegraded":"2024-04-25T02:10:02.751951+0000","last_fullsized":"2024-04-25T02:10:02.751951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708856+0000","last_change":"2024-04-25T02:10:02.365974+0000","last_active":"2024-04-25T02:10:02.708856+0000","last_peered":"2024-04-25T02:10:02.708856+0000","last_clean":"2024-04-25T02:10:02.708856+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:10:02.708856+0000","last_undegraded":"2024-04-25T02:10:02.708856+0000","last_fullsized":"2024-04-25T02:10:02.708856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750664+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:10:02.750664+0000","last_peered":"2024-04-25T02:10:02.750664+0000","last_clean":"2024-04-25T02:10:02.750664+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:10:02.750664+0000","last_undegraded":"2024-04-25T02:10:02.750664+0000","last_fullsized":"2024-04-25T02:10:02.750664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.711566+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:10:02.711566+0000","last_peered":"2024-04-25T02:10:02.711566+0000","last_clean":"2024-04-25T02:10:02.711566+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:10:02.711566+0000","last_undegraded":"2024-04-25T02:10:02.711566+0000","last_fullsized":"2024-04-25T02:10:02.711566+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.711916+0000","last_change":"2024-04-25T02:10:02.367538+0000","last_active":"2024-04-25T02:10:02.711916+0000","last_peered":"2024-04-25T02:10:02.711916+0000","last_clean":"2024-04-25T02:10:02.711916+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:10:02.711916+0000","last_undegraded":"2024-04-25T02:10:02.711916+0000","last_fullsized":"2024-04-25T02:10:02.711916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.747676+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:10:02.747676+0000","last_peered":"2024-04-25T02:10:02.747676+0000","last_clean":"2024-04-25T02:10:02.747676+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:10:02.747676+0000","last_undegraded":"2024-04-25T02:10:02.747676+0000","last_fullsized":"2024-04-25T02:10:02.747676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715220+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:02.715220+0000","last_peered":"2024-04-25T02:10:02.715220+0000","last_clean":"2024-04-25T02:10:02.715220+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:02.715220+0000","last_undegraded":"2024-04-25T02:10:02.715220+0000","last_fullsized":"2024-04-25T02:10:02.715220+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.719601+0000","last_change":"2024-04-25T02:10:02.360464+0000","last_active":"2024-04-25T02:10:02.719601+0000","last_peered":"2024-04-25T02:10:02.719601+0000","last_clean":"2024-04-25T02:10:02.719601+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:10:02.719601+0000","last_undegraded":"2024-04-25T02:10:02.719601+0000","last_fullsized":"2024-04-25T02:10:02.719601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743997+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:10:02.743997+0000","last_peered":"2024-04-25T02:10:02.743997+0000","last_clean":"2024-04-25T02:10:02.743997+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:10:02.743997+0000","last_undegraded":"2024-04-25T02:10:02.743997+0000","last_fullsized":"2024-04-25T02:10:02.743997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708934+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:10:02.708934+0000","last_peered":"2024-04-25T02:10:02.708934+0000","last_clean":"2024-04-25T02:10:02.708934+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:10:02.708934+0000","last_undegraded":"2024-04-25T02:10:02.708934+0000","last_fullsized":"2024-04-25T02:10:02.708934+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708931+0000","last_change":"2024-04-25T02:10:02.361010+0000","last_active":"2024-04-25T02:10:02.708931+0000","last_peered":"2024-04-25T02:10:02.708931+0000","last_clean":"2024-04-25T02:10:02.708931+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:10:02.708931+0000","last_undegraded":"2024-04-25T02:10:02.708931+0000","last_fullsized":"2024-04-25T02:10:02.708931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.740726+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:10:02.740726+0000","last_peered":"2024-04-25T02:10:02.740726+0000","last_clean":"2024-04-25T02:10:02.740726+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:10:02.740726+0000","last_undegraded":"2024-04-25T02:10:02.740726+0000","last_fullsized":"2024-04-25T02:10:02.740726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715234+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:02.715234+0000","last_peered":"2024-04-25T02:10:02.715234+0000","last_clean":"2024-04-25T02:10:02.715234+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:02.715234+0000","last_undegraded":"2024-04-25T02:10:02.715234+0000","last_fullsized":"2024-04-25T02:10:02.715234+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.708832+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:10:02.708832+0000","last_peered":"2024-04-25T02:10:02.708832+0000","last_clean":"2024-04-25T02:10:02.708832+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:10:02.708832+0000","last_undegraded":"2024-04-25T02:10:02.708832+0000","last_fullsized":"2024-04-25T02:10:02.708832+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.715074+0000","last_change":"2024-04-25T02:10:02.364629+0000","last_active":"2024-04-25T02:10:02.715074+0000","last_peered":"2024-04-25T02:10:02.715074+0000","last_clean":"2024-04-25T02:10:02.715074+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:10:02.715074+0000","last_undegraded":"2024-04-25T02:10:02.715074+0000","last_fullsized":"2024-04-25T02:10:02.715074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751605+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:10:02.751605+0000","last_peered":"2024-04-25T02:10:02.751605+0000","last_clean":"2024-04-25T02:10:02.751605+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:10:02.751605+0000","last_undegraded":"2024-04-25T02:10:02.751605+0000","last_fullsized":"2024-04-25T02:10:02.751605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.709238+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:02.709238+0000","last_peered":"2024-04-25T02:10:02.709238+0000","last_clean":"2024-04-25T02:10:02.709238+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:02.709238+0000","last_undegraded":"2024-04-25T02:10:02.709238+0000","last_fullsized":"2024-04-25T02:10:02.709238+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.712258+0000","last_change":"2024-04-25T02:10:02.356105+0000","last_active":"2024-04-25T02:10:02.712258+0000","last_peered":"2024-04-25T02:10:02.712258+0000","last_clean":"2024-04-25T02:10:02.712258+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:10:02.712258+0000","last_undegraded":"2024-04-25T02:10:02.712258+0000","last_fullsized":"2024-04-25T02:10:02.712258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750390+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:10:02.750390+0000","last_peered":"2024-04-25T02:10:02.750390+0000","last_clean":"2024-04-25T02:10:02.750390+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:10:02.750390+0000","last_undegraded":"2024-04-25T02:10:02.750390+0000","last_fullsized":"2024-04-25T02:10:02.750390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.714745+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:02.714745+0000","last_peered":"2024-04-25T02:10:02.714745+0000","last_clean":"2024-04-25T02:10:02.714745+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:02.714745+0000","last_undegraded":"2024-04-25T02:10:02.714745+0000","last_fullsized":"2024-04-25T02:10:02.714745+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.710292+0000","last_change":"2024-04-25T02:10:02.360478+0000","last_active":"2024-04-25T02:10:02.710292+0000","last_peered":"2024-04-25T02:10:02.710292+0000","last_clean":"2024-04-25T02:10:02.710292+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:10:02.710292+0000","last_undegraded":"2024-04-25T02:10:02.710292+0000","last_fullsized":"2024-04-25T02:10:02.710292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.733559+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:10:02.733559+0000","last_peered":"2024-04-25T02:10:02.733559+0000","last_clean":"2024-04-25T02:10:02.733559+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:10:02.733559+0000","last_undegraded":"2024-04-25T02:10:02.733559+0000","last_fullsized":"2024-04-25T02:10:02.733559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743700+0000","last_change":"2024-04-25T02:10:02.370193+0000","last_active":"2024-04-25T02:10:02.743700+0000","last_peered":"2024-04-25T02:10:02.743700+0000","last_clean":"2024-04-25T02:10:02.743700+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:10:02.743700+0000","last_undegraded":"2024-04-25T02:10:02.743700+0000","last_fullsized":"2024-04-25T02:10:02.743700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.714484+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:10:02.714484+0000","last_peered":"2024-04-25T02:10:02.714484+0000","last_clean":"2024-04-25T02:10:02.714484+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:10:02.714484+0000","last_undegraded":"2024-04-25T02:10:02.714484+0000","last_fullsized":"2024-04-25T02:10:02.714484+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750824+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:10:02.750824+0000","last_peered":"2024-04-25T02:10:02.750824+0000","last_clean":"2024-04-25T02:10:02.750824+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:10:02.750824+0000","last_undegraded":"2024-04-25T02:10:02.750824+0000","last_fullsized":"2024-04-25T02:10:02.750824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.714476+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:02.714476+0000","last_peered":"2024-04-25T02:10:02.714476+0000","last_clean":"2024-04-25T02:10:02.714476+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:02.714476+0000","last_undegraded":"2024-04-25T02:10:02.714476+0000","last_fullsized":"2024-04-25T02:10:02.714476+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T02:10:03.707731+0000","last_change":"2024-04-25T02:10:02.370537+0000","last_active":"2024-04-25T02:10:03.707731+0000","last_peered":"2024-04-25T02:10:03.707731+0000","last_clean":"2024-04-25T02:10:03.707731+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:10:03.707731+0000","last_undegraded":"2024-04-25T02:10:03.707731+0000","last_fullsized":"2024-04-25T02:10:03.707731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752025+0000","last_change":"2024-04-25T02:10:02.748709+0000","last_active":"2024-04-25T02:10:02.752025+0000","last_peered":"2024-04-25T02:10:02.752025+0000","last_clean":"2024-04-25T02:10:02.752025+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:10:02.752025+0000","last_undegraded":"2024-04-25T02:10:02.752025+0000","last_fullsized":"2024-04-25T02:10:02.752025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750585+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:10:02.750585+0000","last_peered":"2024-04-25T02:10:02.750585+0000","last_clean":"2024-04-25T02:10:02.750585+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:10:02.750585+0000","last_undegraded":"2024-04-25T02:10:02.750585+0000","last_fullsized":"2024-04-25T02:10:02.750585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750180+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:10:02.750180+0000","last_peered":"2024-04-25T02:10:02.750180+0000","last_clean":"2024-04-25T02:10:02.750180+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:10:02.750180+0000","last_undegraded":"2024-04-25T02:10:02.750180+0000","last_fullsized":"2024-04-25T02:10:02.750180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.737684+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:10:02.737684+0000","last_peered":"2024-04-25T02:10:02.737684+0000","last_clean":"2024-04-25T02:10:02.737684+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:10:02.737684+0000","last_undegraded":"2024-04-25T02:10:02.737684+0000","last_fullsized":"2024-04-25T02:10:02.737684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751910+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:10:02.751910+0000","last_peered":"2024-04-25T02:10:02.751910+0000","last_clean":"2024-04-25T02:10:02.751910+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:10:02.751910+0000","last_undegraded":"2024-04-25T02:10:02.751910+0000","last_fullsized":"2024-04-25T02:10:02.751910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.745989+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:10:02.745989+0000","last_peered":"2024-04-25T02:10:02.745989+0000","last_clean":"2024-04-25T02:10:02.745989+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:10:02.745989+0000","last_undegraded":"2024-04-25T02:10:02.745989+0000","last_fullsized":"2024-04-25T02:10:02.745989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.752054+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:10:02.752054+0000","last_peered":"2024-04-25T02:10:02.752054+0000","last_clean":"2024-04-25T02:10:02.752054+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:10:02.752054+0000","last_undegraded":"2024-04-25T02:10:02.752054+0000","last_fullsized":"2024-04-25T02:10:02.752054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.741785+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:10:02.741785+0000","last_peered":"2024-04-25T02:10:02.741785+0000","last_clean":"2024-04-25T02:10:02.741785+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:10:02.741785+0000","last_undegraded":"2024-04-25T02:10:02.741785+0000","last_fullsized":"2024-04-25T02:10:02.741785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751558+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:10:02.751558+0000","last_peered":"2024-04-25T02:10:02.751558+0000","last_clean":"2024-04-25T02:10:02.751558+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:10:02.751558+0000","last_undegraded":"2024-04-25T02:10:02.751558+0000","last_fullsized":"2024-04-25T02:10:02.751558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.744528+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:10:02.744528+0000","last_peered":"2024-04-25T02:10:02.744528+0000","last_clean":"2024-04-25T02:10:02.744528+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:10:02.744528+0000","last_undegraded":"2024-04-25T02:10:02.744528+0000","last_fullsized":"2024-04-25T02:10:02.744528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751847+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:10:02.751847+0000","last_peered":"2024-04-25T02:10:02.751847+0000","last_clean":"2024-04-25T02:10:02.751847+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:10:02.751847+0000","last_undegraded":"2024-04-25T02:10:02.751847+0000","last_fullsized":"2024-04-25T02:10:02.751847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.742731+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:10:02.742731+0000","last_peered":"2024-04-25T02:10:02.742731+0000","last_clean":"2024-04-25T02:10:02.742731+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:10:02.742731+0000","last_undegraded":"2024-04-25T02:10:02.742731+0000","last_fullsized":"2024-04-25T02:10:02.742731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751522+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:10:02.751522+0000","last_peered":"2024-04-25T02:10:02.751522+0000","last_clean":"2024-04-25T02:10:02.751522+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:10:02.751522+0000","last_undegraded":"2024-04-25T02:10:02.751522+0000","last_fullsized":"2024-04-25T02:10:02.751522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.751431+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:10:02.751431+0000","last_peered":"2024-04-25T02:10:02.751431+0000","last_clean":"2024-04-25T02:10:02.751431+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:10:02.751431+0000","last_undegraded":"2024-04-25T02:10:02.751431+0000","last_fullsized":"2024-04-25T02:10:02.751431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.750718+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:10:02.750718+0000","last_peered":"2024-04-25T02:10:02.750718+0000","last_clean":"2024-04-25T02:10:02.750718+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:10:02.750718+0000","last_undegraded":"2024-04-25T02:10:02.750718+0000","last_fullsized":"2024-04-25T02:10:02.750718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T02:10:02.743979+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:10:02.743979+0000","last_peered":"2024-04-25T02:10:02.743979+0000","last_clean":"2024-04-25T02:10:02.743979+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:10:02.743979+0000","last_undegraded":"2024-04-25T02:10:02.743979+0000","last_fullsized":"2024-04-25T02:10:02.743979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]}]},{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":45214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:10:13.943 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:10:13.943 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:10:13.943 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:10:13.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:10:14.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.086+0000 7fa210ae0700 1 Processor -- start 2024-04-25T02:10:14.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.086+0000 7fa210ae0700 1 -- start start 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa210ae0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa20c124000 0x7fa20c0961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa210ae0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c0937a0 0x7fa20c1243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa210ae0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa210ae0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c096cf0 con 0x7fa20c124000 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa210ae0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c093ba0 con 0x7fa20c0937a0 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa210ae0700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c092d00 con 0x7fa20c1274e0 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa20a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa20c124000 0x7fa20c0961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa209d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c0937a0 0x7fa20c1243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa20ad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa20a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa20c124000 0x7fa20c0961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38390/0 (socket says 172.21.15.78:38390) 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa209d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c0937a0 0x7fa20c1243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57756/0 (socket says 172.21.15.78:57756) 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa20ad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c127990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51090/0 (socket says 172.21.15.78:51090) 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.087+0000 7fa20a59c700 1 -- 172.21.15.78:0/3584602323 learned_addr learned my addr 172.21.15.78:0/3584602323 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20a59c700 1 -- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 msgr2=0x7fa20c127990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20a59c700 1 --2- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c127990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20a59c700 1 -- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c0937a0 msgr2=0x7fa20c1243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20a59c700 1 --2- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c0937a0 0x7fa20c1243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20a59c700 1 -- 172.21.15.78:0/3584602323 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c0933a0 con 0x7fa20c124000 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa209d9b700 1 --2- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c0937a0 0x7fa20c1243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20ad9d700 1 --2- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20a59c700 1 --2- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c124000 0x7fa20c0961a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa200006fd0 tx=0x7fa20000b3b0).ready entity=mon.0 client_cookie=3689a229b1c51962 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20959a700 1 -- 172.21.15.78:0/3584602323 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20000da70 con 0x7fa20c124000 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20959a700 1 -- 172.21.15.78:0/3584602323 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20000dbd0 con 0x7fa20c124000 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa20959a700 1 -- 172.21.15.78:0/3584602323 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200010470 con 0x7fa20c124000 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa210ae0700 1 -- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c124000 msgr2=0x7fa20c0961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa210ae0700 1 --2- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c124000 0x7fa20c0961a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa200006fd0 tx=0x7fa20000b3b0).stop 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa210ae0700 1 -- 172.21.15.78:0/3584602323 shutdown_connections 2024-04-25T02:10:14.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa210ae0700 1 --2- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa210ae0700 1 --2- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c124000 0x7fa20c0961a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa210ae0700 1 --2- 172.21.15.78:0/3584602323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c0937a0 0x7fa20c1243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa210ae0700 1 -- 172.21.15.78:0/3584602323 >> 172.21.15.78:0/3584602323 conn(0x7fa20c097450 msgr2=0x7fa20c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa210ae0700 1 -- 172.21.15.78:0/3584602323 shutdown_connections 2024-04-25T02:10:14.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.088+0000 7fa210ae0700 1 -- 172.21.15.78:0/3584602323 wait complete. 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.089+0000 7fa210ae0700 1 Processor -- start 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa210ae0700 1 -- start start 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa210ae0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c0937a0 0x7fa20c135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa210ae0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c124000 0x7fa20c136280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa210ae0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c068710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa210ae0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c069bf0 con 0x7fa20c0937a0 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa210ae0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c112b70 con 0x7fa20c124000 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa210ae0700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c094fe0 con 0x7fa20c1274e0 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c0937a0 0x7fa20c135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20ad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c0937a0 0x7fa20c135d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38400/0 (socket says 172.21.15.78:38400) 2024-04-25T02:10:14.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20a59c700 1 -- 172.21.15.78:0/4176133281 learned_addr learned my addr 172.21.15.78:0/4176133281 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa209d9b700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c124000 0x7fa20c136280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20ad9d700 1 -- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c124000 msgr2=0x7fa20c136280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20ad9d700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c124000 0x7fa20c136280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20ad9d700 1 -- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c0937a0 msgr2=0x7fa20c135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20ad9d700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c0937a0 0x7fa20c135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20ad9d700 1 -- 172.21.15.78:0/4176133281 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc0092a0 con 0x7fa20c1274e0 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa209d9b700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c124000 0x7fa20c136280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20a59c700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c0937a0 0x7fa20c135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.090+0000 7fa20ad9d700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c068710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa204009f10 tx=0x7fa20400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.091+0000 7fa1faffd700 1 -- 172.21.15.78:0/4176133281 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20400cb70 con 0x7fa20c1274e0 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.091+0000 7fa1faffd700 1 -- 172.21.15.78:0/4176133281 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20400f040 con 0x7fa20c1274e0 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.091+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa204009a20 con 0x7fa20c1274e0 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.091+0000 7fa1faffd700 1 -- 172.21.15.78:0/4176133281 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204013400 con 0x7fa20c1274e0 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.091+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20000b610 con 0x7fa20c1274e0 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.091+0000 7fa1faffd700 1 -- 172.21.15.78:0/4176133281 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fa2040137f0 con 0x7fa20c1274e0 2024-04-25T02:10:14.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.092+0000 7fa1faffd700 1 -- 172.21.15.78:0/4176133281 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa20403b9f0 con 0x7fa20c1274e0 2024-04-25T02:10:14.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.092+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20c1127f0 con 0x7fa20c1274e0 2024-04-25T02:10:14.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.096+0000 7fa1faffd700 1 -- 172.21.15.78:0/4176133281 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fa20c1127f0 con 0x7fa20c1274e0 2024-04-25T02:10:14.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.291+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa20c1127f0 con 0x7fa20c1274e0 2024-04-25T02:10:14.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.291+0000 7fa1faffd700 1 -- 172.21.15.78:0/4176133281 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fa20c1127f0 con 0x7fa20c1274e0 2024-04-25T02:10:14.299 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 >> v1:172.21.15.78:6816/46507 conn(0x7fa1ec02bd30 legacy=0x7fa1ec02e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 msgr2=0x7fa20c068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c068710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa204009f10 tx=0x7fa20400b040).stop 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 shutdown_connections 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa20c1274e0 0x7fa20c068710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa20c0937a0 0x7fa20c135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 --2- 172.21.15.78:0/4176133281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa20c124000 0x7fa20c136280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 >> 172.21.15.78:0/4176133281 conn(0x7fa20c097450 msgr2=0x7fa20c0641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 shutdown_connections 2024-04-25T02:10:14.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.293+0000 7fa210ae0700 1 -- 172.21.15.78:0/4176133281 wait complete. 2024-04-25T02:10:14.312 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:10:14.312 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:10:14.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:14.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.418+0000 7f6d9ce65700 1 Processor -- start 2024-04-25T02:10:14.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.418+0000 7f6d9ce65700 1 -- start start 2024-04-25T02:10:14.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d9ce65700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d98124000 0x7f6d980961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d9ce65700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6d981243e0 0x7f6d98127bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d9ce65700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d98096cf0 con 0x7f6d980937a0 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d9ce65700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d98093ba0 con 0x7f6d981243e0 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d9ce65700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98092d00 con 0x7f6d98124000 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d9659c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d98124000 0x7f6d980961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d96d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6d981243e0 0x7f6d98127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d95d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6d980937a0 0x7f6d981274e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48434/0 (socket says 172.21.15.78:48434) 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d9659c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d98124000 0x7f6d980961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51116/0 (socket says 172.21.15.78:51116) 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d95d9b700 1 -- 172.21.15.78:0/3277115148 learned_addr learned my addr 172.21.15.78:0/3277115148 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d96d9d700 1 -- 172.21.15.78:0/3277115148 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d98124000 msgr2=0x7f6d980961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d96d9d700 1 --2- 172.21.15.78:0/3277115148 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d98124000 0x7f6d980961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d96d9d700 1 -- 172.21.15.78:0/3277115148 >> v1:172.21.15.78:6789/0 conn(0x7f6d980937a0 legacy=0x7f6d981274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d9559a700 1 -- 172.21.15.78:0/3277115148 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030369895 0 0) 0x7f6d98096cf0 con 0x7f6d980937a0 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d96d9d700 1 -- 172.21.15.78:0/3277115148 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980933a0 con 0x7f6d981243e0 2024-04-25T02:10:14.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d9659c700 1 --2- 172.21.15.78:0/3277115148 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d98124000 0x7f6d980961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.419+0000 7f6d96d9d700 1 --2- 172.21.15.78:0/3277115148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981243e0 0x7f6d98127bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f6d90009e90 tx=0x7f6d90009780).ready entity=mon.0 client_cookie=6e028e711ba2b8c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9559a700 1 -- 172.21.15.78:0/3277115148 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9000e070 con 0x7f6d981243e0 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9559a700 1 -- 172.21.15.78:0/3277115148 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9000bb20 con 0x7f6d981243e0 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9559a700 1 -- 172.21.15.78:0/3277115148 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9000bea0 con 0x7f6d981243e0 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3277115148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981243e0 msgr2=0x7f6d98127bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9ce65700 1 --2- 172.21.15.78:0/3277115148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981243e0 0x7f6d98127bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f6d90009e90 tx=0x7f6d90009780).stop 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3277115148 shutdown_connections 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9ce65700 1 --2- 172.21.15.78:0/3277115148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981243e0 0x7f6d98127bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9ce65700 1 --2- 172.21.15.78:0/3277115148 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d98124000 0x7f6d980961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3277115148 >> 172.21.15.78:0/3277115148 conn(0x7f6d98097450 msgr2=0x7f6d98097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3277115148 shutdown_connections 2024-04-25T02:10:14.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.420+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3277115148 wait complete. 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.421+0000 7f6d9ce65700 1 Processor -- start 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.421+0000 7f6d9ce65700 1 -- start start 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9ce65700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d980937a0 0x7f6d98137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9ce65700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98124000 0x7f6d981381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9ce65700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d981243e0 0x7f6d980683a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9ce65700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98113870 con 0x7f6d98124000 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9ce65700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981144d0 con 0x7f6d980937a0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9ce65700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9812ba30 con 0x7f6d981243e0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d95d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98124000 0x7f6d981381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d96d9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d981243e0 0x7f6d980683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d980937a0 0x7f6d98137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d95d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98124000 0x7f6d981381a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38414/0 (socket says 172.21.15.78:38414) 2024-04-25T02:10:14.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d95d9b700 1 -- 172.21.15.78:0/3642753948 learned_addr learned my addr 172.21.15.78:0/3642753948 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9659c700 1 -- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d981243e0 msgr2=0x7f6d980683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9659c700 1 --2- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d981243e0 0x7f6d980683a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9659c700 1 -- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98124000 msgr2=0x7f6d981381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9659c700 1 --2- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98124000 0x7f6d981381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9659c700 1 -- 172.21.15.78:0/3642753948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0092a0 con 0x7f6d980937a0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d95d9b700 1 --2- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98124000 0x7f6d981381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d96d9d700 1 --2- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d981243e0 0x7f6d980683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9659c700 1 --2- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d980937a0 0x7f6d98137cb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6d8c00e9b0 tx=0x7f6d8c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d86ffd700 1 -- 172.21.15.78:0/3642753948 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c012600 con 0x7f6d980937a0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d86ffd700 1 -- 172.21.15.78:0/3642753948 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c012760 con 0x7f6d980937a0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d86ffd700 1 -- 172.21.15.78:0/3642753948 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c012ae0 con 0x7f6d980937a0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.422+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d90009a20 con 0x7f6d980937a0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.423+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d98069420 con 0x7f6d980937a0 2024-04-25T02:10:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.423+0000 7f6d86ffd700 1 -- 172.21.15.78:0/3642753948 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f6d8c01b400 con 0x7f6d980937a0 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.423+0000 7f6d86ffd700 1 -- 172.21.15.78:0/3642753948 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6d8c03b660 con 0x7f6d980937a0 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.424+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d981134f0 con 0x7f6d980937a0 2024-04-25T02:10:14.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.428+0000 7f6d86ffd700 1 -- 172.21.15.78:0/3642753948 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f6d8c019900 con 0x7f6d980937a0 2024-04-25T02:10:14.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.587+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d98097f70 con 0x7f6d980937a0 2024-04-25T02:10:14.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.588+0000 7f6d86ffd700 1 -- 172.21.15.78:0/3642753948 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11309 (secure 0 0 0) 0x7f6d8c019310 con 0x7f6d980937a0 2024-04-25T02:10:14.596 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:14.596 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:03.700137+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 >> v1:172.21.15.78:6816/46507 conn(0x7f6d7802bd00 legacy=0x7f6d7802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d980937a0 msgr2=0x7f6d98137cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 --2- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d980937a0 0x7f6d98137cb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6d8c00e9b0 tx=0x7f6d8c009060).stop 2024-04-25T02:10:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 shutdown_connections 2024-04-25T02:10:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 --2- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6d981243e0 0x7f6d980683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 --2- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d980937a0 0x7f6d98137cb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 --2- 172.21.15.78:0/3642753948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98124000 0x7f6d981381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 >> 172.21.15.78:0/3642753948 conn(0x7f6d98097450 msgr2=0x7f6d98095080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 shutdown_connections 2024-04-25T02:10:14.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.590+0000 7f6d9ce65700 1 -- 172.21.15.78:0/3642753948 wait complete. 2024-04-25T02:10:14.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:00.989685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:01.680090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:10:14.609 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:10:14.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.719+0000 7efc34c9c700 1 Processor -- start 2024-04-25T02:10:14.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.719+0000 7efc34c9c700 1 -- start start 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc34c9c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc3012af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc34c9c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc3012b480 0x7efc300958a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc34c9c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc30091a10 con 0x7efc3012ab00 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc34c9c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc30062c40 con 0x7efc30062860 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc34c9c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc300922e0 con 0x7efc3012b480 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc3012af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2dd9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efc3012ab00 0x7efc30095190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48446/0 (socket says 172.21.15.78:48446) 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2dd9b700 1 -- 172.21.15.78:0/3979727259 learned_addr learned my addr 172.21.15.78:0/3979727259 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2ed9d700 1 --2- 172.21.15.78:0/3979727259 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc3012b480 0x7efc300958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2e59c700 1 -- 172.21.15.78:0/3979727259 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc3012b480 msgr2=0x7efc300958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:14.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2e59c700 1 --2- 172.21.15.78:0/3979727259 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc3012b480 0x7efc300958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2e59c700 1 -- 172.21.15.78:0/3979727259 >> v1:172.21.15.78:6789/0 conn(0x7efc3012ab00 legacy=0x7efc30095190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2d59a700 1 -- 172.21.15.78:0/3979727259 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508467884 0 0) 0x7efc30091a10 con 0x7efc3012ab00 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2e59c700 1 -- 172.21.15.78:0/3979727259 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc30091cb0 con 0x7efc30062860 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2ed9d700 1 --2- 172.21.15.78:0/3979727259 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc3012b480 0x7efc300958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2e59c700 1 --2- 172.21.15.78:0/3979727259 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc3012af90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7efc24009790 tx=0x7efc24009060).ready entity=mon.1 client_cookie=7e88b7dd099d4891 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2d59a700 1 -- 172.21.15.78:0/3979727259 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400f510 con 0x7efc30062860 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2d59a700 1 -- 172.21.15.78:0/3979727259 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2400f670 con 0x7efc30062860 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.720+0000 7efc2d59a700 1 -- 172.21.15.78:0/3979727259 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400f9f0 con 0x7efc30062860 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.721+0000 7efc34c9c700 1 -- 172.21.15.78:0/3979727259 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 msgr2=0x7efc3012af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.721+0000 7efc34c9c700 1 --2- 172.21.15.78:0/3979727259 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc3012af90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7efc24009790 tx=0x7efc24009060).stop 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.721+0000 7efc34c9c700 1 -- 172.21.15.78:0/3979727259 shutdown_connections 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.721+0000 7efc34c9c700 1 --2- 172.21.15.78:0/3979727259 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc3012b480 0x7efc300958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.721+0000 7efc34c9c700 1 --2- 172.21.15.78:0/3979727259 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc3012af90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.721+0000 7efc34c9c700 1 -- 172.21.15.78:0/3979727259 >> 172.21.15.78:0/3979727259 conn(0x7efc3009a970 msgr2=0x7efc3009ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.721+0000 7efc34c9c700 1 -- 172.21.15.78:0/3979727259 shutdown_connections 2024-04-25T02:10:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.721+0000 7efc34c9c700 1 -- 172.21.15.78:0/3979727259 wait complete. 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc34c9c700 1 Processor -- start 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc34c9c700 1 -- start start 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc34c9c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc30124e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc34c9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3012b480 0x7efc30115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc34c9c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc30115770 0x7efc30115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc34c9c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc30117340 con 0x7efc3012b480 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc34c9c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc301160c0 con 0x7efc30062860 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc34c9c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc301179e0 con 0x7efc30115770 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc2e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc30124e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc2dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3012b480 0x7efc30115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc2e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc30124e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57800/0 (socket says 172.21.15.78:57800) 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.722+0000 7efc2e59c700 1 -- 172.21.15.78:0/3737070096 learned_addr learned my addr 172.21.15.78:0/3737070096 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc2ed9d700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc30115770 0x7efc30115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc2dd9b700 1 -- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc30115770 msgr2=0x7efc30115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc2dd9b700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc30115770 0x7efc30115bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc2dd9b700 1 -- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 msgr2=0x7efc30124e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc2dd9b700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc30124e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc2dd9b700 1 -- 172.21.15.78:0/3737070096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc28009a20 con 0x7efc3012b480 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc2e59c700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc30124e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc2ed9d700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc30115770 0x7efc30115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc2dd9b700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3012b480 0x7efc30115280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7efc20000c00 tx=0x7efc20007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc1effd700 1 -- 172.21.15.78:0/3737070096 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2000ce20 con 0x7efc3012b480 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc1effd700 1 -- 172.21.15.78:0/3737070096 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc200072e0 con 0x7efc3012b480 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc1effd700 1 -- 172.21.15.78:0/3737070096 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200057a0 con 0x7efc3012b480 2024-04-25T02:10:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc240092a0 con 0x7efc3012b480 2024-04-25T02:10:14.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.723+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc30069390 con 0x7efc3012b480 2024-04-25T02:10:14.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.724+0000 7efc1effd700 1 -- 172.21.15.78:0/3737070096 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7efc20005bd0 con 0x7efc3012b480 2024-04-25T02:10:14.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.724+0000 7efc1effd700 1 -- 172.21.15.78:0/3737070096 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7efc2003a830 con 0x7efc3012b480 2024-04-25T02:10:14.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.724+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc30117820 con 0x7efc3012b480 2024-04-25T02:10:14.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.729+0000 7efc1effd700 1 -- 172.21.15.78:0/3737070096 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7efc2001d3f0 con 0x7efc3012b480 2024-04-25T02:10:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.888+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efc3009b490 con 0x7efc3012b480 2024-04-25T02:10:14.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.888+0000 7efc1effd700 1 -- 172.21.15.78:0/3737070096 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7efc2001c350 con 0x7efc3012b480 2024-04-25T02:10:14.896 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:10:14.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 >> v1:172.21.15.78:6816/46507 conn(0x7efc1002bd00 legacy=0x7efc1002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3012b480 msgr2=0x7efc30115280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3012b480 0x7efc30115280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7efc20000c00 tx=0x7efc20007b90).stop 2024-04-25T02:10:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 shutdown_connections 2024-04-25T02:10:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7efc30115770 0x7efc30115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc30062860 0x7efc30124e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 --2- 172.21.15.78:0/3737070096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc3012b480 0x7efc30115280 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 >> 172.21.15.78:0/3737070096 conn(0x7efc3009a970 msgr2=0x7efc300994d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 shutdown_connections 2024-04-25T02:10:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:14.890+0000 7efc34c9c700 1 -- 172.21.15.78:0/3737070096 wait complete. 2024-04-25T02:10:14.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:10:15.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.018+0000 7f62a3a7a700 1 Processor -- start 2024-04-25T02:10:15.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.018+0000 7f62a3a7a700 1 -- start start 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a3a7a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f629c0972f0 0x7f629c12fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a3a7a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 0x7f629c1324b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a3a7a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c0652a0 con 0x7f629c065d60 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a3a7a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c066140 con 0x7f629c0972f0 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a3a7a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c128280 con 0x7f629c1300c0 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a2017700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 0x7f629c1324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a1015700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f629c0972f0 0x7f629c12fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a1816700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f629c065d60 0x7f629c127b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48450/0 (socket says 172.21.15.78:48450) 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a2017700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 0x7f629c1324b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57802/0 (socket says 172.21.15.78:57802) 2024-04-25T02:10:15.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a1816700 1 -- 172.21.15.78:0/3000409447 learned_addr learned my addr 172.21.15.78:0/3000409447 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a1015700 1 -- 172.21.15.78:0/3000409447 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 msgr2=0x7f629c1324b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a1015700 1 --2- 172.21.15.78:0/3000409447 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 0x7f629c1324b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a1015700 1 -- 172.21.15.78:0/3000409447 >> v1:172.21.15.78:6789/0 conn(0x7f629c065d60 legacy=0x7f629c127b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a1015700 1 -- 172.21.15.78:0/3000409447 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0649e0 con 0x7f629c0972f0 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a0814700 1 -- 172.21.15.78:0/3000409447 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346252500 0 0) 0x7f629c0652a0 con 0x7f629c065d60 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a1015700 1 --2- 172.21.15.78:0/3000409447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c0972f0 0x7f629c12fbd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f6298009760 tx=0x7f6298009060).ready entity=mon.0 client_cookie=2944c9d2a129bbfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a0814700 1 -- 172.21.15.78:0/3000409447 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629800f510 con 0x7f629c0972f0 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a0814700 1 -- 172.21.15.78:0/3000409447 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629800f670 con 0x7f629c0972f0 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.019+0000 7f62a0814700 1 -- 172.21.15.78:0/3000409447 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629800f9f0 con 0x7f629c0972f0 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.020+0000 7f62a3a7a700 1 -- 172.21.15.78:0/3000409447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c0972f0 msgr2=0x7f629c12fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.020+0000 7f62a3a7a700 1 --2- 172.21.15.78:0/3000409447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c0972f0 0x7f629c12fbd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f6298009760 tx=0x7f6298009060).stop 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.020+0000 7f62a3a7a700 1 -- 172.21.15.78:0/3000409447 shutdown_connections 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.020+0000 7f62a3a7a700 1 --2- 172.21.15.78:0/3000409447 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 0x7f629c1324b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.020+0000 7f62a3a7a700 1 --2- 172.21.15.78:0/3000409447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c0972f0 0x7f629c12fbd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.020+0000 7f62a3a7a700 1 -- 172.21.15.78:0/3000409447 >> 172.21.15.78:0/3000409447 conn(0x7f629c09ba80 msgr2=0x7f629c09be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.020+0000 7f62a3a7a700 1 -- 172.21.15.78:0/3000409447 shutdown_connections 2024-04-25T02:10:15.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.020+0000 7f62a3a7a700 1 -- 172.21.15.78:0/3000409447 wait complete. 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a3a7a700 1 Processor -- start 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a3a7a700 1 -- start start 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a3a7a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c065d60 0x7f629c12cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a3a7a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f629c0972f0 0x7f629c12d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a3a7a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 0x7f629c12d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a3a7a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c12de80 con 0x7f629c065d60 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a3a7a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c064c10 con 0x7f629c1300c0 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a3a7a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f629c113b50 con 0x7f629c0972f0 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a1816700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c065d60 0x7f629c12cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a1816700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c065d60 0x7f629c12cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38448/0 (socket says 172.21.15.78:38448) 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a1816700 1 -- 172.21.15.78:0/2971740577 learned_addr learned my addr 172.21.15.78:0/2971740577 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a1015700 1 --2- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f629c0972f0 0x7f629c12d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.021+0000 7f62a2017700 1 --2- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 0x7f629c12d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f62a1816700 1 -- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f629c0972f0 msgr2=0x7f629c12d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f62a1816700 1 --2- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f629c0972f0 0x7f629c12d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f62a1816700 1 -- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 msgr2=0x7f629c12d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f62a1816700 1 --2- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 0x7f629c12d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f62a1816700 1 -- 172.21.15.78:0/2971740577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62980092a0 con 0x7f629c065d60 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f62a1816700 1 --2- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c065d60 0x7f629c12cfb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f628c00c4c0 tx=0x7f628c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f6292777700 1 -- 172.21.15.78:0/2971740577 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00ce30 con 0x7f629c065d60 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f6292777700 1 -- 172.21.15.78:0/2971740577 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c0072e0 con 0x7f629c065d60 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f6292777700 1 -- 172.21.15.78:0/2971740577 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0057a0 con 0x7f629c065d60 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c112ed0 con 0x7f629c065d60 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.022+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c113770 con 0x7f629c065d60 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.023+0000 7f6292777700 1 -- 172.21.15.78:0/2971740577 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f628c005bd0 con 0x7f629c065d60 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.023+0000 7f6292777700 1 -- 172.21.15.78:0/2971740577 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f628c03a5f0 con 0x7f629c065d60 2024-04-25T02:10:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.023+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c113770 con 0x7f629c065d60 2024-04-25T02:10:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.027+0000 7f6292777700 1 -- 172.21.15.78:0/2971740577 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f629c113770 con 0x7f629c065d60 2024-04-25T02:10:15.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.185+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f629c113770 con 0x7f629c065d60 2024-04-25T02:10:15.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.185+0000 7f6292777700 1 -- 172.21.15.78:0/2971740577 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f629c113770 con 0x7f629c065d60 2024-04-25T02:10:15.193 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 >> v1:172.21.15.78:6816/46507 conn(0x7f628002bd30 legacy=0x7f628002e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c065d60 msgr2=0x7f629c12cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 --2- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c065d60 0x7f629c12cfb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f628c00c4c0 tx=0x7f628c007c10).stop 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 shutdown_connections 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 --2- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f629c1300c0 0x7f629c12d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 --2- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f629c065d60 0x7f629c12cfb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 --2- 172.21.15.78:0/2971740577 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f629c0972f0 0x7f629c12d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 >> 172.21.15.78:0/2971740577 conn(0x7f629c09ba80 msgr2=0x7f629c12a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 shutdown_connections 2024-04-25T02:10:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.187+0000 7f62a3a7a700 1 -- 172.21.15.78:0/2971740577 wait complete. 2024-04-25T02:10:15.206 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:10:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.315+0000 7f34286b6700 1 Processor -- start 2024-04-25T02:10:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.315+0000 7f34286b6700 1 -- start start 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f34286b6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f342012af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f34286b6700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f342012ab00 0x7f342012b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f34286b6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3420091a10 con 0x7f3420095190 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f34286b6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3420062c40 con 0x7f3420062860 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f34286b6700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34200922e0 con 0x7f342012ab00 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425c51700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f342012ab00 0x7f342012b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3426452700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f342012af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3426452700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f342012af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57820/0 (socket says 172.21.15.78:57820) 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425c51700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f342012ab00 0x7f342012b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51152/0 (socket says 172.21.15.78:51152) 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3426c53700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3420095190 0x7f3420095640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48454/0 (socket says 172.21.15.78:48454) 2024-04-25T02:10:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3426452700 1 -- 172.21.15.78:0/1956183859 learned_addr learned my addr 172.21.15.78:0/1956183859 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425c51700 1 -- 172.21.15.78:0/1956183859 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 msgr2=0x7f342012af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425c51700 1 --2- 172.21.15.78:0/1956183859 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f342012af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425450700 1 -- 172.21.15.78:0/1956183859 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676741095 0 0) 0x7f3420091a10 con 0x7f3420095190 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425c51700 1 -- 172.21.15.78:0/1956183859 >> v1:172.21.15.78:6789/0 conn(0x7f3420095190 legacy=0x7f3420095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425c51700 1 -- 172.21.15.78:0/1956183859 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342012b970 con 0x7f342012ab00 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3426452700 1 --2- 172.21.15.78:0/1956183859 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f342012af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425c51700 1 --2- 172.21.15.78:0/1956183859 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f342012ab00 0x7f342012b480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f341c0097c0 tx=0x7f341c009060).ready entity=mon.2 client_cookie=fb88a829a391ee4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425450700 1 -- 172.21.15.78:0/1956183859 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00f510 con 0x7f342012ab00 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425450700 1 -- 172.21.15.78:0/1956183859 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c00f670 con 0x7f342012ab00 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.316+0000 7f3425450700 1 -- 172.21.15.78:0/1956183859 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00f9f0 con 0x7f342012ab00 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.317+0000 7f34286b6700 1 -- 172.21.15.78:0/1956183859 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f342012ab00 msgr2=0x7f342012b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.317+0000 7f34286b6700 1 --2- 172.21.15.78:0/1956183859 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f342012ab00 0x7f342012b480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f341c0097c0 tx=0x7f341c009060).stop 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.317+0000 7f34286b6700 1 -- 172.21.15.78:0/1956183859 shutdown_connections 2024-04-25T02:10:15.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.317+0000 7f34286b6700 1 --2- 172.21.15.78:0/1956183859 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f342012af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.317+0000 7f34286b6700 1 --2- 172.21.15.78:0/1956183859 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f342012ab00 0x7f342012b480 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.317+0000 7f34286b6700 1 -- 172.21.15.78:0/1956183859 >> 172.21.15.78:0/1956183859 conn(0x7f342009a970 msgr2=0x7f342009ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.317+0000 7f34286b6700 1 -- 172.21.15.78:0/1956183859 shutdown_connections 2024-04-25T02:10:15.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.317+0000 7f34286b6700 1 -- 172.21.15.78:0/1956183859 wait complete. 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f34286b6700 1 Processor -- start 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f34286b6700 1 -- start start 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f34286b6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f3420124dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f34286b6700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3420095190 0x7f3420115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f34286b6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3420115770 0x7f3420115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f34286b6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342009a030 con 0x7f3420115770 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f34286b6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3420096c60 con 0x7f3420062860 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f34286b6700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3420117ec0 con 0x7f3420095190 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f3426452700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f3420124dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f3425c51700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3420095190 0x7f3420115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f3426c53700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3420115770 0x7f3420115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f3426452700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f3420124dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57828/0 (socket says 172.21.15.78:57828) 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.318+0000 7f3426452700 1 -- 172.21.15.78:0/3738253443 learned_addr learned my addr 172.21.15.78:0/3738253443 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3425c51700 1 -- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 msgr2=0x7f3420124dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3425c51700 1 --2- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f3420124dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3425c51700 1 -- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3420115770 msgr2=0x7f3420115bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3425c51700 1 --2- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3420115770 0x7f3420115bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3425c51700 1 -- 172.21.15.78:0/3738253443 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3410009370 con 0x7f3420095190 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3426c53700 1 --2- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3420115770 0x7f3420115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3425c51700 1 --2- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3420095190 0x7f3420115280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f341c014000 tx=0x7f341c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3416ffd700 1 -- 172.21.15.78:0/3738253443 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00f7e0 con 0x7f3420095190 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3416ffd700 1 -- 172.21.15.78:0/3738253443 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c00f940 con 0x7f3420095190 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c0092a0 con 0x7f3420095190 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f3416ffd700 1 -- 172.21.15.78:0/3738253443 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c01c670 con 0x7f3420095190 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.319+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34201160a0 con 0x7f3420095190 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.320+0000 7f3416ffd700 1 -- 172.21.15.78:0/3738253443 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f341c01c9e0 con 0x7f3420095190 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.320+0000 7f3416ffd700 1 -- 172.21.15.78:0/3738253443 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f341c03c5c0 con 0x7f3420095190 2024-04-25T02:10:15.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.320+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3420069330 con 0x7f3420095190 2024-04-25T02:10:15.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.324+0000 7f3416ffd700 1 -- 172.21.15.78:0/3738253443 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f341c020080 con 0x7f3420095190 2024-04-25T02:10:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.481+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f342009b490 con 0x7f3420095190 2024-04-25T02:10:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.481+0000 7f3416ffd700 1 -- 172.21.15.78:0/3738253443 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f341c025970 con 0x7f3420095190 2024-04-25T02:10:15.489 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 >> v1:172.21.15.78:6816/46507 conn(0x7f340402bd30 legacy=0x7f340402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3420095190 msgr2=0x7f3420115280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 --2- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3420095190 0x7f3420115280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f341c014000 tx=0x7f341c017000).stop 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 shutdown_connections 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 --2- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3420115770 0x7f3420115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 --2- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3420062860 0x7f3420124dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 --2- 172.21.15.78:0/3738253443 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3420095190 0x7f3420115280 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 >> 172.21.15.78:0/3738253443 conn(0x7f342009a970 msgr2=0x7f34200991d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 shutdown_connections 2024-04-25T02:10:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.483+0000 7f34286b6700 1 -- 172.21.15.78:0/3738253443 wait complete. 2024-04-25T02:10:15.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:10:15.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.610+0000 7f63c5626700 1 Processor -- start 2024-04-25T02:10:15.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.610+0000 7f63c5626700 1 -- start start 2024-04-25T02:10:15.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63c5626700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0098f50 0x7f63c012fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63c5626700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0130040 0x7f63c0132430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63c5626700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c0091c40 con 0x7f63c0064b70 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63c5626700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0064f50 con 0x7f63c0098f50 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63c5626700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0065930 con 0x7f63c0130040 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63be7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0098f50 0x7f63c012fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63beffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f63c0064b70 0x7f63c0098840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48462/0 (socket says 172.21.15.78:48462) 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63bf7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0130040 0x7f63c0132430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63beffd700 1 -- 172.21.15.78:0/849897007 learned_addr learned my addr 172.21.15.78:0/849897007 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63be7fc700 1 -- 172.21.15.78:0/849897007 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0130040 msgr2=0x7f63c0132430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63be7fc700 1 --2- 172.21.15.78:0/849897007 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0130040 0x7f63c0132430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63be7fc700 1 -- 172.21.15.78:0/849897007 >> v1:172.21.15.78:6789/0 conn(0x7f63c0064b70 legacy=0x7f63c0098840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63bdffb700 1 -- 172.21.15.78:0/849897007 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208289556 0 0) 0x7f63c0091c40 con 0x7f63c0064b70 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63be7fc700 1 -- 172.21.15.78:0/849897007 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0098530 con 0x7f63c0098f50 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63bf7fe700 1 --2- 172.21.15.78:0/849897007 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0130040 0x7f63c0132430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:15.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.611+0000 7f63be7fc700 1 --2- 172.21.15.78:0/849897007 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0098f50 0x7f63c012fb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f63b0009790 tx=0x7f63b0009060).ready entity=mon.1 client_cookie=cd6909d0a065eaf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63bdffb700 1 -- 172.21.15.78:0/849897007 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b000f510 con 0x7f63c0098f50 2024-04-25T02:10:15.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63bdffb700 1 -- 172.21.15.78:0/849897007 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b000f670 con 0x7f63c0098f50 2024-04-25T02:10:15.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63bdffb700 1 -- 172.21.15.78:0/849897007 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b000f9f0 con 0x7f63c0098f50 2024-04-25T02:10:15.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63c5626700 1 -- 172.21.15.78:0/849897007 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0098f50 msgr2=0x7f63c012fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63c5626700 1 --2- 172.21.15.78:0/849897007 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0098f50 0x7f63c012fb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f63b0009790 tx=0x7f63b0009060).stop 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63c5626700 1 -- 172.21.15.78:0/849897007 shutdown_connections 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63c5626700 1 --2- 172.21.15.78:0/849897007 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0130040 0x7f63c0132430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63c5626700 1 --2- 172.21.15.78:0/849897007 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0098f50 0x7f63c012fb50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63c5626700 1 -- 172.21.15.78:0/849897007 >> 172.21.15.78:0/849897007 conn(0x7f63c009e7a0 msgr2=0x7f63c009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63c5626700 1 -- 172.21.15.78:0/849897007 shutdown_connections 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.612+0000 7f63c5626700 1 -- 172.21.15.78:0/849897007 wait complete. 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.613+0000 7f63c5626700 1 Processor -- start 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.613+0000 7f63c5626700 1 -- start start 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63c5626700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63c0098f50 0x7f63c00959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63c5626700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0130040 0x7f63c0095ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63c5626700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0096390 0x7f63c01404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63c5626700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0099a80 con 0x7f63c0098f50 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63c5626700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0115850 con 0x7f63c0130040 2024-04-25T02:10:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63c5626700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63c01152e0 con 0x7f63c0096390 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63beffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63c0098f50 0x7f63c00959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63bf7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0096390 0x7f63c01404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63bf7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0096390 0x7f63c01404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51198/0 (socket says 172.21.15.78:51198) 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63bf7fe700 1 -- 172.21.15.78:0/634836476 learned_addr learned my addr 172.21.15.78:0/634836476 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63beffd700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63c0098f50 0x7f63c00959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38460/0 (socket says 172.21.15.78:38460) 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63be7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0130040 0x7f63c0095ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63beffd700 1 -- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0096390 msgr2=0x7f63c01404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63beffd700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0096390 0x7f63c01404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63beffd700 1 -- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0130040 msgr2=0x7f63c0095ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63beffd700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0130040 0x7f63c0095ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63beffd700 1 -- 172.21.15.78:0/634836476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b8009a20 con 0x7f63c0098f50 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63be7fc700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0130040 0x7f63c0095ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63bf7fe700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0096390 0x7f63c01404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63beffd700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63c0098f50 0x7f63c00959b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f63b400c490 tx=0x7f63b4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63a77fe700 1 -- 172.21.15.78:0/634836476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b40070d0 con 0x7f63c0098f50 2024-04-25T02:10:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63a77fe700 1 -- 172.21.15.78:0/634836476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b4007230 con 0x7f63c0098f50 2024-04-25T02:10:15.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b00092a0 con 0x7f63c0098f50 2024-04-25T02:10:15.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63a77fe700 1 -- 172.21.15.78:0/634836476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b40075d0 con 0x7f63c0098f50 2024-04-25T02:10:15.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.614+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c0096810 con 0x7f63c0098f50 2024-04-25T02:10:15.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.615+0000 7f63a77fe700 1 -- 172.21.15.78:0/634836476 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f63b40059b0 con 0x7f63c0098f50 2024-04-25T02:10:15.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.615+0000 7f63a77fe700 1 -- 172.21.15.78:0/634836476 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f63b403a740 con 0x7f63c0098f50 2024-04-25T02:10:15.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.615+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c0115a90 con 0x7f63c0098f50 2024-04-25T02:10:15.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.620+0000 7f63a77fe700 1 -- 172.21.15.78:0/634836476 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f63b4013970 con 0x7f63c0098f50 2024-04-25T02:10:15.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.778+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63c0063870 con 0x7f63c0098f50 2024-04-25T02:10:15.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.778+0000 7f63a77fe700 1 -- 172.21.15.78:0/634836476 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63b4010300 con 0x7f63c0098f50 2024-04-25T02:10:15.786 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 >> v1:172.21.15.78:6816/46507 conn(0x7f63ac02bd00 legacy=0x7f63ac02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63c0098f50 msgr2=0x7f63c00959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63c0098f50 0x7f63c00959b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f63b400c490 tx=0x7f63b4007db0).stop 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 shutdown_connections 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f63c0096390 0x7f63c01404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63c0098f50 0x7f63c00959b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 --2- 172.21.15.78:0/634836476 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f63c0130040 0x7f63c0095ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 >> 172.21.15.78:0/634836476 conn(0x7f63c0064b70 msgr2=0x7f63c012a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 shutdown_connections 2024-04-25T02:10:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.780+0000 7f63c5626700 1 -- 172.21.15.78:0/634836476 wait complete. 2024-04-25T02:10:15.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:15.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.905+0000 7fe042ad2700 1 Processor -- start 2024-04-25T02:10:15.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.905+0000 7fe042ad2700 1 -- start start 2024-04-25T02:10:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe042ad2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe03c091f40 0x7fe03c12c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe042ad2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c12c890 0x7fe03c12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe042ad2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c093d70 con 0x7fe03c091450 2024-04-25T02:10:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe042ad2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03c06c260 con 0x7fe03c091f40 2024-04-25T02:10:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe042ad2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c099570 con 0x7fe03c12c890 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe04086e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe03c091450 0x7fe03c091830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48476/0 (socket says 172.21.15.78:48476) 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe04086e700 1 -- 172.21.15.78:0/3071167906 learned_addr learned my addr 172.21.15.78:0/3071167906 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe03bfff700 1 --2- 172.21.15.78:0/3071167906 >> v2:172.21.15.78:3300/0 conn(0x7fe03c091f40 0x7fe03c12c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe04106f700 1 --2- 172.21.15.78:0/3071167906 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c12c890 0x7fe03c12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe03bfff700 1 -- 172.21.15.78:0/3071167906 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c12c890 msgr2=0x7fe03c12ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe03bfff700 1 --2- 172.21.15.78:0/3071167906 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c12c890 0x7fe03c12ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe03bfff700 1 -- 172.21.15.78:0/3071167906 >> v1:172.21.15.78:6789/0 conn(0x7fe03c091450 legacy=0x7fe03c091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe03bfff700 1 -- 172.21.15.78:0/3071167906 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c093ad0 con 0x7fe03c091f40 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe04106f700 1 --2- 172.21.15.78:0/3071167906 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c12c890 0x7fe03c12ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe03b7fe700 1 -- 172.21.15.78:0/3071167906 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76977943 0 0) 0x7fe03c093d70 con 0x7fe03c091450 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.906+0000 7fe03bfff700 1 --2- 172.21.15.78:0/3071167906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 0x7fe03c12c3a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe028009760 tx=0x7fe028009060).ready entity=mon.0 client_cookie=4b9c5e69df84dccc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe03b7fe700 1 -- 172.21.15.78:0/3071167906 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280090d0 con 0x7fe03c091f40 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe03b7fe700 1 -- 172.21.15.78:0/3071167906 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02800f510 con 0x7fe03c091f40 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe03b7fe700 1 -- 172.21.15.78:0/3071167906 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02800f890 con 0x7fe03c091f40 2024-04-25T02:10:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe042ad2700 1 -- 172.21.15.78:0/3071167906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 msgr2=0x7fe03c12c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe042ad2700 1 --2- 172.21.15.78:0/3071167906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 0x7fe03c12c3a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe028009760 tx=0x7fe028009060).stop 2024-04-25T02:10:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe042ad2700 1 -- 172.21.15.78:0/3071167906 shutdown_connections 2024-04-25T02:10:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe042ad2700 1 --2- 172.21.15.78:0/3071167906 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c12c890 0x7fe03c12ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe042ad2700 1 --2- 172.21.15.78:0/3071167906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 0x7fe03c12c3a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe042ad2700 1 -- 172.21.15.78:0/3071167906 >> 172.21.15.78:0/3071167906 conn(0x7fe03c0974d0 msgr2=0x7fe03c099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe042ad2700 1 -- 172.21.15.78:0/3071167906 shutdown_connections 2024-04-25T02:10:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.907+0000 7fe042ad2700 1 -- 172.21.15.78:0/3071167906 wait complete. 2024-04-25T02:10:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.908+0000 7fe042ad2700 1 Processor -- start 2024-04-25T02:10:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.908+0000 7fe042ad2700 1 -- start start 2024-04-25T02:10:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe042ad2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c091450 0x7fe03c120240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe042ad2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 0x7fe03c137540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe042ad2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe03c12c890 0x7fe03c137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe042ad2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c12cd80 con 0x7fe03c091f40 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe042ad2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c11fa60 con 0x7fe03c091450 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe042ad2700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c131330 con 0x7fe03c12c890 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe04086e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c091450 0x7fe03c120240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe03bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 0x7fe03c137540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe03bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 0x7fe03c137540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38474/0 (socket says 172.21.15.78:38474) 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe04106f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe03c12c890 0x7fe03c137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe04086e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c091450 0x7fe03c120240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57874/0 (socket says 172.21.15.78:57874) 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe03bfff700 1 -- 172.21.15.78:0/1753456864 learned_addr learned my addr 172.21.15.78:0/1753456864 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe03bfff700 1 -- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe03c12c890 msgr2=0x7fe03c137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe03bfff700 1 --2- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe03c12c890 0x7fe03c137a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe03bfff700 1 -- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c091450 msgr2=0x7fe03c120240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe03bfff700 1 --2- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c091450 0x7fe03c120240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe03bfff700 1 -- 172.21.15.78:0/1753456864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034009a20 con 0x7fe03c091f40 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe04086e700 1 --2- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c091450 0x7fe03c120240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe03bfff700 1 --2- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 0x7fe03c137540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe028009130 tx=0x7fe028017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe039775700 1 -- 172.21.15.78:0/1753456864 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02800f890 con 0x7fe03c091f40 2024-04-25T02:10:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe039775700 1 -- 172.21.15.78:0/1753456864 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe028006970 con 0x7fe03c091f40 2024-04-25T02:10:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0280092a0 con 0x7fe03c091f40 2024-04-25T02:10:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe039775700 1 -- 172.21.15.78:0/1753456864 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02800fea0 con 0x7fe03c091f40 2024-04-25T02:10:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.909+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c069b80 con 0x7fe03c091f40 2024-04-25T02:10:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.910+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c12d880 con 0x7fe03c091f40 2024-04-25T02:10:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.911+0000 7fe039775700 1 -- 172.21.15.78:0/1753456864 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fe02801b620 con 0x7fe03c091f40 2024-04-25T02:10:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.911+0000 7fe039775700 1 -- 172.21.15.78:0/1753456864 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe02803cfd0 con 0x7fe03c091f40 2024-04-25T02:10:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:15.915+0000 7fe039775700 1 -- 172.21.15.78:0/1753456864 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fe02801b8d0 con 0x7fe03c091f40 2024-04-25T02:10:16.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.108+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe03c11fca0 con 0x7fe03c091f40 2024-04-25T02:10:16.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.108+0000 7fe039775700 1 -- 172.21.15.78:0/1753456864 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fe028019b70 con 0x7fe03c091f40 2024-04-25T02:10:16.116 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:16.116 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:02.698771+0000","modified":"2024-04-25T02:10:04.706190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:10:16.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 >> v1:172.21.15.78:6816/46507 conn(0x7fe02002bd30 legacy=0x7fe02002e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 msgr2=0x7fe03c137540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 --2- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 0x7fe03c137540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe028009130 tx=0x7fe028017000).stop 2024-04-25T02:10:16.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 shutdown_connections 2024-04-25T02:10:16.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 --2- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe03c12c890 0x7fe03c137a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 --2- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe03c091450 0x7fe03c120240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 --2- 172.21.15.78:0/1753456864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe03c091f40 0x7fe03c137540 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 >> 172.21.15.78:0/1753456864 conn(0x7fe03c0974d0 msgr2=0x7fe03c128170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 shutdown_connections 2024-04-25T02:10:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.110+0000 7fe042ad2700 1 -- 172.21.15.78:0/1753456864 wait complete. 2024-04-25T02:10:16.119 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-25T02:10:16.130 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1480917700 1 Processor -- start 2024-04-25T02:10:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1480917700 1 -- start start 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1480917700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f147c05e960 0x7f147c098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1480917700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c099330 0x7f147c099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1480917700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0682e0 con 0x7f147c12d120 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1480917700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c06ad80 con 0x7f147c05e960 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1480917700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f147c05ed40 con 0x7f147c099330 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1479d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c099330 0x7f147c099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f147a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f147c05e960 0x7f147c098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1479d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c099330 0x7f147c099730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51216/0 (socket says 172.21.15.78:51216) 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f147ad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f147c12d120 0x7f147c12f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48488/0 (socket says 172.21.15.78:48488) 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f147a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f147c05e960 0x7f147c098e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38490/0 (socket says 172.21.15.78:38490) 2024-04-25T02:10:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.237+0000 7f1479d9b700 1 -- 172.21.15.78:0/67238533 learned_addr learned my addr 172.21.15.78:0/67238533 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f147a59c700 1 -- 172.21.15.78:0/67238533 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c099330 msgr2=0x7f147c099730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f147a59c700 1 --2- 172.21.15.78:0/67238533 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c099330 0x7f147c099730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f147a59c700 1 -- 172.21.15.78:0/67238533 >> v1:172.21.15.78:6789/0 conn(0x7f147c12d120 legacy=0x7f147c12f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f147a59c700 1 -- 172.21.15.78:0/67238533 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c069060 con 0x7f147c05e960 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f1479d9b700 1 --2- 172.21.15.78:0/67238533 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c099330 0x7f147c099730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f147959a700 1 -- 172.21.15.78:0/67238533 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439511507 0 0) 0x7f147c0682e0 con 0x7f147c12d120 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f147a59c700 1 --2- 172.21.15.78:0/67238533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 0x7f147c098e40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f146c009760 tx=0x7f146c009060).ready entity=mon.0 client_cookie=51887ea7ea45eecb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f147959a700 1 -- 172.21.15.78:0/67238533 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00f510 con 0x7f147c05e960 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f147959a700 1 -- 172.21.15.78:0/67238533 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c00f670 con 0x7f147c05e960 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f147959a700 1 -- 172.21.15.78:0/67238533 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00f9f0 con 0x7f147c05e960 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f1480917700 1 -- 172.21.15.78:0/67238533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 msgr2=0x7f147c098e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.238+0000 7f1480917700 1 --2- 172.21.15.78:0/67238533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 0x7f147c098e40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f146c009760 tx=0x7f146c009060).stop 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.239+0000 7f1480917700 1 -- 172.21.15.78:0/67238533 shutdown_connections 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.239+0000 7f1480917700 1 --2- 172.21.15.78:0/67238533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 0x7f147c098e40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.239+0000 7f1480917700 1 --2- 172.21.15.78:0/67238533 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c099330 0x7f147c099730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.239+0000 7f1480917700 1 -- 172.21.15.78:0/67238533 >> 172.21.15.78:0/67238533 conn(0x7f147c0974d0 msgr2=0x7f147c099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.239+0000 7f1480917700 1 -- 172.21.15.78:0/67238533 shutdown_connections 2024-04-25T02:10:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.239+0000 7f1480917700 1 -- 172.21.15.78:0/67238533 wait complete. 2024-04-25T02:10:16.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.240+0000 7f1480917700 1 Processor -- start 2024-04-25T02:10:16.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.240+0000 7f1480917700 1 -- start start 2024-04-25T02:10:16.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1480917700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 0x7f147c128db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1480917700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f147c099330 0x7f147c124e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1480917700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c12d120 0x7f147c1252f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1480917700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1262a0 con 0x7f147c05e960 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1480917700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c128310 con 0x7f147c099330 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1480917700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f147c098750 con 0x7f147c12d120 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 0x7f147c128db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147ad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c12d120 0x7f147c1252f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 0x7f147c128db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38496/0 (socket says 172.21.15.78:38496) 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147a59c700 1 -- 172.21.15.78:0/1745714940 learned_addr learned my addr 172.21.15.78:0/1745714940 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1479d9b700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f147c099330 0x7f147c124e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147ad9d700 1 -- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f147c099330 msgr2=0x7f147c124e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147ad9d700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f147c099330 0x7f147c124e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147ad9d700 1 -- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 msgr2=0x7f147c128db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147ad9d700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 0x7f147c128db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147ad9d700 1 -- 172.21.15.78:0/1745714940 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470009370 con 0x7f147c12d120 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147a59c700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 0x7f147c128db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1479d9b700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f147c099330 0x7f147c124e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f147ad9d700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c12d120 0x7f147c1252f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1474002230 tx=0x7f1474007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f146affd700 1 -- 172.21.15.78:0/1745714940 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474005c70 con 0x7f147c12d120 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f146affd700 1 -- 172.21.15.78:0/1745714940 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474005df0 con 0x7f147c12d120 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c0092a0 con 0x7f147c12d120 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f146affd700 1 -- 172.21.15.78:0/1745714940 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474007360 con 0x7f147c12d120 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.241+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c1269a0 con 0x7f147c12d120 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.242+0000 7f146affd700 1 -- 172.21.15.78:0/1745714940 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f1474007750 con 0x7f147c12d120 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.242+0000 7f146affd700 1 -- 172.21.15.78:0/1745714940 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f147403b130 con 0x7f147c12d120 2024-04-25T02:10:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.242+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c09a660 con 0x7f147c12d120 2024-04-25T02:10:16.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.247+0000 7f146affd700 1 -- 172.21.15.78:0/1745714940 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f147401c3e0 con 0x7f147c12d120 2024-04-25T02:10:16.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.406+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f147c125c00 con 0x7f147c12d120 2024-04-25T02:10:16.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.407+0000 7f146affd700 1 -- 172.21.15.78:0/1745714940 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11309 (secure 0 0 0) 0x7f147401b390 con 0x7f147c12d120 2024-04-25T02:10:16.414 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:16.415 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:03.700137+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:16.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 >> v1:172.21.15.78:6816/46507 conn(0x7f145c02bd00 legacy=0x7f145c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c12d120 msgr2=0x7f147c1252f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c12d120 0x7f147c1252f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1474002230 tx=0x7f1474007eb0).stop 2024-04-25T02:10:16.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 shutdown_connections 2024-04-25T02:10:16.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f147c12d120 0x7f147c1252f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f147c05e960 0x7f147c128db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 --2- 172.21.15.78:0/1745714940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f147c099330 0x7f147c124e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 >> 172.21.15.78:0/1745714940 conn(0x7f147c0974d0 msgr2=0x7f147c12ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:16.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 shutdown_connections 2024-04-25T02:10:16.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.409+0000 7f1480917700 1 -- 172.21.15.78:0/1745714940 wait complete. 2024-04-25T02:10:16.428 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:00.989685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:01.680090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:10:16.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:10:16.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35ac736700 1 Processor -- start 2024-04-25T02:10:16.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35ac736700 1 -- start start 2024-04-25T02:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35ac736700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f35a406a270 0x7f35a406a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35ac736700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a406ab40 0x7f35a40915a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35ac736700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a4091a90 0x7f35a4091f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35ac736700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a4060040 con 0x7f35a406a270 2024-04-25T02:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35ac736700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4092430 con 0x7f35a4091a90 2024-04-25T02:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35ac736700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4065e00 con 0x7f35a406ab40 2024-04-25T02:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35a9cd1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a406ab40 0x7f35a40915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35aacd3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a4091a90 0x7f35a4091f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.537+0000 7f35aa4d2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f35a406a270 0x7f35a406a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a9cd1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a406ab40 0x7f35a40915a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51238/0 (socket says 172.21.15.78:51238) 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35aa4d2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f35a406a270 0x7f35a406a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38498/0 (socket says 172.21.15.78:38498) 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35aacd3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a4091a90 0x7f35a4091f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57888/0 (socket says 172.21.15.78:57888) 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a9cd1700 1 -- 172.21.15.78:0/1924269009 learned_addr learned my addr 172.21.15.78:0/1924269009 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a9cd1700 1 -- 172.21.15.78:0/1924269009 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a4091a90 msgr2=0x7f35a4091f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a9cd1700 1 --2- 172.21.15.78:0/1924269009 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a4091a90 0x7f35a4091f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a9cd1700 1 -- 172.21.15.78:0/1924269009 >> v2:172.21.15.78:3300/0 conn(0x7f35a406a270 msgr2=0x7f35a406a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a9cd1700 1 --2- 172.21.15.78:0/1924269009 >> v2:172.21.15.78:3300/0 conn(0x7f35a406a270 0x7f35a406a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a9cd1700 1 -- 172.21.15.78:0/1924269009 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40967d0 con 0x7f35a406ab40 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35aacd3700 1 --2- 172.21.15.78:0/1924269009 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a4091a90 0x7f35a4091f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35aa4d2700 1 --2- 172.21.15.78:0/1924269009 >> v2:172.21.15.78:3300/0 conn(0x7f35a406a270 0x7f35a406a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a9cd1700 1 --2- 172.21.15.78:0/1924269009 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a406ab40 0x7f35a40915a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3594009860 tx=0x7f35940090f0).ready entity=mon.2 client_cookie=b3ffb06ddf340f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a94d0700 1 -- 172.21.15.78:0/1924269009 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400f510 con 0x7f35a406ab40 2024-04-25T02:10:16.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a94d0700 1 -- 172.21.15.78:0/1924269009 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400f670 con 0x7f35a406ab40 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.538+0000 7f35a94d0700 1 -- 172.21.15.78:0/1924269009 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400f9f0 con 0x7f35a406ab40 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 -- 172.21.15.78:0/1924269009 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a406ab40 msgr2=0x7f35a40915a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 --2- 172.21.15.78:0/1924269009 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a406ab40 0x7f35a40915a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3594009860 tx=0x7f35940090f0).stop 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 -- 172.21.15.78:0/1924269009 shutdown_connections 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 --2- 172.21.15.78:0/1924269009 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a4091a90 0x7f35a4091f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 --2- 172.21.15.78:0/1924269009 >> v2:172.21.15.78:3300/0 conn(0x7f35a406a270 0x7f35a406a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 --2- 172.21.15.78:0/1924269009 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a406ab40 0x7f35a40915a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 -- 172.21.15.78:0/1924269009 >> 172.21.15.78:0/1924269009 conn(0x7f35a409abf0 msgr2=0x7f35a4096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 -- 172.21.15.78:0/1924269009 shutdown_connections 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 -- 172.21.15.78:0/1924269009 wait complete. 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.539+0000 7f35ac736700 1 Processor -- start 2024-04-25T02:10:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35ac736700 1 -- start start 2024-04-25T02:10:16.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35ac736700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35a406a270 0x7f35a408c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35ac736700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a4091a90 0x7f35a40883d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35ac736700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a40888c0 0x7f35a4088d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35ac736700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a408cac0 con 0x7f35a406a270 2024-04-25T02:10:16.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35ac736700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4095b10 con 0x7f35a40888c0 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35ac736700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a408be40 con 0x7f35a4091a90 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aa4d2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35a406a270 0x7f35a408c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aacd3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a40888c0 0x7f35a4088d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aa4d2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35a406a270 0x7f35a408c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38508/0 (socket says 172.21.15.78:38508) 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aa4d2700 1 -- 172.21.15.78:0/2103050229 learned_addr learned my addr 172.21.15.78:0/2103050229 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35a9cd1700 1 --2- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a4091a90 0x7f35a40883d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aa4d2700 1 -- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a4091a90 msgr2=0x7f35a40883d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aa4d2700 1 --2- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a4091a90 0x7f35a40883d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aa4d2700 1 -- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a40888c0 msgr2=0x7f35a4088d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aa4d2700 1 --2- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a40888c0 0x7f35a4088d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aa4d2700 1 -- 172.21.15.78:0/2103050229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00092a0 con 0x7f35a406a270 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aacd3700 1 --2- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a40888c0 0x7f35a4088d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.540+0000 7f35aa4d2700 1 --2- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35a406a270 0x7f35a408c340 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f35a000ea20 tx=0x7f35a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.541+0000 7f359affd700 1 -- 172.21.15.78:0/2103050229 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000c850 con 0x7f35a406a270 2024-04-25T02:10:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.541+0000 7f359affd700 1 -- 172.21.15.78:0/2103050229 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a000c9b0 con 0x7f35a406a270 2024-04-25T02:10:16.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.541+0000 7f359affd700 1 -- 172.21.15.78:0/2103050229 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000cd30 con 0x7f35a406a270 2024-04-25T02:10:16.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.541+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c00cb60 con 0x7f35a406a270 2024-04-25T02:10:16.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.541+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3594009370 con 0x7f35a406a270 2024-04-25T02:10:16.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.541+0000 7f359affd700 1 -- 172.21.15.78:0/2103050229 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f35a0012600 con 0x7f35a406a270 2024-04-25T02:10:16.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.542+0000 7f359affd700 1 -- 172.21.15.78:0/2103050229 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f35a003b7c0 con 0x7f35a406a270 2024-04-25T02:10:16.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.542+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a406c550 con 0x7f35a406a270 2024-04-25T02:10:16.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.546+0000 7f359affd700 1 -- 172.21.15.78:0/2103050229 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f35a001b400 con 0x7f35a406a270 2024-04-25T02:10:16.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.705+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f35a4095ee0 con 0x7f35a406a270 2024-04-25T02:10:16.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.705+0000 7f359affd700 1 -- 172.21.15.78:0/2103050229 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7f35a0023350 con 0x7f35a406a270 2024-04-25T02:10:16.713 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:10:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 >> v1:172.21.15.78:6816/46507 conn(0x7f358802bd00 legacy=0x7f358802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35a406a270 msgr2=0x7f35a408c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 --2- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35a406a270 0x7f35a408c340 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f35a000ea20 tx=0x7f35a0009060).stop 2024-04-25T02:10:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 shutdown_connections 2024-04-25T02:10:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 --2- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35a40888c0 0x7f35a4088d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 --2- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35a406a270 0x7f35a408c340 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 --2- 172.21.15.78:0/2103050229 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f35a4091a90 0x7f35a40883d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 >> 172.21.15.78:0/2103050229 conn(0x7f35a409abf0 msgr2=0x7f35a4068de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:16.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 shutdown_connections 2024-04-25T02:10:16.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.707+0000 7f35ac736700 1 -- 172.21.15.78:0/2103050229 wait complete. 2024-04-25T02:10:16.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:10:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.836+0000 7f9ffe16b700 1 Processor -- start 2024-04-25T02:10:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.836+0000 7f9ffe16b700 1 -- start start 2024-04-25T02:10:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ffe16b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8090d40 0x7f9ff8096220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ffe16b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff8096710 0x7f9ff8132390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ffe16b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80931b0 con 0x7f9ff8097750 2024-04-25T02:10:16.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ffe16b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff8097b30 con 0x7f9ff8096710 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ffe16b700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff8092640 con 0x7f9ff8090d40 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff77fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9ff8097750 0x7f9ff8095b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48494/0 (socket says 172.21.15.78:48494) 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff6ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8090d40 0x7f9ff8096220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff7fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff8096710 0x7f9ff8132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff77fe700 1 -- 172.21.15.78:0/4233770229 learned_addr learned my addr 172.21.15.78:0/4233770229 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff6ffd700 1 -- 172.21.15.78:0/4233770229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff8096710 msgr2=0x7f9ff8132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff6ffd700 1 --2- 172.21.15.78:0/4233770229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff8096710 0x7f9ff8132390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff67fc700 1 -- 172.21.15.78:0/4233770229 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010977563 0 0) 0x7f9ff80931b0 con 0x7f9ff8097750 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff6ffd700 1 -- 172.21.15.78:0/4233770229 >> v1:172.21.15.78:6789/0 conn(0x7f9ff8097750 legacy=0x7f9ff8095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff6ffd700 1 -- 172.21.15.78:0/4233770229 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff805ed80 con 0x7f9ff8090d40 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff6ffd700 1 --2- 172.21.15.78:0/4233770229 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8090d40 0x7f9ff8096220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9fe0009790 tx=0x7f9fe0009060).ready entity=mon.2 client_cookie=7637b881af879d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff67fc700 1 -- 172.21.15.78:0/4233770229 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000f510 con 0x7f9ff8090d40 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff67fc700 1 -- 172.21.15.78:0/4233770229 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000f670 con 0x7f9ff8090d40 2024-04-25T02:10:16.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.837+0000 7f9ff67fc700 1 -- 172.21.15.78:0/4233770229 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000f9f0 con 0x7f9ff8090d40 2024-04-25T02:10:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.838+0000 7f9ffe16b700 1 -- 172.21.15.78:0/4233770229 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8090d40 msgr2=0x7f9ff8096220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.838+0000 7f9ffe16b700 1 --2- 172.21.15.78:0/4233770229 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8090d40 0x7f9ff8096220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9fe0009790 tx=0x7f9fe0009060).stop 2024-04-25T02:10:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.838+0000 7f9ffe16b700 1 -- 172.21.15.78:0/4233770229 shutdown_connections 2024-04-25T02:10:16.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.838+0000 7f9ffe16b700 1 --2- 172.21.15.78:0/4233770229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff8096710 0x7f9ff8132390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.838+0000 7f9ffe16b700 1 --2- 172.21.15.78:0/4233770229 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8090d40 0x7f9ff8096220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.838+0000 7f9ffe16b700 1 -- 172.21.15.78:0/4233770229 >> 172.21.15.78:0/4233770229 conn(0x7f9ff809abf0 msgr2=0x7f9ff8096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.838+0000 7f9ffe16b700 1 -- 172.21.15.78:0/4233770229 shutdown_connections 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.838+0000 7f9ffe16b700 1 -- 172.21.15.78:0/4233770229 wait complete. 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.839+0000 7f9ffe16b700 1 Processor -- start 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.839+0000 7f9ffe16b700 1 -- start start 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.839+0000 7f9ffe16b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8096710 0x7f9ff808e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.839+0000 7f9ffe16b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff8097750 0x7f9ff808b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.839+0000 7f9ffe16b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff808ba50 0x7f9ff808bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.839+0000 7f9ffe16b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff808c3c0 con 0x7f9ff8097750 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.839+0000 7f9ffe16b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff808d0e0 con 0x7f9ff808ba50 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.839+0000 7f9ffe16b700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff808fbd0 con 0x7f9ff8096710 2024-04-25T02:10:16.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff77fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8096710 0x7f9ff808e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff77fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8096710 0x7f9ff808e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51270/0 (socket says 172.21.15.78:51270) 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff8097750 0x7f9ff808b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff7fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff808ba50 0x7f9ff808bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff77fe700 1 -- 172.21.15.78:0/749493698 learned_addr learned my addr 172.21.15.78:0/749493698 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff77fe700 1 -- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff808ba50 msgr2=0x7f9ff808bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff77fe700 1 --2- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff808ba50 0x7f9ff808bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff77fe700 1 -- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff8097750 msgr2=0x7f9ff808b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff77fe700 1 --2- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff8097750 0x7f9ff808b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff77fe700 1 -- 172.21.15.78:0/749493698 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00092a0 con 0x7f9ff8096710 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff7fff700 1 --2- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff808ba50 0x7f9ff808bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ff77fe700 1 --2- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8096710 0x7f9ff808e3a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9fe800c4c0 tx=0x7f9fe8007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9feffff700 1 -- 172.21.15.78:0/749493698 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800ce30 con 0x7f9ff8096710 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9feffff700 1 -- 172.21.15.78:0/749493698 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe80072e0 con 0x7f9ff8096710 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9feffff700 1 -- 172.21.15.78:0/749493698 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80057a0 con 0x7f9ff8096710 2024-04-25T02:10:16.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff8092af0 con 0x7f9ff8096710 2024-04-25T02:10:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.840+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff8099040 con 0x7f9ff8096710 2024-04-25T02:10:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.841+0000 7f9feffff700 1 -- 172.21.15.78:0/749493698 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9fe8005bd0 con 0x7f9ff8096710 2024-04-25T02:10:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.841+0000 7f9feffff700 1 -- 172.21.15.78:0/749493698 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9fe803a750 con 0x7f9ff8096710 2024-04-25T02:10:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.841+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff806c550 con 0x7f9ff8096710 2024-04-25T02:10:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:16.845+0000 7f9feffff700 1 -- 172.21.15.78:0/749493698 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f9fe801d3f0 con 0x7f9ff8096710 2024-04-25T02:10:17.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.003+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ff8046ce0 con 0x7f9ff8096710 2024-04-25T02:10:17.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.003+0000 7f9feffff700 1 -- 172.21.15.78:0/749493698 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9fe801c350 con 0x7f9ff8096710 2024-04-25T02:10:17.011 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 >> v1:172.21.15.78:6816/46507 conn(0x7f9fd802bd30 legacy=0x7f9fd802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8096710 msgr2=0x7f9ff808e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 --2- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8096710 0x7f9ff808e3a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9fe800c4c0 tx=0x7f9fe8007c10).stop 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 shutdown_connections 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 --2- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ff808ba50 0x7f9ff808bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 --2- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9ff8096710 0x7f9ff808e3a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 --2- 172.21.15.78:0/749493698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ff8097750 0x7f9ff808b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 >> 172.21.15.78:0/749493698 conn(0x7f9ff809abf0 msgr2=0x7f9ff8097f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 shutdown_connections 2024-04-25T02:10:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.005+0000 7f9ffe16b700 1 -- 172.21.15.78:0/749493698 wait complete. 2024-04-25T02:10:17.024 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:10:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.132+0000 7f01cc018700 1 Processor -- start 2024-04-25T02:10:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.132+0000 7f01cc018700 1 -- start start 2024-04-25T02:10:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01cc018700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01c4095c80 0x7f01c412d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01cc018700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c412d500 0x7f01c412f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01cc018700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c4094c70 con 0x7f01c4095190 2024-04-25T02:10:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01cc018700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c4096060 con 0x7f01c4095c80 2024-04-25T02:10:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01cc018700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4096570 con 0x7f01c412d500 2024-04-25T02:10:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01ca5b5700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c412d500 0x7f01c412f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01c95b3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01c4095c80 0x7f01c412d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01c9db4700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f01c4095190 0x7f01c4095570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48510/0 (socket says 172.21.15.78:48510) 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01c9db4700 1 -- 172.21.15.78:0/1569041260 learned_addr learned my addr 172.21.15.78:0/1569041260 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01ca5b5700 1 -- 172.21.15.78:0/1569041260 >> v2:172.21.15.78:3300/0 conn(0x7f01c4095c80 msgr2=0x7f01c412d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01ca5b5700 1 --2- 172.21.15.78:0/1569041260 >> v2:172.21.15.78:3300/0 conn(0x7f01c4095c80 0x7f01c412d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01ca5b5700 1 -- 172.21.15.78:0/1569041260 >> v1:172.21.15.78:6789/0 conn(0x7f01c4095190 legacy=0x7f01c4095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01c8db2700 1 -- 172.21.15.78:0/1569041260 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341860141 0 0) 0x7f01c4094c70 con 0x7f01c4095190 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01ca5b5700 1 -- 172.21.15.78:0/1569041260 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c4096da0 con 0x7f01c412d500 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01c95b3700 1 --2- 172.21.15.78:0/1569041260 >> v2:172.21.15.78:3300/0 conn(0x7f01c4095c80 0x7f01c412d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01ca5b5700 1 --2- 172.21.15.78:0/1569041260 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c412d500 0x7f01c412f8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f01bc009e60 tx=0x7f01bc009780).ready entity=mon.2 client_cookie=225ea2425c6353a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.133+0000 7f01c8db2700 1 -- 172.21.15.78:0/1569041260 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00e070 con 0x7f01c412d500 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01c8db2700 1 -- 172.21.15.78:0/1569041260 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc00bb60 con 0x7f01c412d500 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01c8db2700 1 -- 172.21.15.78:0/1569041260 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc012410 con 0x7f01c412d500 2024-04-25T02:10:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01cc018700 1 -- 172.21.15.78:0/1569041260 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c412d500 msgr2=0x7f01c412f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01cc018700 1 --2- 172.21.15.78:0/1569041260 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c412d500 0x7f01c412f8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f01bc009e60 tx=0x7f01bc009780).stop 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01cc018700 1 -- 172.21.15.78:0/1569041260 shutdown_connections 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01cc018700 1 --2- 172.21.15.78:0/1569041260 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c412d500 0x7f01c412f8f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01cc018700 1 --2- 172.21.15.78:0/1569041260 >> v2:172.21.15.78:3300/0 conn(0x7f01c4095c80 0x7f01c412d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01cc018700 1 -- 172.21.15.78:0/1569041260 >> 172.21.15.78:0/1569041260 conn(0x7f01c409a970 msgr2=0x7f01c409ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01cc018700 1 -- 172.21.15.78:0/1569041260 shutdown_connections 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.134+0000 7f01cc018700 1 -- 172.21.15.78:0/1569041260 wait complete. 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01cc018700 1 Processor -- start 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01cc018700 1 -- start start 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01cc018700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c4095190 0x7f01c411dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01cc018700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01c4095c80 0x7f01c4119f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01cc018700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c412d500 0x7f01c411a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01cc018700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c412d140 con 0x7f01c412d500 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01cc018700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c411c680 con 0x7f01c4095c80 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01cc018700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01c411d520 con 0x7f01c4095190 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01ca5b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c412d500 0x7f01c411a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01c9db4700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c4095190 0x7f01c411dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01c95b3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01c4095c80 0x7f01c4119f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01ca5b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c412d500 0x7f01c411a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38532/0 (socket says 172.21.15.78:38532) 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.135+0000 7f01ca5b5700 1 -- 172.21.15.78:0/3291630596 learned_addr learned my addr 172.21.15.78:0/3291630596 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01c9db4700 1 -- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01c4095c80 msgr2=0x7f01c4119f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01c9db4700 1 --2- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01c4095c80 0x7f01c4119f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01c9db4700 1 -- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c412d500 msgr2=0x7f01c411a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01c9db4700 1 --2- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c412d500 0x7f01c411a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01c9db4700 1 -- 172.21.15.78:0/3291630596 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c000b540 con 0x7f01c4095190 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01ca5b5700 1 --2- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c412d500 0x7f01c411a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01c9db4700 1 --2- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c4095190 0x7f01c411dfc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f01b8000c00 tx=0x7f01b8007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01b67fc700 1 -- 172.21.15.78:0/3291630596 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80070d0 con 0x7f01c4095190 2024-04-25T02:10:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01b67fc700 1 -- 172.21.15.78:0/3291630596 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b8007250 con 0x7f01c4095190 2024-04-25T02:10:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01bc009a20 con 0x7f01c4095190 2024-04-25T02:10:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01b67fc700 1 -- 172.21.15.78:0/3291630596 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8007610 con 0x7f01c4095190 2024-04-25T02:10:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.136+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c411bbb0 con 0x7f01c4095190 2024-04-25T02:10:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.137+0000 7f01b67fc700 1 -- 172.21.15.78:0/3291630596 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f01b80059b0 con 0x7f01c4095190 2024-04-25T02:10:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.137+0000 7f01b67fc700 1 -- 172.21.15.78:0/3291630596 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f01b803a8a0 con 0x7f01c4095190 2024-04-25T02:10:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.137+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c4092fb0 con 0x7f01c4095190 2024-04-25T02:10:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.141+0000 7f01b67fc700 1 -- 172.21.15.78:0/3291630596 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f01b8013970 con 0x7f01c4095190 2024-04-25T02:10:17.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.301+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01c411bd70 con 0x7f01c4095190 2024-04-25T02:10:17.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.302+0000 7f01b67fc700 1 -- 172.21.15.78:0/3291630596 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01b8018020 con 0x7f01c4095190 2024-04-25T02:10:17.310 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-25T02:10:17.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.303+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 >> v1:172.21.15.78:6816/46507 conn(0x7f01a802bd00 legacy=0x7f01a802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.303+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c4095190 msgr2=0x7f01c411dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.303+0000 7f01cc018700 1 --2- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c4095190 0x7f01c411dfc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f01b8000c00 tx=0x7f01b8007b90).stop 2024-04-25T02:10:17.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.304+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 shutdown_connections 2024-04-25T02:10:17.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.304+0000 7f01cc018700 1 --2- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01c412d500 0x7f01c411a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.304+0000 7f01cc018700 1 --2- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f01c4095190 0x7f01c411dfc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.304+0000 7f01cc018700 1 --2- 172.21.15.78:0/3291630596 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01c4095c80 0x7f01c4119f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.304+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 >> 172.21.15.78:0/3291630596 conn(0x7f01c409a970 msgr2=0x7f01c4068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:17.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.304+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 shutdown_connections 2024-04-25T02:10:17.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.304+0000 7f01cc018700 1 -- 172.21.15.78:0/3291630596 wait complete. 2024-04-25T02:10:17.323 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.432+0000 7f3b6977b700 1 Processor -- start 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.432+0000 7f3b6977b700 1 -- start start 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.432+0000 7f3b6977b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b64064b70 0x7f3b64098840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.432+0000 7f3b6977b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b64098d30 0x7f3b64099130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.432+0000 7f3b6977b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b64091c40 con 0x7f3b6412a7c0 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.432+0000 7f3b6977b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b64064f50 con 0x7f3b64098d30 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.432+0000 7f3b6977b700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64065930 con 0x7f3b64064b70 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b62ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b64064b70 0x7f3b64098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b5bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b64098d30 0x7f3b64099130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b62ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b64064b70 0x7f3b64098840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51290/0 (socket says 172.21.15.78:51290) 2024-04-25T02:10:17.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b62ffd700 1 -- 172.21.15.78:0/446884867 learned_addr learned my addr 172.21.15.78:0/446884867 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b62ffd700 1 -- 172.21.15.78:0/446884867 >> v2:172.21.15.78:3300/0 conn(0x7f3b64098d30 msgr2=0x7f3b64099130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b62ffd700 1 --2- 172.21.15.78:0/446884867 >> v2:172.21.15.78:3300/0 conn(0x7f3b64098d30 0x7f3b64099130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b62ffd700 1 -- 172.21.15.78:0/446884867 >> v1:172.21.15.78:6789/0 conn(0x7f3b6412a7c0 legacy=0x7f3b6412ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b62ffd700 1 -- 172.21.15.78:0/446884867 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64098530 con 0x7f3b64064b70 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b627fc700 1 -- 172.21.15.78:0/446884867 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509424831 0 0) 0x7f3b64091c40 con 0x7f3b6412a7c0 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b5bfff700 1 --2- 172.21.15.78:0/446884867 >> v2:172.21.15.78:3300/0 conn(0x7f3b64098d30 0x7f3b64099130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b62ffd700 1 --2- 172.21.15.78:0/446884867 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b64064b70 0x7f3b64098840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3b54009830 tx=0x7f3b540090f0).ready entity=mon.2 client_cookie=8eca919a6f12842c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b627fc700 1 -- 172.21.15.78:0/446884867 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5400b580 con 0x7f3b64064b70 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b627fc700 1 -- 172.21.15.78:0/446884867 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5400b6e0 con 0x7f3b64064b70 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.433+0000 7f3b627fc700 1 -- 172.21.15.78:0/446884867 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5400ba60 con 0x7f3b64064b70 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.434+0000 7f3b6977b700 1 -- 172.21.15.78:0/446884867 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b64064b70 msgr2=0x7f3b64098840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.434+0000 7f3b6977b700 1 --2- 172.21.15.78:0/446884867 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b64064b70 0x7f3b64098840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3b54009830 tx=0x7f3b540090f0).stop 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.434+0000 7f3b6977b700 1 -- 172.21.15.78:0/446884867 shutdown_connections 2024-04-25T02:10:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.434+0000 7f3b6977b700 1 --2- 172.21.15.78:0/446884867 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b64064b70 0x7f3b64098840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.434+0000 7f3b6977b700 1 --2- 172.21.15.78:0/446884867 >> v2:172.21.15.78:3300/0 conn(0x7f3b64098d30 0x7f3b64099130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.434+0000 7f3b6977b700 1 -- 172.21.15.78:0/446884867 >> 172.21.15.78:0/446884867 conn(0x7f3b6409e7a0 msgr2=0x7f3b6409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.434+0000 7f3b6977b700 1 -- 172.21.15.78:0/446884867 shutdown_connections 2024-04-25T02:10:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.434+0000 7f3b6977b700 1 -- 172.21.15.78:0/446884867 wait complete. 2024-04-25T02:10:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b6977b700 1 Processor -- start 2024-04-25T02:10:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b6977b700 1 -- start start 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b6977b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64098d30 0x7f3b64116a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b6977b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b6412a7c0 0x7f3b64116ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b6977b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b641173e0 0x7f3b64117860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b6977b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64127b60 con 0x7f3b64098d30 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b6977b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64099a80 con 0x7f3b6412a7c0 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b6977b700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64119f90 con 0x7f3b641173e0 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b62ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64098d30 0x7f3b64116a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b62ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64098d30 0x7f3b64116a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38548/0 (socket says 172.21.15.78:38548) 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b62ffd700 1 -- 172.21.15.78:0/2963500897 learned_addr learned my addr 172.21.15.78:0/2963500897 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b5bfff700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b6412a7c0 0x7f3b64116ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b637fe700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b641173e0 0x7f3b64117860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b637fe700 1 -- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b6412a7c0 msgr2=0x7f3b64116ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b637fe700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b6412a7c0 0x7f3b64116ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b637fe700 1 -- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64098d30 msgr2=0x7f3b64116a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b637fe700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64098d30 0x7f3b64116a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b637fe700 1 -- 172.21.15.78:0/2963500897 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0092a0 con 0x7f3b641173e0 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b5bfff700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b6412a7c0 0x7f3b64116ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.435+0000 7f3b62ffd700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64098d30 0x7f3b64116a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.436+0000 7f3b637fe700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b641173e0 0x7f3b64117860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3b5c00c730 tx=0x7f3b5c007ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.436+0000 7f3b5b7fe700 1 -- 172.21.15.78:0/2963500897 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00e4a0 con 0x7f3b641173e0 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.436+0000 7f3b5b7fe700 1 -- 172.21.15.78:0/2963500897 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c00e600 con 0x7f3b641173e0 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.436+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b54009370 con 0x7f3b641173e0 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.436+0000 7f3b5b7fe700 1 -- 172.21.15.78:0/2963500897 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00e9c0 con 0x7f3b641173e0 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.436+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b64117d50 con 0x7f3b641173e0 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.436+0000 7f3b5b7fe700 1 -- 172.21.15.78:0/2963500897 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f3b5c012400 con 0x7f3b641173e0 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.436+0000 7f3b5b7fe700 1 -- 172.21.15.78:0/2963500897 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3b5c03a930 con 0x7f3b641173e0 2024-04-25T02:10:17.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.437+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6409cc60 con 0x7f3b641173e0 2024-04-25T02:10:17.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.441+0000 7f3b5b7fe700 1 -- 172.21.15.78:0/2963500897 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f3b5c017030 con 0x7f3b641173e0 2024-04-25T02:10:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.598+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b64063870 con 0x7f3b641173e0 2024-04-25T02:10:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.599+0000 7f3b5b7fe700 1 -- 172.21.15.78:0/2963500897 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b5c0126b0 con 0x7f3b641173e0 2024-04-25T02:10:17.607 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-25T02:10:17.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.600+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 >> v1:172.21.15.78:6816/46507 conn(0x7f3b4402bd30 legacy=0x7f3b4402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.600+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b641173e0 msgr2=0x7f3b64117860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.600+0000 7f3b6977b700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b641173e0 0x7f3b64117860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3b5c00c730 tx=0x7f3b5c007ee0).stop 2024-04-25T02:10:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.601+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 shutdown_connections 2024-04-25T02:10:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.601+0000 7f3b6977b700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3b641173e0 0x7f3b64117860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.601+0000 7f3b6977b700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64098d30 0x7f3b64116a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.601+0000 7f3b6977b700 1 --2- 172.21.15.78:0/2963500897 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b6412a7c0 0x7f3b64116ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.601+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 >> 172.21.15.78:0/2963500897 conn(0x7f3b64064b70 msgr2=0x7f3b64096f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.601+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 shutdown_connections 2024-04-25T02:10:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.601+0000 7f3b6977b700 1 -- 172.21.15.78:0/2963500897 wait complete. 2024-04-25T02:10:17.620 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:17.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.726+0000 7fe973027700 1 Processor -- start 2024-04-25T02:10:17.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.726+0000 7fe973027700 1 -- start start 2024-04-25T02:10:17.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe973027700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c128930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe973027700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe96c128e20 0x7fe96c093c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe973027700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c0945c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe973027700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c062c40 con 0x7fe96c128e20 2024-04-25T02:10:17.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe973027700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0965c0 con 0x7fe96c062860 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe973027700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c094ab0 con 0x7fe96c094110 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe96bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe96c128e20 0x7fe96c093c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe970dc3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c128930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe9715c4700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c0945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe96bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe96c128e20 0x7fe96c093c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38550/0 (socket says 172.21.15.78:38550) 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe9715c4700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c0945c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51308/0 (socket says 172.21.15.78:51308) 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe970dc3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c128930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57950/0 (socket says 172.21.15.78:57950) 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe96bfff700 1 -- 172.21.15.78:0/776754564 learned_addr learned my addr 172.21.15.78:0/776754564 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe9715c4700 1 -- 172.21.15.78:0/776754564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 msgr2=0x7fe96c128930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe9715c4700 1 --2- 172.21.15.78:0/776754564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c128930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe9715c4700 1 -- 172.21.15.78:0/776754564 >> v2:172.21.15.78:3300/0 conn(0x7fe96c128e20 msgr2=0x7fe96c093c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe9715c4700 1 --2- 172.21.15.78:0/776754564 >> v2:172.21.15.78:3300/0 conn(0x7fe96c128e20 0x7fe96c093c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe9715c4700 1 -- 172.21.15.78:0/776754564 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c063310 con 0x7fe96c094110 2024-04-25T02:10:17.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe96bfff700 1 --2- 172.21.15.78:0/776754564 >> v2:172.21.15.78:3300/0 conn(0x7fe96c128e20 0x7fe96c093c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.727+0000 7fe9715c4700 1 --2- 172.21.15.78:0/776754564 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c0945c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fe964009e90 tx=0x7fe964009780).ready entity=mon.2 client_cookie=da4f0d5f0eb4eae1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe96b7fe700 1 -- 172.21.15.78:0/776754564 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400e070 con 0x7fe96c094110 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe96b7fe700 1 -- 172.21.15.78:0/776754564 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96400ba70 con 0x7fe96c094110 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe96b7fe700 1 -- 172.21.15.78:0/776754564 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400bdf0 con 0x7fe96c094110 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe973027700 1 -- 172.21.15.78:0/776754564 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 msgr2=0x7fe96c0945c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe973027700 1 --2- 172.21.15.78:0/776754564 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c0945c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fe964009e90 tx=0x7fe964009780).stop 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe973027700 1 -- 172.21.15.78:0/776754564 shutdown_connections 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe973027700 1 --2- 172.21.15.78:0/776754564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c128930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe973027700 1 --2- 172.21.15.78:0/776754564 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c0945c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe973027700 1 --2- 172.21.15.78:0/776754564 >> v2:172.21.15.78:3300/0 conn(0x7fe96c128e20 0x7fe96c093c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe973027700 1 -- 172.21.15.78:0/776754564 >> 172.21.15.78:0/776754564 conn(0x7fe96c097450 msgr2=0x7fe96c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe973027700 1 -- 172.21.15.78:0/776754564 shutdown_connections 2024-04-25T02:10:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.728+0000 7fe973027700 1 -- 172.21.15.78:0/776754564 wait complete. 2024-04-25T02:10:17.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.729+0000 7fe973027700 1 Processor -- start 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.729+0000 7fe973027700 1 -- start start 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe973027700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe973027700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c069340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe973027700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96c128e20 0x7fe96c069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe973027700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c1284e0 con 0x7fe96c128e20 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe973027700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0956f0 con 0x7fe96c062860 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe973027700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c111680 con 0x7fe96c094110 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe970dc3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe9715c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96c128e20 0x7fe96c069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe970dc3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c068e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57966/0 (socket says 172.21.15.78:57966) 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe970dc3700 1 -- 172.21.15.78:0/89398330 learned_addr learned my addr 172.21.15.78:0/89398330 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe96bfff700 1 -- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 msgr2=0x7fe96c068e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe96bfff700 1 --2- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c068e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe96bfff700 1 -- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96c128e20 msgr2=0x7fe96c069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe96bfff700 1 --2- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96c128e20 0x7fe96c069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe96bfff700 1 -- 172.21.15.78:0/89398330 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe958009370 con 0x7fe96c094110 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe96bfff700 1 --2- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c069340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe958006fd0 tx=0x7fe9580090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe9697fa700 1 -- 172.21.15.78:0/89398330 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958009650 con 0x7fe96c094110 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe9697fa700 1 -- 172.21.15.78:0/89398330 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95800c6a0 con 0x7fe96c094110 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe964009a20 con 0x7fe96c094110 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe9697fa700 1 -- 172.21.15.78:0/89398330 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800ca20 con 0x7fe96c094110 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.730+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c113640 con 0x7fe96c094110 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.731+0000 7fe9697fa700 1 -- 172.21.15.78:0/89398330 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fe95801b400 con 0x7fe96c094110 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.731+0000 7fe9697fa700 1 -- 172.21.15.78:0/89398330 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe95803b470 con 0x7fe96c094110 2024-04-25T02:10:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.731+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c069d20 con 0x7fe96c094110 2024-04-25T02:10:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.736+0000 7fe9697fa700 1 -- 172.21.15.78:0/89398330 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fe95801b6b0 con 0x7fe96c094110 2024-04-25T02:10:17.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.931+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe96c113640 con 0x7fe96c094110 2024-04-25T02:10:17.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.931+0000 7fe9697fa700 1 -- 172.21.15.78:0/89398330 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fe96c113640 con 0x7fe96c094110 2024-04-25T02:10:17.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:17.940 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:02.698771+0000","modified":"2024-04-25T02:10:04.706190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:10:17.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.933+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 >> v1:172.21.15.78:6816/46507 conn(0x7fe95002bd00 legacy=0x7fe95002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.933+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 msgr2=0x7fe96c069340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:17.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.933+0000 7fe973027700 1 --2- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c069340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe958006fd0 tx=0x7fe9580090f0).stop 2024-04-25T02:10:17.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.933+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 shutdown_connections 2024-04-25T02:10:17.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.933+0000 7fe973027700 1 --2- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96c128e20 0x7fe96c069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.933+0000 7fe973027700 1 --2- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe96c062860 0x7fe96c068e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.933+0000 7fe973027700 1 --2- 172.21.15.78:0/89398330 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe96c094110 0x7fe96c069340 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:17.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.933+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 >> 172.21.15.78:0/89398330 conn(0x7fe96c097450 msgr2=0x7fe96c124220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:17.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.933+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 shutdown_connections 2024-04-25T02:10:17.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:17.934+0000 7fe973027700 1 -- 172.21.15.78:0/89398330 wait complete. 2024-04-25T02:10:17.942 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-25T02:10:17.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea52880700 1 Processor -- start 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea52880700 1 -- start start 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea52880700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c0669e0 0x7fea4c098600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea52880700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c1285d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea52880700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4c0661e0 con 0x7fea4c125dc0 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea52880700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c066dc0 con 0x7fea4c125940 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea52880700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c065f20 con 0x7fea4c0669e0 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea4b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c1285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea4bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c0669e0 0x7fea4c098600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea50e1d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fea4c125dc0 0x7fea4c128ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48532/0 (socket says 172.21.15.78:48532) 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea4b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c1285d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57976/0 (socket says 172.21.15.78:57976) 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea50e1d700 1 -- 172.21.15.78:0/1273173069 learned_addr learned my addr 172.21.15.78:0/1273173069 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.061+0000 7fea4affd700 1 -- 172.21.15.78:0/1273173069 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345045074 0 0) 0x7fea4c0661e0 con 0x7fea4c125dc0 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4affd700 1 -- 172.21.15.78:0/1273173069 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea340033f0 con 0x7fea4c125dc0 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4bfff700 1 -- 172.21.15.78:0/1273173069 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 msgr2=0x7fea4c1285d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4bfff700 1 --2- 172.21.15.78:0/1273173069 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c1285d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4bfff700 1 -- 172.21.15.78:0/1273173069 >> v1:172.21.15.78:6789/0 conn(0x7fea4c125dc0 legacy=0x7fea4c128ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4bfff700 1 -- 172.21.15.78:0/1273173069 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0990f0 con 0x7fea4c0669e0 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4b7fe700 1 --2- 172.21.15.78:0/1273173069 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c1285d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4bfff700 1 --2- 172.21.15.78:0/1273173069 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c0669e0 0x7fea4c098600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fea3c009790 tx=0x7fea3c009060).ready entity=mon.2 client_cookie=226b03313591a5c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4affd700 1 -- 172.21.15.78:0/1273173069 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0090d0 con 0x7fea4c0669e0 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4affd700 1 -- 172.21.15.78:0/1273173069 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c00f510 con 0x7fea4c0669e0 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea4affd700 1 -- 172.21.15.78:0/1273173069 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00f890 con 0x7fea4c0669e0 2024-04-25T02:10:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea52880700 1 -- 172.21.15.78:0/1273173069 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c0669e0 msgr2=0x7fea4c098600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea52880700 1 --2- 172.21.15.78:0/1273173069 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c0669e0 0x7fea4c098600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fea3c009790 tx=0x7fea3c009060).stop 2024-04-25T02:10:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea52880700 1 -- 172.21.15.78:0/1273173069 shutdown_connections 2024-04-25T02:10:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea52880700 1 --2- 172.21.15.78:0/1273173069 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c0669e0 0x7fea4c098600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea52880700 1 --2- 172.21.15.78:0/1273173069 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c1285d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea52880700 1 -- 172.21.15.78:0/1273173069 >> 172.21.15.78:0/1273173069 conn(0x7fea4c096210 msgr2=0x7fea4c096620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea52880700 1 -- 172.21.15.78:0/1273173069 shutdown_connections 2024-04-25T02:10:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.062+0000 7fea52880700 1 -- 172.21.15.78:0/1273173069 wait complete. 2024-04-25T02:10:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.063+0000 7fea52880700 1 Processor -- start 2024-04-25T02:10:18.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea52880700 1 -- start start 2024-04-25T02:10:18.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea52880700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea4c0669e0 0x7fea4c116a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea52880700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea52880700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c125dc0 0x7fea4c112f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea52880700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c123bb0 con 0x7fea4c0669e0 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea52880700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c0656d0 con 0x7fea4c125940 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea52880700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c115fe0 con 0x7fea4c125dc0 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea4c0669e0 0x7fea4c116a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea50e1d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c125dc0 0x7fea4c112f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea4c0669e0 0x7fea4c116a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38574/0 (socket says 172.21.15.78:38574) 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea50e1d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c125dc0 0x7fea4c112f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51334/0 (socket says 172.21.15.78:51334) 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4bfff700 1 -- 172.21.15.78:0/2987215752 learned_addr learned my addr 172.21.15.78:0/2987215752 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4b7fe700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c112aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57992/0 (socket says 172.21.15.78:57992) 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4b7fe700 1 -- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c125dc0 msgr2=0x7fea4c112f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4b7fe700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c125dc0 0x7fea4c112f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4b7fe700 1 -- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea4c0669e0 msgr2=0x7fea4c116a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4b7fe700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea4c0669e0 0x7fea4c116a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4b7fe700 1 -- 172.21.15.78:0/2987215752 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea400092a0 con 0x7fea4c125940 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea4bfff700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea4c0669e0 0x7fea4c116a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.064+0000 7fea50e1d700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c125dc0 0x7fea4c112f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.065+0000 7fea4b7fe700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c112aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fea4000e980 tx=0x7fea40009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.065+0000 7fea48ff9700 1 -- 172.21.15.78:0/2987215752 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40012600 con 0x7fea4c125940 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.065+0000 7fea48ff9700 1 -- 172.21.15.78:0/2987215752 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40012760 con 0x7fea4c125940 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.065+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c0092a0 con 0x7fea4c125940 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.065+0000 7fea48ff9700 1 -- 172.21.15.78:0/2987215752 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40012b00 con 0x7fea4c125940 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.065+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c114670 con 0x7fea4c125940 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.065+0000 7fea48ff9700 1 -- 172.21.15.78:0/2987215752 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fea4001b400 con 0x7fea4c125940 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.065+0000 7fea48ff9700 1 -- 172.21.15.78:0/2987215752 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fea4003b600 con 0x7fea4c125940 2024-04-25T02:10:18.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.066+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4c1241c0 con 0x7fea4c125940 2024-04-25T02:10:18.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.070+0000 7fea48ff9700 1 -- 172.21.15.78:0/2987215752 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fea40016070 con 0x7fea4c125940 2024-04-25T02:10:18.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.229+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea4c096d30 con 0x7fea4c125940 2024-04-25T02:10:18.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.230+0000 7fea48ff9700 1 -- 172.21.15.78:0/2987215752 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11309 (secure 0 0 0) 0x7fea40016020 con 0x7fea4c125940 2024-04-25T02:10:18.238 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:18.238 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:03.700137+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 >> v1:172.21.15.78:6816/46507 conn(0x7fea3802bd00 legacy=0x7fea3802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 msgr2=0x7fea4c112aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c112aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fea4000e980 tx=0x7fea40009060).stop 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 shutdown_connections 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fea4c125dc0 0x7fea4c112f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea4c0669e0 0x7fea4c116a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 --2- 172.21.15.78:0/2987215752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea4c125940 0x7fea4c112aa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 >> 172.21.15.78:0/2987215752 conn(0x7fea4c096210 msgr2=0x7fea4c0694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 shutdown_connections 2024-04-25T02:10:18.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.232+0000 7fea52880700 1 -- 172.21.15.78:0/2987215752 wait complete. 2024-04-25T02:10:18.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.360+0000 7f9bef2ed700 1 Processor -- start 2024-04-25T02:10:18.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.360+0000 7f9bef2ed700 1 -- start start 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.360+0000 7f9bef2ed700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be80961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.360+0000 7f9bef2ed700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9be80937a0 0x7f9be81243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.360+0000 7f9bef2ed700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be81274e0 0x7f9be8127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.360+0000 7f9bef2ed700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be8096cf0 con 0x7f9be80937a0 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.360+0000 7f9bef2ed700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8093ba0 con 0x7f9be81274e0 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.360+0000 7f9bef2ed700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8092d00 con 0x7f9be8124000 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bec888700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9be80937a0 0x7f9be81243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed88a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be81274e0 0x7f9be8127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed089700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be80961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed88a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be81274e0 0x7f9be8127990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:57998/0 (socket says 172.21.15.78:57998) 2024-04-25T02:10:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bec888700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9be80937a0 0x7f9be81243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38576/0 (socket says 172.21.15.78:38576) 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed089700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be80961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51338/0 (socket says 172.21.15.78:51338) 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed88a700 1 -- 172.21.15.78:0/4017760663 learned_addr learned my addr 172.21.15.78:0/4017760663 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed089700 1 -- 172.21.15.78:0/4017760663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be81274e0 msgr2=0x7f9be8127990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed089700 1 --2- 172.21.15.78:0/4017760663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be81274e0 0x7f9be8127990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed089700 1 -- 172.21.15.78:0/4017760663 >> v2:172.21.15.78:3300/0 conn(0x7f9be80937a0 msgr2=0x7f9be81243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed089700 1 --2- 172.21.15.78:0/4017760663 >> v2:172.21.15.78:3300/0 conn(0x7f9be80937a0 0x7f9be81243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed089700 1 -- 172.21.15.78:0/4017760663 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be80933a0 con 0x7f9be8124000 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bec888700 1 --2- 172.21.15.78:0/4017760663 >> v2:172.21.15.78:3300/0 conn(0x7f9be80937a0 0x7f9be81243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bed089700 1 --2- 172.21.15.78:0/4017760663 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be80961a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f9be4009790 tx=0x7f9be4009060).ready entity=mon.2 client_cookie=c3788c17308b9ca4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bdffff700 1 -- 172.21.15.78:0/4017760663 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40090d0 con 0x7f9be8124000 2024-04-25T02:10:18.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bdffff700 1 -- 172.21.15.78:0/4017760663 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400d4a0 con 0x7f9be8124000 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.361+0000 7f9bdffff700 1 -- 172.21.15.78:0/4017760663 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400d820 con 0x7f9be8124000 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.362+0000 7f9bef2ed700 1 -- 172.21.15.78:0/4017760663 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 msgr2=0x7f9be80961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.362+0000 7f9bef2ed700 1 --2- 172.21.15.78:0/4017760663 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be80961a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f9be4009790 tx=0x7f9be4009060).stop 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.362+0000 7f9bef2ed700 1 -- 172.21.15.78:0/4017760663 shutdown_connections 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.362+0000 7f9bef2ed700 1 --2- 172.21.15.78:0/4017760663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be81274e0 0x7f9be8127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.362+0000 7f9bef2ed700 1 --2- 172.21.15.78:0/4017760663 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be80961a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.362+0000 7f9bef2ed700 1 --2- 172.21.15.78:0/4017760663 >> v2:172.21.15.78:3300/0 conn(0x7f9be80937a0 0x7f9be81243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.362+0000 7f9bef2ed700 1 -- 172.21.15.78:0/4017760663 >> 172.21.15.78:0/4017760663 conn(0x7f9be8097450 msgr2=0x7f9be8097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.362+0000 7f9bef2ed700 1 -- 172.21.15.78:0/4017760663 shutdown_connections 2024-04-25T02:10:18.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.362+0000 7f9bef2ed700 1 -- 172.21.15.78:0/4017760663 wait complete. 2024-04-25T02:10:18.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bef2ed700 1 Processor -- start 2024-04-25T02:10:18.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bef2ed700 1 -- start start 2024-04-25T02:10:18.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bef2ed700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be80937a0 0x7f9be812d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bef2ed700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be812e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bef2ed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be81274e0 0x7f9be81290e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bef2ed700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be812c930 con 0x7f9be81274e0 2024-04-25T02:10:18.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bef2ed700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be812c670 con 0x7f9be80937a0 2024-04-25T02:10:18.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bef2ed700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9be812ae80 con 0x7f9be8124000 2024-04-25T02:10:18.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bec888700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be812e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bec888700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be812e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51344/0 (socket says 172.21.15.78:51344) 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bed88a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be81274e0 0x7f9be81290e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bed089700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be80937a0 0x7f9be812d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bec888700 1 -- 172.21.15.78:0/384314025 learned_addr learned my addr 172.21.15.78:0/384314025 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bed089700 1 -- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 msgr2=0x7f9be812e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bed089700 1 --2- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be812e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bed089700 1 -- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be81274e0 msgr2=0x7f9be81290e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.363+0000 7f9bed089700 1 --2- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be81274e0 0x7f9be81290e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.364+0000 7f9bed089700 1 -- 172.21.15.78:0/384314025 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80092a0 con 0x7f9be80937a0 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.364+0000 7f9bec888700 1 --2- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be812e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.364+0000 7f9bed88a700 1 --2- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be81274e0 0x7f9be81290e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.364+0000 7f9bed089700 1 --2- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be80937a0 0x7f9be812d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9be4013000 tx=0x7f9be4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.364+0000 7f9bddffb700 1 -- 172.21.15.78:0/384314025 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4020070 con 0x7f9be80937a0 2024-04-25T02:10:18.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.364+0000 7f9bddffb700 1 -- 172.21.15.78:0/384314025 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40127f0 con 0x7f9be80937a0 2024-04-25T02:10:18.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.364+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be40092a0 con 0x7f9be80937a0 2024-04-25T02:10:18.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.364+0000 7f9bddffb700 1 -- 172.21.15.78:0/384314025 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4012b90 con 0x7f9be80937a0 2024-04-25T02:10:18.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.364+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be812b560 con 0x7f9be80937a0 2024-04-25T02:10:18.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.365+0000 7f9bddffb700 1 -- 172.21.15.78:0/384314025 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9be401c420 con 0x7f9be80937a0 2024-04-25T02:10:18.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.365+0000 7f9bddffb700 1 -- 172.21.15.78:0/384314025 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9be403ba80 con 0x7f9be80937a0 2024-04-25T02:10:18.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.365+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be8092440 con 0x7f9be80937a0 2024-04-25T02:10:18.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.370+0000 7f9bddffb700 1 -- 172.21.15.78:0/384314025 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f9be401a720 con 0x7f9be80937a0 2024-04-25T02:10:18.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.565+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9be812d7f0 con 0x7f9be80937a0 2024-04-25T02:10:18.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.565+0000 7f9bddffb700 1 -- 172.21.15.78:0/384314025 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7f9be401b380 con 0x7f9be80937a0 2024-04-25T02:10:18.573 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:18.573 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:02.698771+0000","modified":"2024-04-25T02:10:04.706190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 >> v1:172.21.15.78:6816/46507 conn(0x7f9bcc02bd00 legacy=0x7f9bcc02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be80937a0 msgr2=0x7f9be812d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 --2- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be80937a0 0x7f9be812d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9be4013000 tx=0x7f9be4016000).stop 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 shutdown_connections 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 --2- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be81274e0 0x7f9be81290e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 --2- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9be80937a0 0x7f9be812d110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 --2- 172.21.15.78:0/384314025 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9be8124000 0x7f9be812e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 >> 172.21.15.78:0/384314025 conn(0x7f9be8097450 msgr2=0x7f9be81268a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 shutdown_connections 2024-04-25T02:10:18.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.567+0000 7f9bef2ed700 1 -- 172.21.15.78:0/384314025 wait complete. 2024-04-25T02:10:18.576 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-25T02:10:18.687 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:10:02.698771+0000', 'modified': '2024-04-25T02:10:04.706190+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4187}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4187': {'gid': 4187, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6817/281509915', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.78:6817', 'nonce': 281509915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:10:18.687 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:10:18.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:10:18.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.800+0000 7fd5498b8700 1 Processor -- start 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5498b8700 1 -- start start 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5498b8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd544127080 0x7fd544127460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5498b8700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544092250 0x7fd544127950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5498b8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd544093690 con 0x7fd544097e80 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5498b8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd544092770 con 0x7fd544127080 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5498b8700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd544093e70 con 0x7fd544092250 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5427fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544092250 0x7fd544127950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd542ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd544127080 0x7fd544127460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5437fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd544097e80 0x7fd5440982f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48536/0 (socket says 172.21.15.78:48536) 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5427fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544092250 0x7fd544127950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51356/0 (socket says 172.21.15.78:51356) 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5437fe700 1 -- 172.21.15.78:0/3438810622 learned_addr learned my addr 172.21.15.78:0/3438810622 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd542ffd700 1 -- 172.21.15.78:0/3438810622 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544092250 msgr2=0x7fd544127950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd542ffd700 1 --2- 172.21.15.78:0/3438810622 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544092250 0x7fd544127950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd542ffd700 1 -- 172.21.15.78:0/3438810622 >> v1:172.21.15.78:6789/0 conn(0x7fd544097e80 legacy=0x7fd5440982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd541ffb700 1 -- 172.21.15.78:0/3438810622 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169396788 0 0) 0x7fd544093690 con 0x7fd544097e80 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd542ffd700 1 -- 172.21.15.78:0/3438810622 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5440930b0 con 0x7fd544127080 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.801+0000 7fd5427fc700 1 --2- 172.21.15.78:0/3438810622 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544092250 0x7fd544127950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd542ffd700 1 --2- 172.21.15.78:0/3438810622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 0x7fd544127460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd538009760 tx=0x7fd538009060).ready entity=mon.0 client_cookie=e97fcde6e5527b6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd541ffb700 1 -- 172.21.15.78:0/3438810622 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800f510 con 0x7fd544127080 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd541ffb700 1 -- 172.21.15.78:0/3438810622 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53800f670 con 0x7fd544127080 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd541ffb700 1 -- 172.21.15.78:0/3438810622 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800f9f0 con 0x7fd544127080 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd5498b8700 1 -- 172.21.15.78:0/3438810622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 msgr2=0x7fd544127460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd5498b8700 1 --2- 172.21.15.78:0/3438810622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 0x7fd544127460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd538009760 tx=0x7fd538009060).stop 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd5498b8700 1 -- 172.21.15.78:0/3438810622 shutdown_connections 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd5498b8700 1 --2- 172.21.15.78:0/3438810622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 0x7fd544127460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd5498b8700 1 --2- 172.21.15.78:0/3438810622 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544092250 0x7fd544127950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd5498b8700 1 -- 172.21.15.78:0/3438810622 >> 172.21.15.78:0/3438810622 conn(0x7fd544096210 msgr2=0x7fd544096620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd5498b8700 1 -- 172.21.15.78:0/3438810622 shutdown_connections 2024-04-25T02:10:18.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.802+0000 7fd5498b8700 1 -- 172.21.15.78:0/3438810622 wait complete. 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.803+0000 7fd5498b8700 1 Processor -- start 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.803+0000 7fd5498b8700 1 -- start start 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5498b8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd544092250 0x7fd54412cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5498b8700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544097e80 0x7fd54412d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5498b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 0x7fd54412d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5498b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441310d0 con 0x7fd544127080 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5498b8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd544069240 con 0x7fd544092250 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5498b8700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd544092db0 con 0x7fd544097e80 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5427fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544097e80 0x7fd54412d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd542ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd544092250 0x7fd54412cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5427fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544097e80 0x7fd54412d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51360/0 (socket says 172.21.15.78:51360) 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 0x7fd54412d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5427fc700 1 -- 172.21.15.78:0/2011652630 learned_addr learned my addr 172.21.15.78:0/2011652630 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5427fc700 1 -- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd544092250 msgr2=0x7fd54412cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5427fc700 1 --2- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd544092250 0x7fd54412cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5427fc700 1 -- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 msgr2=0x7fd54412d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5427fc700 1 --2- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 0x7fd54412d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5427fc700 1 -- 172.21.15.78:0/2011652630 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340092a0 con 0x7fd544097e80 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5437fe700 1 --2- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 0x7fd54412d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5427fc700 1 --2- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544097e80 0x7fd54412d420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd53400ea50 tx=0x7fd534009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd52b7fe700 1 -- 172.21.15.78:0/2011652630 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400ee90 con 0x7fd544097e80 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd52b7fe700 1 -- 172.21.15.78:0/2011652630 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534009600 con 0x7fd544097e80 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5498b8700 1 -- 172.21.15.78:0/2011652630 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5380092a0 con 0x7fd544097e80 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd52b7fe700 1 -- 172.21.15.78:0/2011652630 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400ca60 con 0x7fd544097e80 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.804+0000 7fd5498b8700 1 -- 172.21.15.78:0/2011652630 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd544130390 con 0x7fd544097e80 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.805+0000 7fd52b7fe700 1 -- 172.21.15.78:0/2011652630 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fd53401b400 con 0x7fd544097e80 2024-04-25T02:10:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.805+0000 7fd52b7fe700 1 -- 172.21.15.78:0/2011652630 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd53403b740 con 0x7fd544097e80 2024-04-25T02:10:18.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd55b26db80 1 Processor -- start 2024-04-25T02:10:18.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd55b26db80 1 -- start start 2024-04-25T02:10:18.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375a7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a237571740 con 0x55a2375c1f00 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2374e8150 con 0x55a2375c1b00 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a2374fd640 con 0x55a2375aad70 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd5427fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd542ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd5427fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375a71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:58030/0 (socket says 172.21.15.78:58030) 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd542ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51372/0 (socket says 172.21.15.78:51372) 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.808+0000 7fd5427fc700 1 -- 172.21.15.78:0/4224225741 learned_addr learned my addr 172.21.15.78:0/4224225741 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd5427fc700 1 -- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 msgr2=0x55a2375c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd5427fc700 1 --2- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd5427fc700 1 -- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 msgr2=0x55a2375a7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd5427fc700 1 --2- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375a7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd5427fc700 1 -- 172.21.15.78:0/4224225741 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a237398710 con 0x55a2375c1b00 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd542ffd700 1 --2- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd5437fe700 1 --2- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd5427fc700 1 --2- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375a71a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd534000c00 tx=0x7fd53401a000).ready entity=mon.1 client_cookie=3975544c260e41da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd528ff9700 1 -- 172.21.15.78:0/4224225741 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534029070 con 0x55a2375c1b00 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd528ff9700 1 -- 172.21.15.78:0/4224225741 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534011350 con 0x55a2375c1b00 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.809+0000 7fd528ff9700 1 -- 172.21.15.78:0/4224225741 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53401bde0 con 0x55a2375c1b00 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 -- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 msgr2=0x55a2375a71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 --2- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375a71a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd534000c00 tx=0x7fd53401a000).stop 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 -- 172.21.15.78:0/4224225741 shutdown_connections 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 --2- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 --2- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 --2- 172.21.15.78:0/4224225741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375a71a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 -- 172.21.15.78:0/4224225741 >> 172.21.15.78:0/4224225741 conn(0x55a237415940 msgr2=0x55a2375c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 -- 172.21.15.78:0/4224225741 shutdown_connections 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 -- 172.21.15.78:0/4224225741 wait complete. 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 -- start start 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.810+0000 7fd55b26db80 1 Processor -- start 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375c0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2374fd780 con 0x55a2375c1f00 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2374fda00 con 0x55a2375c1b00 2024-04-25T02:10:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a2374c8d40 con 0x55a2375aad70 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 10 client.0 ll_register_callbacks cb 0x55a23756bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd542ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd542ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375b7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51380/0 (socket says 172.21.15.78:51380) 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd5427fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd542ffd700 1 -- 172.21.15.78:0/4215881551 learned_addr learned my addr 172.21.15.78:0/4215881551 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd5437fe700 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd542ffd700 1 -- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 msgr2=0x55a2375c0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd542ffd700 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375c0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd542ffd700 1 -- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 msgr2=0x55a2375c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd542ffd700 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd542ffd700 1 -- 172.21.15.78:0/4215881551 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c004e10 con 0x55a2375aad70 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd5427fc700 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd5437fe700 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd542ffd700 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375b7f60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd538011000 tx=0x7fd538017000).ready entity=mon.2 client_cookie=6c895590a67d64d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd521ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3302/0 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd521ffb700 1 -- 172.21.15.78:0/4215881551 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538024070 con 0x55a2375aad70 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd521ffb700 1 -- 172.21.15.78:0/4215881551 <== mon.2 v2:172.21.15.78:3302/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd53801dc10 con 0x55a2375aad70 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 1 -- 172.21.15.78:0/4215881551 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a23759fe00 con 0x55a2375aad70 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd521ffb700 1 -- 172.21.15.78:0/4215881551 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd53800fe60 con 0x55a2375aad70 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 10 client.4490 fetch_fsmap learned FSMap version 5 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.811+0000 7fd55b26db80 1 -- 172.21.15.78:0/4215881551 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x7fd544130390 con 0x55a2375aad70 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd521ffb700 1 -- 172.21.15.78:0/4215881551 <== mon.2 v2:172.21.15.78:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53802d030 con 0x55a2375aad70 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd521ffb700 1 -- 172.21.15.78:0/4215881551 <== mon.2 v2:172.21.15.78:3302/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fd538009790 con 0x55a2375aad70 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd55b26db80 10 client.4490 fetch_fsmap finished waiting for FSMap version 5 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd55b26db80 10 client.4490 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd55b26db80 20 client.4490 populate_metadata read hostname 'smithi078' 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd55b26db80 4 client.4490 mds_command: new command op to 4187 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd55b26db80 1 -- 172.21.15.78:0/4215881551 --> v1:172.21.15.78:6817/281509915 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a237575380 con 0x55a2375b4490 2024-04-25T02:10:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd521ffb700 10 client.4490 ms_handle_connect on v1:172.21.15.78:6817/281509915 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd521ffb700 1 -- 172.21.15.78:0/4215881551 <== mds.0 v1:172.21.15.78:6817/281509915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55a237575380 con 0x55a2375b4490 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.812+0000 7fd521ffb700 10 client.4490 handle_command_reply: tid=0 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 client.4490 shutdown 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 -- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 msgr2=0x55a2375b7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375b7f60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd538011000 tx=0x7fd538017000).stop 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 -- 172.21.15.78:0/4215881551 shutdown_connections 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1f00 0x55a2375c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375b7f60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 --2- 172.21.15.78:0/4215881551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd521ffb700 0 client.4490 ms_handle_reset on v1:172.21.15.78:6817/281509915 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 -- 172.21.15.78:0/4215881551 >> 172.21.15.78:0/4215881551 conn(0x55a237415940 msgr2=0x55a2375a71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 -- 172.21.15.78:0/4215881551 shutdown_connections 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 1 -- 172.21.15.78:0/4215881551 wait complete. 2024-04-25T02:10:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.813+0000 7fd55b26db80 20 client.4490 trim_cache size 0 max 16384 2024-04-25T02:10:18.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd55b26db80 1 Processor -- start 2024-04-25T02:10:18.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd55b26db80 1 -- start start 2024-04-25T02:10:18.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1b00 0x55a2375ab270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1f00 0x55a2375b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2375aac20 con 0x55a2375c1b00 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2375b65b0 con 0x55a2375c1f00 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a2375a24a0 con 0x55a2375aad70 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd542ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd5427fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1b00 0x55a2375ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1f00 0x55a2375b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd542ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51386/0 (socket says 172.21.15.78:51386) 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.829+0000 7fd542ffd700 1 -- 172.21.15.78:0/1314662741 learned_addr learned my addr 172.21.15.78:0/1314662741 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5437fe700 1 -- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 msgr2=0x55a2375c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5437fe700 1 --2- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5437fe700 1 -- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1b00 msgr2=0x55a2375ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5437fe700 1 --2- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1b00 0x55a2375ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5437fe700 1 -- 172.21.15.78:0/1314662741 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2374f6580 con 0x55a2375c1f00 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5427fc700 1 --2- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1b00 0x55a2375ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd542ffd700 1 --2- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5437fe700 1 --2- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1f00 0x55a2375b6de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x55a2375a82d0 tx=0x7fd53c006040).ready entity=mon.1 client_cookie=7527ff2ad52483d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5297fa700 1 -- 172.21.15.78:0/1314662741 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c01a030 con 0x55a2375c1f00 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5297fa700 1 -- 172.21.15.78:0/1314662741 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c015610 con 0x55a2375c1f00 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd5297fa700 1 -- 172.21.15.78:0/1314662741 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c015990 con 0x55a2375c1f00 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd55b26db80 1 -- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1f00 msgr2=0x55a2375b6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd55b26db80 1 --2- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1f00 0x55a2375b6de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x55a2375a82d0 tx=0x7fd53c006040).stop 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd55b26db80 1 -- 172.21.15.78:0/1314662741 shutdown_connections 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd55b26db80 1 --2- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1f00 0x55a2375b6de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd55b26db80 1 --2- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375aad70 0x55a2375c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd55b26db80 1 --2- 172.21.15.78:0/1314662741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375c1b00 0x55a2375ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd55b26db80 1 -- 172.21.15.78:0/1314662741 >> 172.21.15.78:0/1314662741 conn(0x55a237415940 msgr2=0x55a2375c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd55b26db80 1 -- 172.21.15.78:0/1314662741 shutdown_connections 2024-04-25T02:10:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.830+0000 7fd55b26db80 1 -- 172.21.15.78:0/1314662741 wait complete. 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd55b26db80 1 -- start start 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd55b26db80 1 Processor -- start 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375aad70 0x55a2375e0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375e0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd55b26db80 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375c1f00 0x55a2375e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2375b4090 con 0x55a2375aad70 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2375b4880 con 0x55a2375c1b00 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd55b26db80 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a2375dfab0 con 0x55a2375c1f00 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd55b26db80 10 client.0 ll_register_callbacks cb 0x55a23756bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375c1f00 0x55a2375e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd5427fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375e0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375c1f00 0x55a2375e12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51392/0 (socket says 172.21.15.78:51392) 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd5437fe700 1 -- 172.21.15.78:0/694942387 learned_addr learned my addr 172.21.15.78:0/694942387 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.831+0000 7fd542ffd700 1 --2- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375aad70 0x55a2375e0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd5437fe700 1 -- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 msgr2=0x55a2375e0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd5437fe700 1 --2- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375e0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd5437fe700 1 -- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375aad70 msgr2=0x55a2375e0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd5437fe700 1 --2- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375aad70 0x55a2375e0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd5437fe700 1 -- 172.21.15.78:0/694942387 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd544130390 con 0x55a2375c1f00 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd542ffd700 1 --2- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375aad70 0x55a2375e0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd5437fe700 1 --2- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375c1f00 0x55a2375e12e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd53c01b040 tx=0x7fd53c009000).ready entity=mon.2 client_cookie=2544207c2251815e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd521ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3302/0 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd521ffb700 1 -- 172.21.15.78:0/694942387 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c017790 con 0x55a2375c1f00 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd521ffb700 1 -- 172.21.15.78:0/694942387 <== mon.2 v2:172.21.15.78:3302/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd53c01b070 con 0x55a2375c1f00 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd55b26db80 1 -- 172.21.15.78:0/694942387 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd534011350 con 0x55a2375c1f00 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd521ffb700 1 -- 172.21.15.78:0/694942387 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd53c0178f0 con 0x55a2375c1f00 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd55b26db80 10 client.4496 fetch_fsmap learned FSMap version 5 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd55b26db80 1 -- 172.21.15.78:0/694942387 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x55a237398710 con 0x55a2375c1f00 2024-04-25T02:10:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd521ffb700 1 -- 172.21.15.78:0/694942387 <== mon.2 v2:172.21.15.78:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534011350 con 0x55a2375c1f00 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd521ffb700 1 -- 172.21.15.78:0/694942387 <== mon.2 v2:172.21.15.78:3302/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fd53c012070 con 0x55a2375c1f00 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd55b26db80 10 client.4496 fetch_fsmap finished waiting for FSMap version 5 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd55b26db80 10 client.4496 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd55b26db80 20 client.4496 populate_metadata read hostname 'smithi078' 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd55b26db80 4 client.4496 mds_command: new command op to 4187 tid=0[{"prefix": "status"}] 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.832+0000 7fd55b26db80 1 -- 172.21.15.78:0/694942387 --> v1:172.21.15.78:6817/281509915 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a237365ef0 con 0x55a237636ed0 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd521ffb700 10 client.4496 ms_handle_connect on v1:172.21.15.78:6817/281509915 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd521ffb700 1 -- 172.21.15.78:0/694942387 <== mds.0 v1:172.21.15.78:6817/281509915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 1385972926) 0x7fd53802d160 con 0x55a237636ed0 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd521ffb700 10 client.4496 handle_command_reply: tid=0 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 client.4496 shutdown 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 -- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375c1f00 msgr2=0x55a2375e12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 --2- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375c1f00 0x55a2375e12e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd53c01b040 tx=0x7fd53c009000).stop 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 -- 172.21.15.78:0/694942387 shutdown_connections 2024-04-25T02:10:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 --2- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55a2375c1f00 0x55a2375e12e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 --2- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2375aad70 0x55a2375e0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd521ffb700 0 client.4496 ms_handle_reset on v1:172.21.15.78:6817/281509915 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 --2- 172.21.15.78:0/694942387 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a2375c1b00 0x55a2375e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 -- 172.21.15.78:0/694942387 >> 172.21.15.78:0/694942387 conn(0x55a237415940 msgr2=0x55a2375c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 -- 172.21.15.78:0/694942387 shutdown_connections 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 1 -- 172.21.15.78:0/694942387 wait complete. 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.833+0000 7fd55b26db80 20 client.4496 trim_cache size 0 max 16384 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c7765ec7-39fd-490f-9c17-2b734a0c4de0", 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4187, 2024-04-25T02:10:18.848 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-04-25T02:10:18.849 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-04-25T02:10:18.849 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-04-25T02:10:18.849 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 16.130935050000001, 2024-04-25T02:10:18.849 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 5, 2024-04-25T02:10:18.849 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 16, 2024-04-25T02:10:18.849 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 16, 2024-04-25T02:10:18.849 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 20.519240417999999 2024-04-25T02:10:18.849 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 -- 172.21.15.78:0/2011652630 >> v1:172.21.15.78:6816/46507 conn(0x7fd53002bd00 legacy=0x7fd53002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 -- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544097e80 msgr2=0x7fd54412d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 --2- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544097e80 0x7fd54412d420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd53400ea50 tx=0x7fd534009060).stop 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 -- 172.21.15.78:0/2011652630 shutdown_connections 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 --2- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544127080 0x7fd54412d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 --2- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd544092250 0x7fd54412cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 --2- 172.21.15.78:0/2011652630 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd544097e80 0x7fd54412d420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 -- 172.21.15.78:0/2011652630 >> 172.21.15.78:0/2011652630 conn(0x7fd544096210 msgr2=0x7fd5440982f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 -- 172.21.15.78:0/2011652630 shutdown_connections 2024-04-25T02:10:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.834+0000 7fd5498b8700 1 -- 172.21.15.78:0/2011652630 wait complete. 2024-04-25T02:10:18.853 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T02:10:18.862 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T02:10:18.862 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:10:18.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2024-04-25T02:10:18.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.967+0000 7fd1dac0f700 1 Processor -- start 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.967+0000 7fd1dac0f700 1 -- start start 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.967+0000 7fd1dac0f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1d405e270 0x7fd1d4095a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.967+0000 7fd1dac0f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d4095f10 0x7fd1d40962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.967+0000 7fd1dac0f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d4093260 con 0x7fd1d412f280 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.967+0000 7fd1dac0f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d405e650 con 0x7fd1d405e270 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.967+0000 7fd1dac0f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4091d50 con 0x7fd1d4095f10 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d3fff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d4095f10 0x7fd1d40962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d89ab700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1d405e270 0x7fd1d4095a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d91ac700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd1d412f280 0x7fd1d4131670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48548/0 (socket says 172.21.15.78:48548) 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d91ac700 1 -- 172.21.15.78:0/2161480986 learned_addr learned my addr 172.21.15.78:0/2161480986 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d89ab700 1 -- 172.21.15.78:0/2161480986 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d4095f10 msgr2=0x7fd1d40962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d89ab700 1 --2- 172.21.15.78:0/2161480986 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d4095f10 0x7fd1d40962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d89ab700 1 -- 172.21.15.78:0/2161480986 >> v1:172.21.15.78:6789/0 conn(0x7fd1d412f280 legacy=0x7fd1d4131670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d89ab700 1 -- 172.21.15.78:0/2161480986 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d409afc0 con 0x7fd1d405e270 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d3fff700 1 --2- 172.21.15.78:0/2161480986 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d4095f10 0x7fd1d40962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d89ab700 1 --2- 172.21.15.78:0/2161480986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d405e270 0x7fd1d4095a20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd1c8009760 tx=0x7fd1c8009060).ready entity=mon.0 client_cookie=931d1a53eae4faba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d37fe700 1 -- 172.21.15.78:0/2161480986 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80090d0 con 0x7fd1d405e270 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d37fe700 1 -- 172.21.15.78:0/2161480986 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c800f510 con 0x7fd1d405e270 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.968+0000 7fd1d37fe700 1 -- 172.21.15.78:0/2161480986 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c800f890 con 0x7fd1d405e270 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.969+0000 7fd1dac0f700 1 -- 172.21.15.78:0/2161480986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d405e270 msgr2=0x7fd1d4095a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.969+0000 7fd1dac0f700 1 --2- 172.21.15.78:0/2161480986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d405e270 0x7fd1d4095a20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd1c8009760 tx=0x7fd1c8009060).stop 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.969+0000 7fd1dac0f700 1 -- 172.21.15.78:0/2161480986 shutdown_connections 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.969+0000 7fd1dac0f700 1 --2- 172.21.15.78:0/2161480986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d405e270 0x7fd1d4095a20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.969+0000 7fd1dac0f700 1 --2- 172.21.15.78:0/2161480986 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d4095f10 0x7fd1d40962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.969+0000 7fd1dac0f700 1 -- 172.21.15.78:0/2161480986 >> 172.21.15.78:0/2161480986 conn(0x7fd1d40975d0 msgr2=0x7fd1d409a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.969+0000 7fd1dac0f700 1 -- 172.21.15.78:0/2161480986 shutdown_connections 2024-04-25T02:10:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.969+0000 7fd1dac0f700 1 -- 172.21.15.78:0/2161480986 wait complete. 2024-04-25T02:10:18.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.969+0000 7fd1dac0f700 1 Processor -- start 2024-04-25T02:10:18.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1dac0f700 1 -- start start 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1dac0f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1d405e270 0x7fd1d412e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1dac0f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d4095f10 0x7fd1d412e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1dac0f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d412f280 0x7fd1d412ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1dac0f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d408ebb0 con 0x7fd1d4095f10 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1dac0f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d408e560 con 0x7fd1d405e270 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1dac0f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d406aa70 con 0x7fd1d412f280 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1d89ab700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1d405e270 0x7fd1d412e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1d91ac700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d412f280 0x7fd1d412ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1d89ab700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1d405e270 0x7fd1d412e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:58082/0 (socket says 172.21.15.78:58082) 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1d89ab700 1 -- 172.21.15.78:0/716738690 learned_addr learned my addr 172.21.15.78:0/716738690 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1d3fff700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d4095f10 0x7fd1d412e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1d89ab700 1 -- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d412f280 msgr2=0x7fd1d412ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1d89ab700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d412f280 0x7fd1d412ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1d89ab700 1 -- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d4095f10 msgr2=0x7fd1d412e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.970+0000 7fd1d89ab700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d4095f10 0x7fd1d412e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1d89ab700 1 -- 172.21.15.78:0/716738690 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00092a0 con 0x7fd1d405e270 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1d91ac700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d412f280 0x7fd1d412ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1d3fff700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d4095f10 0x7fd1d412e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1d89ab700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1d405e270 0x7fd1d412e290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd1c8009e00 tx=0x7fd1c8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1d17fa700 1 -- 172.21.15.78:0/716738690 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c800fea0 con 0x7fd1d405e270 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1d17fa700 1 -- 172.21.15.78:0/716738690 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8006930 con 0x7fd1d405e270 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c80092a0 con 0x7fd1d405e270 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1d17fa700 1 -- 172.21.15.78:0/716738690 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c800f8d0 con 0x7fd1d405e270 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d408cf10 con 0x7fd1d405e270 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.971+0000 7fd1d17fa700 1 -- 172.21.15.78:0/716738690 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fd1c801b650 con 0x7fd1d405e270 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.972+0000 7fd1d17fa700 1 -- 172.21.15.78:0/716738690 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd1c803c830 con 0x7fd1d405e270 2024-04-25T02:10:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.972+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d408fa30 con 0x7fd1d405e270 2024-04-25T02:10:18.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:18.976+0000 7fd1d17fa700 1 -- 172.21.15.78:0/716738690 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fd1c8025460 con 0x7fd1d405e270 2024-04-25T02:10:19.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.143+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7fd1d405a310 con 0x7fd1d405e270 2024-04-25T02:10:19.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.748+0000 7fd1d17fa700 1 -- 172.21.15.78:0/716738690 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v17) v1 ==== 143+0+0 (secure 0 0 0) 0x7fd1c8024e70 con 0x7fd1d405e270 2024-04-25T02:10:19.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 >> v1:172.21.15.78:6816/46507 conn(0x7fd1b802bd00 legacy=0x7fd1b802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1d405e270 msgr2=0x7fd1d412e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1d405e270 0x7fd1d412e290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd1c8009e00 tx=0x7fd1c8017000).stop 2024-04-25T02:10:19.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 shutdown_connections 2024-04-25T02:10:19.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd1d412f280 0x7fd1d412ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:19.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1d405e270 0x7fd1d412e290 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:19.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 --2- 172.21.15.78:0/716738690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1d4095f10 0x7fd1d412e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:19.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 >> 172.21.15.78:0/716738690 conn(0x7fd1d40975d0 msgr2=0x7fd1d4097e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 shutdown_connections 2024-04-25T02:10:19.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:19.751+0000 7fd1dac0f700 1 -- 172.21.15.78:0/716738690 wait complete. 2024-04-25T02:10:19.761 INFO:teuthology.orchestra.run.smithi078.stderr:set require_min_compat_client to pacific 2024-04-25T02:10:19.772 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:10:19.780 INFO:teuthology.task.print:**** done ceph 2024-04-25T02:10:19.780 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T02:10:19.803 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T02:10:19.803 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T02:10:19.803 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T02:10:19.803 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:10:19.803 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:19.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:19.803 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T02:10:19.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:19.827 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T02:10:19.902 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T02:10:19.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:10:19.903 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T02:10:19.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:10:20.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f890a772700 1 Processor -- start 2024-04-25T02:10:20.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f890a772700 1 -- start start 2024-04-25T02:10:20.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f890a772700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8904069030 0x7f89040962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:20.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f890a772700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f890412e0c0 0x7f89041304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:20.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f890a772700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8904069f80 con 0x7f89040967d0 2024-04-25T02:10:20.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f890a772700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8904069410 con 0x7f890412e0c0 2024-04-25T02:10:20.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f890a772700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89040688a0 con 0x7f8904069030 2024-04-25T02:10:20.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8908d0f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f890412e0c0 0x7f89041304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:20.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8903fff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8904069030 0x7f89040962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8908d0f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f890412e0c0 0x7f89041304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38654/0 (socket says 172.21.15.78:38654) 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8908d0f700 1 -- 172.21.15.78:0/198506917 learned_addr learned my addr 172.21.15.78:0/198506917 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8903fff700 1 -- 172.21.15.78:0/198506917 >> v2:172.21.15.78:3300/0 conn(0x7f890412e0c0 msgr2=0x7f89041304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8903fff700 1 --2- 172.21.15.78:0/198506917 >> v2:172.21.15.78:3300/0 conn(0x7f890412e0c0 0x7f89041304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8903fff700 1 -- 172.21.15.78:0/198506917 >> v1:172.21.15.78:6789/0 conn(0x7f89040967d0 legacy=0x7f8904096bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8903fff700 1 -- 172.21.15.78:0/198506917 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8904068b10 con 0x7f8904069030 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8902ffd700 1 -- 172.21.15.78:0/198506917 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635888698 0 0) 0x7f8904069f80 con 0x7f89040967d0 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8908d0f700 1 --2- 172.21.15.78:0/198506917 >> v2:172.21.15.78:3300/0 conn(0x7f890412e0c0 0x7f89041304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.017+0000 7f8903fff700 1 --2- 172.21.15.78:0/198506917 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8904069030 0x7f89040962e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f88f4009760 tx=0x7f88f4009060).ready entity=mon.2 client_cookie=49c01a3b9ef559f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f8902ffd700 1 -- 172.21.15.78:0/198506917 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400f510 con 0x7f8904069030 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f8902ffd700 1 -- 172.21.15.78:0/198506917 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f400f670 con 0x7f8904069030 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f8902ffd700 1 -- 172.21.15.78:0/198506917 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400f9f0 con 0x7f8904069030 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f890a772700 1 -- 172.21.15.78:0/198506917 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8904069030 msgr2=0x7f89040962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f890a772700 1 --2- 172.21.15.78:0/198506917 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8904069030 0x7f89040962e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f88f4009760 tx=0x7f88f4009060).stop 2024-04-25T02:10:20.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f890a772700 1 -- 172.21.15.78:0/198506917 shutdown_connections 2024-04-25T02:10:20.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f890a772700 1 --2- 172.21.15.78:0/198506917 >> v2:172.21.15.78:3300/0 conn(0x7f890412e0c0 0x7f89041304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:20.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f890a772700 1 --2- 172.21.15.78:0/198506917 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8904069030 0x7f89040962e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:20.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f890a772700 1 -- 172.21.15.78:0/198506917 >> 172.21.15.78:0/198506917 conn(0x7f890409c550 msgr2=0x7f89040983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:20.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f890a772700 1 -- 172.21.15.78:0/198506917 shutdown_connections 2024-04-25T02:10:20.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.018+0000 7f890a772700 1 -- 172.21.15.78:0/198506917 wait complete. 2024-04-25T02:10:20.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.019+0000 7f890a772700 1 Processor -- start 2024-04-25T02:10:20.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.019+0000 7f890a772700 1 -- start start 2024-04-25T02:10:20.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f890a772700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89040967d0 0x7f8904117de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f890a772700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f890412e0c0 0x7f89041182d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f890a772700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89041187c0 0x7f890413e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f890a772700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89041192b0 con 0x7f89041187c0 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f890a772700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890411b370 con 0x7f89040967d0 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f890a772700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8904118c20 con 0x7f890412e0c0 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f89037fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f890412e0c0 0x7f89041182d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f8903fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89040967d0 0x7f8904117de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f8908d0f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89041187c0 0x7f890413e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f89037fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f890412e0c0 0x7f89041182d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51412/0 (socket says 172.21.15.78:51412) 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f8903fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89040967d0 0x7f8904117de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:58088/0 (socket says 172.21.15.78:58088) 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f89037fe700 1 -- 172.21.15.78:0/953688438 learned_addr learned my addr 172.21.15.78:0/953688438 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:20.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f89037fe700 1 -- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89040967d0 msgr2=0x7f8904117de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f89037fe700 1 --2- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89040967d0 0x7f8904117de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f89037fe700 1 -- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89041187c0 msgr2=0x7f890413e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f89037fe700 1 --2- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89041187c0 0x7f890413e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f89037fe700 1 -- 172.21.15.78:0/953688438 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc009ae0 con 0x7f890412e0c0 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f8908d0f700 1 --2- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89041187c0 0x7f890413e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f8903fff700 1 --2- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89040967d0 0x7f8904117de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f89037fe700 1 --2- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f890412e0c0 0x7f89041182d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f88ec00c490 tx=0x7f88ec007bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f8900ff9700 1 -- 172.21.15.78:0/953688438 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec012400 con 0x7f890412e0c0 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f8900ff9700 1 -- 172.21.15.78:0/953688438 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec012580 con 0x7f890412e0c0 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f40092a0 con 0x7f890412e0c0 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f8900ff9700 1 -- 172.21.15.78:0/953688438 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec012940 con 0x7f890412e0c0 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.020+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89040678e0 con 0x7f890412e0c0 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.021+0000 7f8900ff9700 1 -- 172.21.15.78:0/953688438 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f88ec01b3b0 con 0x7f890412e0c0 2024-04-25T02:10:20.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.021+0000 7f8900ff9700 1 -- 172.21.15.78:0/953688438 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f88ec03a910 con 0x7f890412e0c0 2024-04-25T02:10:20.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.021+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8904098af0 con 0x7f890412e0c0 2024-04-25T02:10:20.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.026+0000 7f8900ff9700 1 -- 172.21.15.78:0/953688438 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f88ec01a360 con 0x7f890412e0c0 2024-04-25T02:10:20.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.224+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8904094f00 con 0x7f890412e0c0 2024-04-25T02:10:20.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.224+0000 7f8900ff9700 1 -- 172.21.15.78:0/953688438 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7f88ec018a50 con 0x7f890412e0c0 2024-04-25T02:10:20.232 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:10:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 >> v1:172.21.15.78:6816/46507 conn(0x7f88e402bd30 legacy=0x7f88e402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f890412e0c0 msgr2=0x7f89041182d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 --2- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f890412e0c0 0x7f89041182d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f88ec00c490 tx=0x7f88ec007bf0).stop 2024-04-25T02:10:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 shutdown_connections 2024-04-25T02:10:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 --2- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89041187c0 0x7f890413e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 --2- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89040967d0 0x7f8904117de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 --2- 172.21.15.78:0/953688438 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f890412e0c0 0x7f89041182d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 >> 172.21.15.78:0/953688438 conn(0x7f8904069030 msgr2=0x7f8904111f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 shutdown_connections 2024-04-25T02:10:20.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:20.226+0000 7f890a772700 1 -- 172.21.15.78:0/953688438 wait complete. 2024-04-25T02:10:20.245 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:10:20.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:10:20.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T02:10:20.245 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:10:20.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:20.245 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:10:20.246 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:10:20.246 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:10:20.246 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:10:20.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:20.246 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T02:10:20.268 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:10:20.268 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:10:20.268 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:10:20.268 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:20.268 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T02:10:20.268 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:20.268 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42628sec preferred_lft 42628sec 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-04-25T02:10:20.269 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:10:20.270 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:10:20.270 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:10:20.270 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:10:20.270 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:10:20.270 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-04-25T02:10:20.270 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-04-25T02:10:20.270 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:10:20.270 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:10:20.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:10:20.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:10:20.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:20.487 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:10:20.514 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T02:10:20.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:20.516 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T02:10:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T02:10:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:10:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:10:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:10:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:10:20.597 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:10:20.597 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:10:20.597 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:10:20.597 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:10:20.597 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:10:20.597 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:10:20.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:10:20.940 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:10:20.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:20.946 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T02:10:20.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:20.964 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-04-25T02:10:21.021 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:10:21.021 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:10:21.021 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:10:21.021 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T02:10:21.021 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:10:21.110 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:10:21.146 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:10:21.152 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T02:10:21.152 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:10:21.152 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:10:21.152 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T02:10:21.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:10:21.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T02:10:21.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T02:10:21.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T02:10:21.153 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:10:21.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:10:21.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:10:21.381 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:10:21.381 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:10:21.381 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T02:10:21.381 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:10:21.382 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:10:21.432 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:10:21.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:10:21.516 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T02:10:21.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:10:21.516 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:21.533 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:10:21.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:10:21.533 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:21.590 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-04-25T02:10:21.656 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:10:21.715 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-04-25T02:10:21.715 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-04-25T02:10:21.715 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-04-25T02:10:21.715 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-04-25T02:10:21.716 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-04-25T02:10:21.716 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-04-25T02:10:21.716 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-04-25T02:10:21.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-04-25T02:10:21.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:10:21.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-04-25T02:10:21.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-04-25T02:10:21.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:10:21.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/memory 2024-04-25T02:10:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:10:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:10:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:10:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/devices 2024-04-25T02:10:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/pids 2024-04-25T02:10:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:10:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:10:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:10:21.718 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:10:21.718 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-04-25T02:10:21.718 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-04-25T02:10:21.718 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-04-25T02:10:21.718 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/selinux 2024-04-25T02:10:21.718 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:10:21.718 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-04-25T02:10:21.718 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-04-25T02:10:21.719 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-04-25T02:10:21.719 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-04-25T02:10:21.719 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:10:21.719 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-04-25T02:10:21.719 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-04-25T02:10:21.719 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-04-25T02:10:21.719 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:10:21.719 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:10:21.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:21.719 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-04-25T02:10:21.773 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T02:10:21.773 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T02:10:21.815 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-04-25T02:10:21.841 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:10:21.900 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-04-25T02:10:21.900 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-04-25T02:10:21.900 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/memory 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/devices 2024-04-25T02:10:21.901 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/pids 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/selinux 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-04-25T02:10:21.902 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:10:21.903 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-04-25T02:10:21.903 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-04-25T02:10:21.903 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-04-25T02:10:21.903 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:10:21.903 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:10:21.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:21.903 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-04-25T02:10:21.905 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi195.stderr:2024-04-25T02:10:21.897+0000 7efecb7113c0 -1 init, newargv = 0x55ecf0ba5740 newargc=15 2024-04-25T02:10:21.906 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi195.stderr:ceph-fuse[40648]: starting ceph client 2024-04-25T02:10:21.910 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi195.stderr:ceph-fuse[40648]: starting fuse 2024-04-25T02:10:21.923 INFO:teuthology.orchestra.run.smithi195.stdout:47 2024-04-25T02:10:21.923 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-04-25T02:10:21.923 DEBUG:teuthology.orchestra.run.smithi195:> sudo stdin-killer -- python3 -c ' 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> import re 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> import os 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2024-04-25T02:10:21.924 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> return f 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.0")) 2024-04-25T02:10:21.925 DEBUG:teuthology.orchestra.run.smithi195:> ' 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.0.40648.asok 2024-04-25T02:10:22.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:10:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:10:22.054 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40648.asok 2024-04-25T02:10:22.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:22.055 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40648.asok status 2024-04-25T02:10:22.204 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-25T02:10:22.204 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2024-04-25T02:10:22.204 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "618f440892089921c3e944a991122ddc44e60516", 2024-04-25T02:10:22.204 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 16.2.15 (618f440892089921c3e944a991122ddc44e60516) pacific (stable)", 2024-04-25T02:10:22.204 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "0", 2024-04-25T02:10:22.204 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2024-04-25T02:10:22.204 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "40648", 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 4514, 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 4514 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "172.21.15.195:0", 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 54968184 2024-04-25T02:10:22.205 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "172.21.15.195:0", 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 54968184 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.4514 172.21.15.195:0/54968184", 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "172.21.15.195:0/54968184", 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 5, 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 17, 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2024-04-25T02:10:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2024-04-25T02:10:22.207 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-25T02:10:22.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:22.214 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2024-04-25T02:10:22.214 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:22.232 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2024-04-25T02:10:22.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:22.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:22.233 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:22.300 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T02:10:22.310 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T02:10:22.310 INFO:tasks.ceph_fuse:config is {'client.0': {'mounted': False}} 2024-04-25T02:10:22.310 INFO:tasks.ceph_fuse:client.0 config is {'mounted': False} 2024-04-25T02:10:22.310 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:10:22.310 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:22.358 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:10:22.358 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:22.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.544+0000 7fc88285f700 1 Processor -- start 2024-04-25T02:10:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.544+0000 7fc88285f700 1 -- start start 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc88285f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1279d0 0x7fc87c127db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc88285f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c12faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc88285f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87c093180 con 0x7fc87c1282a0 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc88285f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c094120 con 0x7fc87c1279d0 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc88285f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c092a80 con 0x7fc87c099550 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc87bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1279d0 0x7fc87c127db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc87b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc87c1282a0 0x7fc87c098e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48570/0 (socket says 172.21.15.78:48570) 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc87b7fe700 1 -- 172.21.15.78:0/3913183802 learned_addr learned my addr 172.21.15.78:0/3913183802 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc880dfc700 1 --2- 172.21.15.78:0/3913183802 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c12faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc87affd700 1 -- 172.21.15.78:0/3913183802 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431161620 0 0) 0x7fc87c093180 con 0x7fc87c1282a0 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc87bfff700 1 -- 172.21.15.78:0/3913183802 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 msgr2=0x7fc87c12faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc87bfff700 1 --2- 172.21.15.78:0/3913183802 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c12faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc87bfff700 1 -- 172.21.15.78:0/3913183802 >> v1:172.21.15.78:6789/0 conn(0x7fc87c1282a0 legacy=0x7fc87c098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc87bfff700 1 -- 172.21.15.78:0/3913183802 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c093440 con 0x7fc87c1279d0 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.545+0000 7fc87bfff700 1 --2- 172.21.15.78:0/3913183802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1279d0 0x7fc87c127db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc86c0097c0 tx=0x7fc86c009060).ready entity=mon.1 client_cookie=11b36209e905c8b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc87affd700 1 -- 172.21.15.78:0/3913183802 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f510 con 0x7fc87c1279d0 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc87affd700 1 -- 172.21.15.78:0/3913183802 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c00f670 con 0x7fc87c1279d0 2024-04-25T02:10:22.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc87affd700 1 -- 172.21.15.78:0/3913183802 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f9f0 con 0x7fc87c1279d0 2024-04-25T02:10:22.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc88285f700 1 -- 172.21.15.78:0/3913183802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1279d0 msgr2=0x7fc87c127db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc88285f700 1 --2- 172.21.15.78:0/3913183802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1279d0 0x7fc87c127db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc86c0097c0 tx=0x7fc86c009060).stop 2024-04-25T02:10:22.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc88285f700 1 -- 172.21.15.78:0/3913183802 shutdown_connections 2024-04-25T02:10:22.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc88285f700 1 --2- 172.21.15.78:0/3913183802 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c12faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc88285f700 1 --2- 172.21.15.78:0/3913183802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1279d0 0x7fc87c127db0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc88285f700 1 -- 172.21.15.78:0/3913183802 >> 172.21.15.78:0/3913183802 conn(0x7fc87c0974d0 msgr2=0x7fc87c099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc88285f700 1 -- 172.21.15.78:0/3913183802 shutdown_connections 2024-04-25T02:10:22.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.546+0000 7fc88285f700 1 -- 172.21.15.78:0/3913183802 wait complete. 2024-04-25T02:10:22.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.547+0000 7fc88285f700 1 Processor -- start 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc88285f700 1 -- start start 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc88285f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc88285f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc87c1279d0 0x7fc87c123f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc88285f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1282a0 0x7fc87c124470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc88285f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c096220 con 0x7fc87c1279d0 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc88285f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c092bd0 con 0x7fc87c1282a0 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc88285f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c122d40 con 0x7fc87c099550 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc87bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc87b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc87c1279d0 0x7fc87c123f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc87bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c06a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51430/0 (socket says 172.21.15.78:51430) 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc87b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc87c1279d0 0x7fc87c123f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38672/0 (socket says 172.21.15.78:38672) 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.548+0000 7fc87bfff700 1 -- 172.21.15.78:0/444392900 learned_addr learned my addr 172.21.15.78:0/444392900 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc880dfc700 1 --2- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1282a0 0x7fc87c124470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc87bfff700 1 -- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1282a0 msgr2=0x7fc87c124470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc87bfff700 1 --2- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1282a0 0x7fc87c124470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc87bfff700 1 -- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc87c1279d0 msgr2=0x7fc87c123f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc87bfff700 1 --2- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc87c1279d0 0x7fc87c123f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc87bfff700 1 -- 172.21.15.78:0/444392900 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0092a0 con 0x7fc87c099550 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc87b7fe700 1 --2- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc87c1279d0 0x7fc87c123f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc87bfff700 1 --2- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c06a1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc86c006df0 tx=0x7fc86c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc878ff9700 1 -- 172.21.15.78:0/444392900 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f7e0 con 0x7fc87c099550 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc878ff9700 1 -- 172.21.15.78:0/444392900 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c00f940 con 0x7fc87c099550 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c122a50 con 0x7fc87c099550 2024-04-25T02:10:22.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc878ff9700 1 -- 172.21.15.78:0/444392900 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c01b660 con 0x7fc87c099550 2024-04-25T02:10:22.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.549+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c124960 con 0x7fc87c099550 2024-04-25T02:10:22.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.550+0000 7fc878ff9700 1 -- 172.21.15.78:0/444392900 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fc86c01b9d0 con 0x7fc87c099550 2024-04-25T02:10:22.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.550+0000 7fc878ff9700 1 -- 172.21.15.78:0/444392900 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc86c03ca90 con 0x7fc87c099550 2024-04-25T02:10:22.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.550+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c124c10 con 0x7fc87c099550 2024-04-25T02:10:22.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.555+0000 7fc878ff9700 1 -- 172.21.15.78:0/444392900 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fc86c01f020 con 0x7fc87c099550 2024-04-25T02:10:22.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.715+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc87c122f50 con 0x7fc87c099550 2024-04-25T02:10:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.715+0000 7fc878ff9700 1 -- 172.21.15.78:0/444392900 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11308 (secure 0 0 0) 0x7fc86c02c940 con 0x7fc87c099550 2024-04-25T02:10:22.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:22.723 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:19.745195+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 >> v1:172.21.15.78:6816/46507 conn(0x7fc85c02bcd0 legacy=0x7fc85c02e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 msgr2=0x7fc87c06a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 --2- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c06a1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc86c006df0 tx=0x7fc86c017000).stop 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 shutdown_connections 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 --2- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc87c1282a0 0x7fc87c124470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 --2- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc87c099550 0x7fc87c06a1f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 --2- 172.21.15.78:0/444392900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc87c1279d0 0x7fc87c123f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 >> 172.21.15.78:0/444392900 conn(0x7fc87c0974d0 msgr2=0x7fc87c094910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 shutdown_connections 2024-04-25T02:10:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.717+0000 7fc88285f700 1 -- 172.21.15.78:0/444392900 wait complete. 2024-04-25T02:10:22.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:00.989685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:01.680090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:10:22.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:10:22.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.847+0000 7f2eceaa2700 1 Processor -- start 2024-04-25T02:10:22.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.847+0000 7f2eceaa2700 1 -- start start 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.847+0000 7f2eceaa2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ec8096220 0x7f2ec8096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.847+0000 7f2eceaa2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec8132770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.847+0000 7f2eceaa2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec805ed80 con 0x7f2ec8092af0 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.847+0000 7f2eceaa2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec8092ed0 con 0x7f2ec8096220 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.847+0000 7f2eceaa2700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec80931b0 con 0x7f2ec8130380 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ecd03f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec8132770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ec7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ec8096220 0x7f2ec8096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ecc83e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2ec8092af0 0x7f2ec8095b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48582/0 (socket says 172.21.15.78:48582) 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ecc83e700 1 -- 172.21.15.78:0/2486797657 learned_addr learned my addr 172.21.15.78:0/2486797657 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ec77fe700 1 -- 172.21.15.78:0/2486797657 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250131865 0 0) 0x7f2ec805ed80 con 0x7f2ec8092af0 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ec77fe700 1 -- 172.21.15.78:0/2486797657 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb80033f0 con 0x7f2ec8092af0 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ecd03f700 1 -- 172.21.15.78:0/2486797657 >> v2:172.21.15.78:3300/0 conn(0x7f2ec8096220 msgr2=0x7f2ec8096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ecd03f700 1 --2- 172.21.15.78:0/2486797657 >> v2:172.21.15.78:3300/0 conn(0x7f2ec8096220 0x7f2ec8096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ecd03f700 1 -- 172.21.15.78:0/2486797657 >> v1:172.21.15.78:6789/0 conn(0x7f2ec8092af0 legacy=0x7f2ec8095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ecd03f700 1 -- 172.21.15.78:0/2486797657 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8092640 con 0x7f2ec8130380 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ec7fff700 1 --2- 172.21.15.78:0/2486797657 >> v2:172.21.15.78:3300/0 conn(0x7f2ec8096220 0x7f2ec8096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ecd03f700 1 --2- 172.21.15.78:0/2486797657 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec8132770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2ec0009e60 tx=0x7f2ec0009780).ready entity=mon.2 client_cookie=67ae31371b8b117e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ec77fe700 1 -- 172.21.15.78:0/2486797657 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000e070 con 0x7f2ec8130380 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ec77fe700 1 -- 172.21.15.78:0/2486797657 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000bab0 con 0x7f2ec8130380 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.848+0000 7f2ec77fe700 1 -- 172.21.15.78:0/2486797657 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000be30 con 0x7f2ec8130380 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.849+0000 7f2eceaa2700 1 -- 172.21.15.78:0/2486797657 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 msgr2=0x7f2ec8132770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.849+0000 7f2eceaa2700 1 --2- 172.21.15.78:0/2486797657 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec8132770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2ec0009e60 tx=0x7f2ec0009780).stop 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.849+0000 7f2eceaa2700 1 -- 172.21.15.78:0/2486797657 shutdown_connections 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.849+0000 7f2eceaa2700 1 --2- 172.21.15.78:0/2486797657 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec8132770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.849+0000 7f2eceaa2700 1 --2- 172.21.15.78:0/2486797657 >> v2:172.21.15.78:3300/0 conn(0x7f2ec8096220 0x7f2ec8096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.849+0000 7f2eceaa2700 1 -- 172.21.15.78:0/2486797657 >> 172.21.15.78:0/2486797657 conn(0x7f2ec809abf0 msgr2=0x7f2ec8096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.849+0000 7f2eceaa2700 1 -- 172.21.15.78:0/2486797657 shutdown_connections 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.849+0000 7f2eceaa2700 1 -- 172.21.15.78:0/2486797657 wait complete. 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2eceaa2700 1 Processor -- start 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2eceaa2700 1 -- start start 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2eceaa2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ec8092af0 0x7f2ec808ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2eceaa2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ec8096220 0x7f2ec812f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2eceaa2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec812f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2eceaa2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec806ab00 con 0x7f2ec8092af0 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2eceaa2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec80976f0 con 0x7f2ec8096220 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2eceaa2700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec808cb80 con 0x7f2ec8130380 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2ec7fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ec8096220 0x7f2ec812f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2ecc83e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ec8092af0 0x7f2ec808ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2ecd03f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec812f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2ec7fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ec8096220 0x7f2ec812f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:58126/0 (socket says 172.21.15.78:58126) 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2ec7fff700 1 -- 172.21.15.78:0/634120793 learned_addr learned my addr 172.21.15.78:0/634120793 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.850+0000 7f2ecd03f700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec812f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:51458/0 (socket says 172.21.15.78:51458) 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ecd03f700 1 -- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ec8096220 msgr2=0x7f2ec812f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ecd03f700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ec8096220 0x7f2ec812f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ecd03f700 1 -- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ec8092af0 msgr2=0x7f2ec808ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ecd03f700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ec8092af0 0x7f2ec808ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ecd03f700 1 -- 172.21.15.78:0/634120793 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb40092a0 con 0x7f2ec8130380 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ec7fff700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ec8096220 0x7f2ec812f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ecc83e700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ec8092af0 0x7f2ec808ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ecd03f700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec812f880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2ec0009e60 tx=0x7f2ec80929f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ec5775700 1 -- 172.21.15.78:0/634120793 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0013e40 con 0x7f2ec8130380 2024-04-25T02:10:22.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ec5775700 1 -- 172.21.15.78:0/634120793 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec001d630 con 0x7f2ec8130380 2024-04-25T02:10:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec0009a20 con 0x7f2ec8130380 2024-04-25T02:10:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2ec5775700 1 -- 172.21.15.78:0/634120793 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec001d9f0 con 0x7f2ec8130380 2024-04-25T02:10:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.851+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec808ea90 con 0x7f2ec8130380 2024-04-25T02:10:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.852+0000 7f2ec5775700 1 -- 172.21.15.78:0/634120793 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f2ec0003040 con 0x7f2ec8130380 2024-04-25T02:10:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.852+0000 7f2ec5775700 1 -- 172.21.15.78:0/634120793 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2ec003ce00 con 0x7f2ec8130380 2024-04-25T02:10:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.852+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec808e680 con 0x7f2ec8130380 2024-04-25T02:10:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:22.857+0000 7f2ec5775700 1 -- 172.21.15.78:0/634120793 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f2ec808e680 con 0x7f2ec8130380 2024-04-25T02:10:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.013+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2ec808e680 con 0x7f2ec8130380 2024-04-25T02:10:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.014+0000 7f2ec5775700 1 -- 172.21.15.78:0/634120793 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2ec808e680 con 0x7f2ec8130380 2024-04-25T02:10:23.021 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.015+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 >> v1:172.21.15.78:6816/46507 conn(0x7f2eac02bcd0 legacy=0x7f2eac02e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.015+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 msgr2=0x7f2ec812f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.015+0000 7f2eceaa2700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec812f880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2ec0009e60 tx=0x7f2ec80929f0).stop 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.015+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 shutdown_connections 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.015+0000 7f2eceaa2700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2ec8130380 0x7f2ec812f880 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.015+0000 7f2eceaa2700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ec8092af0 0x7f2ec808ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.015+0000 7f2eceaa2700 1 --2- 172.21.15.78:0/634120793 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ec8096220 0x7f2ec812f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.015+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 >> 172.21.15.78:0/634120793 conn(0x7f2ec809abf0 msgr2=0x7f2ec8099490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.015+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 shutdown_connections 2024-04-25T02:10:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.016+0000 7f2eceaa2700 1 -- 172.21.15.78:0/634120793 wait complete. 2024-04-25T02:10:23.034 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:10:23.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.143+0000 7fec08ca1700 1 Processor -- start 2024-04-25T02:10:23.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.143+0000 7fec08ca1700 1 -- start start 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec08ca1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec04095b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec08ca1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec04090d40 0x7fec04096000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec08ca1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040931b0 con 0x7fec040964f0 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec08ca1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec04097b30 con 0x7fec04090d40 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec08ca1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec04092640 con 0x7fec04097750 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec0259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec04095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec01d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec04090d40 0x7fec04096000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec0259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec04095b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:58136/0 (socket says 172.21.15.78:58136) 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec0259c700 1 -- 172.21.15.78:0/603302281 learned_addr learned my addr 172.21.15.78:0/603302281 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec02d9d700 1 --1- 172.21.15.78:0/603302281 >> v1:172.21.15.78:6789/0 conn(0x7fec040964f0 0x7fec04131380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48586/0 (socket says 172.21.15.78:48586) 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec01d9b700 1 -- 172.21.15.78:0/603302281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 msgr2=0x7fec04095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec01d9b700 1 --2- 172.21.15.78:0/603302281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec04095b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec01d9b700 1 -- 172.21.15.78:0/603302281 >> v1:172.21.15.78:6789/0 conn(0x7fec040964f0 legacy=0x7fec04131380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec01d9b700 1 -- 172.21.15.78:0/603302281 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0405ed80 con 0x7fec04090d40 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec0159a700 1 -- 172.21.15.78:0/603302281 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837168885 0 0) 0x7fec040931b0 con 0x7fec040964f0 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec0259c700 1 --2- 172.21.15.78:0/603302281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec04095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.144+0000 7fec01d9b700 1 --2- 172.21.15.78:0/603302281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec04090d40 0x7fec04096000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7febf4009760 tx=0x7febf4009060).ready entity=mon.0 client_cookie=4a170428b1c93fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec0159a700 1 -- 172.21.15.78:0/603302281 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf400f510 con 0x7fec04090d40 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec0159a700 1 -- 172.21.15.78:0/603302281 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf400f670 con 0x7fec04090d40 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec0159a700 1 -- 172.21.15.78:0/603302281 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf400f9f0 con 0x7fec04090d40 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec08ca1700 1 -- 172.21.15.78:0/603302281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec04090d40 msgr2=0x7fec04096000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec08ca1700 1 --2- 172.21.15.78:0/603302281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec04090d40 0x7fec04096000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7febf4009760 tx=0x7febf4009060).stop 2024-04-25T02:10:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec08ca1700 1 -- 172.21.15.78:0/603302281 shutdown_connections 2024-04-25T02:10:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec08ca1700 1 --2- 172.21.15.78:0/603302281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec04095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec08ca1700 1 --2- 172.21.15.78:0/603302281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec04090d40 0x7fec04096000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec08ca1700 1 -- 172.21.15.78:0/603302281 >> 172.21.15.78:0/603302281 conn(0x7fec0409abf0 msgr2=0x7fec04096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec08ca1700 1 -- 172.21.15.78:0/603302281 shutdown_connections 2024-04-25T02:10:23.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.145+0000 7fec08ca1700 1 -- 172.21.15.78:0/603302281 wait complete. 2024-04-25T02:10:23.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.146+0000 7fec08ca1700 1 Processor -- start 2024-04-25T02:10:23.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.146+0000 7fec08ca1700 1 -- start start 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec08ca1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fec040964f0 0x7fec0408b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec08ca1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec0408bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec08ca1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec0408c0f0 0x7fec0413a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec08ca1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0408ebc0 con 0x7fec0408c0f0 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec08ca1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0408c550 con 0x7fec04097750 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec08ca1700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec0408f160 con 0x7fec040964f0 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec02d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec0408c0f0 0x7fec0413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec0259c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fec040964f0 0x7fec0408b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec01d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec0408bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec02d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec0408c0f0 0x7fec0413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38708/0 (socket says 172.21.15.78:38708) 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec02d9d700 1 -- 172.21.15.78:0/2371562690 learned_addr learned my addr 172.21.15.78:0/2371562690 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec02d9d700 1 -- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fec040964f0 msgr2=0x7fec0408b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec02d9d700 1 --2- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fec040964f0 0x7fec0408b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec02d9d700 1 -- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 msgr2=0x7fec0408bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec02d9d700 1 --2- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec0408bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec02d9d700 1 -- 172.21.15.78:0/2371562690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8009370 con 0x7fec0408c0f0 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec01d9b700 1 --2- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec0408bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec02d9d700 1 --2- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec0408c0f0 0x7fec0413a440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7febfc00c7e0 tx=0x7febfc007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7febf2ffd700 1 -- 172.21.15.78:0/2371562690 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc005c70 con 0x7fec0408c0f0 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7febf2ffd700 1 -- 172.21.15.78:0/2371562690 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc005dd0 con 0x7fec0408c0f0 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf40092a0 con 0x7fec0408c0f0 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7febf2ffd700 1 -- 172.21.15.78:0/2371562690 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc007320 con 0x7fec0408c0f0 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.147+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0408d2f0 con 0x7fec0408c0f0 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.148+0000 7febf2ffd700 1 -- 172.21.15.78:0/2371562690 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7febfc007710 con 0x7fec0408c0f0 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.148+0000 7febf2ffd700 1 -- 172.21.15.78:0/2371562690 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7febfc03b140 con 0x7fec0408c0f0 2024-04-25T02:10:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.148+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec04092af0 con 0x7fec0408c0f0 2024-04-25T02:10:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.153+0000 7febf2ffd700 1 -- 172.21.15.78:0/2371562690 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7febfc01c3e0 con 0x7fec0408c0f0 2024-04-25T02:10:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.311+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec0406c550 con 0x7fec0408c0f0 2024-04-25T02:10:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.312+0000 7febf2ffd700 1 -- 172.21.15.78:0/2371562690 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7febfc01a300 con 0x7fec0408c0f0 2024-04-25T02:10:23.319 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:10:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 >> v1:172.21.15.78:6816/46507 conn(0x7febe402bd00 legacy=0x7febe402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec0408c0f0 msgr2=0x7fec0413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 --2- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec0408c0f0 0x7fec0413a440 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7febfc00c7e0 tx=0x7febfc007f60).stop 2024-04-25T02:10:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 shutdown_connections 2024-04-25T02:10:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 --2- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec0408c0f0 0x7fec0413a440 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 --2- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fec040964f0 0x7fec0408b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 --2- 172.21.15.78:0/2371562690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec04097750 0x7fec0408bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 >> 172.21.15.78:0/2371562690 conn(0x7fec0409abf0 msgr2=0x7fec04097f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 shutdown_connections 2024-04-25T02:10:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.313+0000 7fec08ca1700 1 -- 172.21.15.78:0/2371562690 wait complete. 2024-04-25T02:10:23.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.442+0000 7fb50484c700 1 Processor -- start 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.442+0000 7fb50484c700 1 -- start start 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb50484c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb500095190 0x7fb500095570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb50484c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb500095a60 0x7fb50012c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb50484c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb50012c4f0 0x7fb50012e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb50484c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb500096570 con 0x7fb500095a60 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb50484c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5000923f0 con 0x7fb500095190 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb50484c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb500094c70 con 0x7fb50012c4f0 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fed9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb50012c4f0 0x7fb50012e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fe59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb500095190 0x7fb500095570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fdd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb500095a60 0x7fb50012c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fdd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb500095a60 0x7fb50012c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57904/0 (socket says 172.21.15.78:57904) 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fe59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb500095190 0x7fb500095570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:60626/0 (socket says 172.21.15.78:60626) 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fed9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb50012c4f0 0x7fb50012e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:35506/0 (socket says 172.21.15.78:35506) 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fdd9b700 1 -- 172.21.15.78:0/607489142 learned_addr learned my addr 172.21.15.78:0/607489142 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fdd9b700 1 -- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb50012c4f0 msgr2=0x7fb50012e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fdd9b700 1 --2- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb50012c4f0 0x7fb50012e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fdd9b700 1 -- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb500095190 msgr2=0x7fb500095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fdd9b700 1 --2- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb500095190 0x7fb500095570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fdd9b700 1 -- 172.21.15.78:0/607489142 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb500096da0 con 0x7fb500095a60 2024-04-25T02:10:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fe59c700 1 --2- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb500095190 0x7fb500095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fed9d700 1 --2- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb50012c4f0 0x7fb50012e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fdd9b700 1 --2- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095a60 0x7fb50012c000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb4f0006fd0 tx=0x7fb4f00090f0).ready entity=mon.0 client_cookie=84414e1ea5dc8385 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fd59a700 1 -- 172.21.15.78:0/607489142 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000f510 con 0x7fb500095a60 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fd59a700 1 -- 172.21.15.78:0/607489142 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f000f670 con 0x7fb500095a60 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.443+0000 7fb4fd59a700 1 -- 172.21.15.78:0/607489142 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000fa10 con 0x7fb500095a60 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.444+0000 7fb50484c700 1 -- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095a60 msgr2=0x7fb50012c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.444+0000 7fb50484c700 1 --2- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095a60 0x7fb50012c000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb4f0006fd0 tx=0x7fb4f00090f0).stop 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.444+0000 7fb50484c700 1 -- 172.21.15.78:0/607489142 shutdown_connections 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.444+0000 7fb50484c700 1 --2- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb500095190 0x7fb500095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.444+0000 7fb50484c700 1 --2- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb50012c4f0 0x7fb50012e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.444+0000 7fb50484c700 1 --2- 172.21.15.78:0/607489142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095a60 0x7fb50012c000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.444+0000 7fb50484c700 1 -- 172.21.15.78:0/607489142 >> 172.21.15.78:0/607489142 conn(0x7fb50009a970 msgr2=0x7fb50009ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.444+0000 7fb50484c700 1 -- 172.21.15.78:0/607489142 shutdown_connections 2024-04-25T02:10:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.444+0000 7fb50484c700 1 -- 172.21.15.78:0/607489142 wait complete. 2024-04-25T02:10:23.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.445+0000 7fb50484c700 1 Processor -- start 2024-04-25T02:10:23.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.445+0000 7fb50484c700 1 -- start start 2024-04-25T02:10:23.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.445+0000 7fb50484c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095190 0x7fb50011bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.445+0000 7fb50484c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb500095a60 0x7fb500117bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.445+0000 7fb50484c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb50012c4f0 0x7fb5001180b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.445+0000 7fb50484c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50012bd30 con 0x7fb500095190 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.445+0000 7fb50484c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50011a260 con 0x7fb50012c4f0 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb50484c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb50011b100 con 0x7fb500095a60 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fe59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095190 0x7fb50011bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fdd9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb500095a60 0x7fb500117bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fe59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095190 0x7fb50011bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57912/0 (socket says 172.21.15.78:57912) 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fe59c700 1 -- 172.21.15.78:0/1317602783 learned_addr learned my addr 172.21.15.78:0/1317602783 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fed9d700 1 --2- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb50012c4f0 0x7fb5001180b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fe59c700 1 -- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb500095a60 msgr2=0x7fb500117bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fe59c700 1 --2- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb500095a60 0x7fb500117bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fe59c700 1 -- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb50012c4f0 msgr2=0x7fb5001180b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fe59c700 1 --2- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb50012c4f0 0x7fb5001180b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fe59c700 1 -- 172.21.15.78:0/1317602783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40092a0 con 0x7fb500095190 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4fe59c700 1 --2- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095190 0x7fb50011bba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fb4f400ea20 tx=0x7fb4f4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4eeffd700 1 -- 172.21.15.78:0/1317602783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400ee60 con 0x7fb500095190 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4eeffd700 1 -- 172.21.15.78:0/1317602783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f4009600 con 0x7fb500095190 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb4eeffd700 1 -- 172.21.15.78:0/1317602783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400ca60 con 0x7fb500095190 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f8009a20 con 0x7fb500095190 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.446+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f0009370 con 0x7fb500095190 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.447+0000 7fb4eeffd700 1 -- 172.21.15.78:0/1317602783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fb4f401b400 con 0x7fb500095190 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.447+0000 7fb4eeffd700 1 -- 172.21.15.78:0/1317602783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb4f403b650 con 0x7fb500095190 2024-04-25T02:10:23.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.447+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb500092fb0 con 0x7fb500095190 2024-04-25T02:10:23.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.452+0000 7fb4eeffd700 1 -- 172.21.15.78:0/1317602783 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fb4f4016020 con 0x7fb500095190 2024-04-25T02:10:23.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.608+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb500119080 con 0x7fb500095190 2024-04-25T02:10:23.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.609+0000 7fb4eeffd700 1 -- 172.21.15.78:0/1317602783 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4f4011d20 con 0x7fb500095190 2024-04-25T02:10:23.616 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.610+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 >> v1:172.21.15.78:6816/46507 conn(0x7fb4e002bd00 legacy=0x7fb4e002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.610+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095190 msgr2=0x7fb50011bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.610+0000 7fb50484c700 1 --2- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095190 0x7fb50011bba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fb4f400ea20 tx=0x7fb4f4009060).stop 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.610+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 shutdown_connections 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.610+0000 7fb50484c700 1 --2- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb50012c4f0 0x7fb5001180b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.610+0000 7fb50484c700 1 --2- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb500095190 0x7fb50011bba0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.610+0000 7fb50484c700 1 --2- 172.21.15.78:0/1317602783 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb500095a60 0x7fb500117bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.610+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 >> 172.21.15.78:0/1317602783 conn(0x7fb50009a970 msgr2=0x7fb500062860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.611+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 shutdown_connections 2024-04-25T02:10:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.611+0000 7fb50484c700 1 -- 172.21.15.78:0/1317602783 wait complete. 2024-04-25T02:10:23.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:10:23.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.739+0000 7f9f1058e700 1 Processor -- start 2024-04-25T02:10:23.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.739+0000 7f9f1058e700 1 -- start start 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f1058e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f0812af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f1058e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9f0812ab00 0x7f9f0812b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f1058e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f08091a10 con 0x7f9f08095190 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f1058e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f08062c40 con 0x7f9f0812ab00 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f1058e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f080922e0 con 0x7f9f08062860 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0e32a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f0812af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0db29700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9f0812ab00 0x7f9f0812b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0eb2b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9f08095190 0x7f9f08095620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51712/0 (socket says 172.21.15.78:51712) 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0eb2b700 1 -- 172.21.15.78:0/1425537606 learned_addr learned my addr 172.21.15.78:0/1425537606 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0e32a700 1 -- 172.21.15.78:0/1425537606 >> v2:172.21.15.78:3300/0 conn(0x7f9f0812ab00 msgr2=0x7f9f0812b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0e32a700 1 --2- 172.21.15.78:0/1425537606 >> v2:172.21.15.78:3300/0 conn(0x7f9f0812ab00 0x7f9f0812b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0e32a700 1 -- 172.21.15.78:0/1425537606 >> v1:172.21.15.78:6789/0 conn(0x7f9f08095190 legacy=0x7f9f08095620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0e32a700 1 -- 172.21.15.78:0/1425537606 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0812b970 con 0x7f9f08062860 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0db29700 1 --2- 172.21.15.78:0/1425537606 >> v2:172.21.15.78:3300/0 conn(0x7f9f0812ab00 0x7f9f0812b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.740+0000 7f9f0e32a700 1 --2- 172.21.15.78:0/1425537606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f0812af90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9ef8009790 tx=0x7f9ef8009060).ready entity=mon.1 client_cookie=6456a5f0d7f7b82f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f0d328700 1 -- 172.21.15.78:0/1425537606 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800f510 con 0x7f9f08062860 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f0d328700 1 -- 172.21.15.78:0/1425537606 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef800f670 con 0x7f9f08062860 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f0d328700 1 -- 172.21.15.78:0/1425537606 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800f9f0 con 0x7f9f08062860 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f1058e700 1 -- 172.21.15.78:0/1425537606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 msgr2=0x7f9f0812af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f1058e700 1 --2- 172.21.15.78:0/1425537606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f0812af90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9ef8009790 tx=0x7f9ef8009060).stop 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f1058e700 1 -- 172.21.15.78:0/1425537606 shutdown_connections 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f1058e700 1 --2- 172.21.15.78:0/1425537606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f0812af90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f1058e700 1 --2- 172.21.15.78:0/1425537606 >> v2:172.21.15.78:3300/0 conn(0x7f9f0812ab00 0x7f9f0812b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f1058e700 1 -- 172.21.15.78:0/1425537606 >> 172.21.15.78:0/1425537606 conn(0x7f9f0809a970 msgr2=0x7f9f0809ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f1058e700 1 -- 172.21.15.78:0/1425537606 shutdown_connections 2024-04-25T02:10:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.741+0000 7f9f1058e700 1 -- 172.21.15.78:0/1425537606 wait complete. 2024-04-25T02:10:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.742+0000 7f9f1058e700 1 Processor -- start 2024-04-25T02:10:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.742+0000 7f9f1058e700 1 -- start start 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.742+0000 7f9f1058e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f08069150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.742+0000 7f9f1058e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9f08095190 0x7f9f08115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f1058e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f08115770 0x7f9f08115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f1058e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081160a0 con 0x7f9f08115770 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f1058e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f081171e0 con 0x7f9f08062860 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f1058e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0809a260 con 0x7f9f08095190 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0e32a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f08069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0e32a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f08069150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:60654/0 (socket says 172.21.15.78:60654) 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0e32a700 1 -- 172.21.15.78:0/1704090718 learned_addr learned my addr 172.21.15.78:0/1704090718 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0db29700 1 --2- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9f08095190 0x7f9f08115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0eb2b700 1 --2- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f08115770 0x7f9f08115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0e32a700 1 -- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9f08095190 msgr2=0x7f9f08115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0e32a700 1 --2- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9f08095190 0x7f9f08115280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0e32a700 1 -- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f08115770 msgr2=0x7f9f08115bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0e32a700 1 --2- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f08115770 0x7f9f08115bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0e32a700 1 -- 172.21.15.78:0/1704090718 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f040092a0 con 0x7f9f08062860 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f0e32a700 1 --2- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f08069150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9f081275b0 tx=0x7f9ef8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9efeffd700 1 -- 172.21.15.78:0/1704090718 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800f7e0 con 0x7f9f08062860 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9efeffd700 1 -- 172.21.15.78:0/1704090718 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef800f980 con 0x7f9f08062860 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef80092a0 con 0x7f9f08062860 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9efeffd700 1 -- 172.21.15.78:0/1704090718 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef801b660 con 0x7f9f08062860 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.743+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f081163f0 con 0x7f9f08062860 2024-04-25T02:10:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.744+0000 7f9efeffd700 1 -- 172.21.15.78:0/1704090718 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9ef801ba50 con 0x7f9f08062860 2024-04-25T02:10:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.744+0000 7f9efeffd700 1 -- 172.21.15.78:0/1704090718 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9ef803cc60 con 0x7f9f08062860 2024-04-25T02:10:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.744+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f08125980 con 0x7f9f08062860 2024-04-25T02:10:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.749+0000 7f9efeffd700 1 -- 172.21.15.78:0/1704090718 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f9ef8023400 con 0x7f9f08062860 2024-04-25T02:10:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.907+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f0809b490 con 0x7f9f08062860 2024-04-25T02:10:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.907+0000 7f9efeffd700 1 -- 172.21.15.78:0/1704090718 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ef80103a0 con 0x7f9f08062860 2024-04-25T02:10:23.914 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-25T02:10:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 >> v1:172.21.15.78:6816/46507 conn(0x7f9eec02bd30 legacy=0x7f9eec02e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 msgr2=0x7f9f08069150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 --2- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f08069150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9f081275b0 tx=0x7f9ef8017000).stop 2024-04-25T02:10:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 shutdown_connections 2024-04-25T02:10:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 --2- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f08115770 0x7f9f08115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 --2- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f08062860 0x7f9f08069150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 --2- 172.21.15.78:0/1704090718 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9f08095190 0x7f9f08115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 >> 172.21.15.78:0/1704090718 conn(0x7f9f0809a970 msgr2=0x7f9f08099820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 shutdown_connections 2024-04-25T02:10:23.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:23.909+0000 7f9f1058e700 1 -- 172.21.15.78:0/1704090718 wait complete. 2024-04-25T02:10:23.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:10:24.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.035+0000 7fdc35306700 1 Processor -- start 2024-04-25T02:10:24.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.035+0000 7fdc35306700 1 -- start start 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc35306700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30098600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc35306700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc30125940 0x7fdc301285d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc35306700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc300661e0 con 0x7fdc30125dc0 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc35306700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc30066dc0 con 0x7fdc30125940 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc35306700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30065f20 con 0x7fdc300669e0 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2e7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc30125940 0x7fdc301285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2effd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30098600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdc30125dc0 0x7fdc30128ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51724/0 (socket says 172.21.15.78:51724) 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2f7fe700 1 -- 172.21.15.78:0/1158716422 learned_addr learned my addr 172.21.15.78:0/1158716422 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2e7fc700 1 -- 172.21.15.78:0/1158716422 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 msgr2=0x7fdc30098600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2e7fc700 1 --2- 172.21.15.78:0/1158716422 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30098600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2e7fc700 1 -- 172.21.15.78:0/1158716422 >> v1:172.21.15.78:6789/0 conn(0x7fdc30125dc0 legacy=0x7fdc30128ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2dffb700 1 -- 172.21.15.78:0/1158716422 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223782922 0 0) 0x7fdc300661e0 con 0x7fdc30125dc0 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2e7fc700 1 -- 172.21.15.78:0/1158716422 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300990f0 con 0x7fdc30125940 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2effd700 1 --2- 172.21.15.78:0/1158716422 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30098600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.036+0000 7fdc2e7fc700 1 --2- 172.21.15.78:0/1158716422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 0x7fdc301285d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fdc20009760 tx=0x7fdc20009060).ready entity=mon.0 client_cookie=a076d67bb21de3fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc2dffb700 1 -- 172.21.15.78:0/1158716422 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200090d0 con 0x7fdc30125940 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc2dffb700 1 -- 172.21.15.78:0/1158716422 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2000f510 con 0x7fdc30125940 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc2dffb700 1 -- 172.21.15.78:0/1158716422 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2000f890 con 0x7fdc30125940 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc35306700 1 -- 172.21.15.78:0/1158716422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 msgr2=0x7fdc301285d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc35306700 1 --2- 172.21.15.78:0/1158716422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 0x7fdc301285d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fdc20009760 tx=0x7fdc20009060).stop 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc35306700 1 -- 172.21.15.78:0/1158716422 shutdown_connections 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc35306700 1 --2- 172.21.15.78:0/1158716422 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30098600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc35306700 1 --2- 172.21.15.78:0/1158716422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 0x7fdc301285d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc35306700 1 -- 172.21.15.78:0/1158716422 >> 172.21.15.78:0/1158716422 conn(0x7fdc30096210 msgr2=0x7fdc30096620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc35306700 1 -- 172.21.15.78:0/1158716422 shutdown_connections 2024-04-25T02:10:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.037+0000 7fdc35306700 1 -- 172.21.15.78:0/1158716422 wait complete. 2024-04-25T02:10:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.038+0000 7fdc35306700 1 Processor -- start 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.038+0000 7fdc35306700 1 -- start start 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.038+0000 7fdc35306700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc35306700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 0x7fdc30110c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc35306700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30125dc0 0x7fdc301110f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc35306700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300656d0 con 0x7fdc30125940 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc35306700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30123800 con 0x7fdc30125dc0 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc35306700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc301141b0 con 0x7fdc300669e0 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2effd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 0x7fdc30110c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2effd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30110710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:35544/0 (socket says 172.21.15.78:35544) 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 0x7fdc30110c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57960/0 (socket says 172.21.15.78:57960) 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2effd700 1 -- 172.21.15.78:0/3484036177 learned_addr learned my addr 172.21.15.78:0/3484036177 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2f7fe700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30125dc0 0x7fdc301110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2e7fc700 1 -- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 msgr2=0x7fdc30110710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2e7fc700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30110710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2e7fc700 1 -- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30125dc0 msgr2=0x7fdc301110f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2e7fc700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30125dc0 0x7fdc301110f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2e7fc700 1 -- 172.21.15.78:0/3484036177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2400d740 con 0x7fdc30125940 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2effd700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2f7fe700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30125dc0 0x7fdc301110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc2e7fc700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 0x7fdc30110c00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdc20014000 tx=0x7fdc20017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc177fe700 1 -- 172.21.15.78:0/3484036177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2000f890 con 0x7fdc30125940 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc177fe700 1 -- 172.21.15.78:0/3484036177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20006910 con 0x7fdc30125940 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc200092a0 con 0x7fdc30125940 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc177fe700 1 -- 172.21.15.78:0/3484036177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2000fea0 con 0x7fdc30125940 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.039+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc30114890 con 0x7fdc30125940 2024-04-25T02:10:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.040+0000 7fdc177fe700 1 -- 172.21.15.78:0/3484036177 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fdc2001b620 con 0x7fdc30125940 2024-04-25T02:10:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.040+0000 7fdc177fe700 1 -- 172.21.15.78:0/3484036177 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdc2003c940 con 0x7fdc30125940 2024-04-25T02:10:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.040+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc301242a0 con 0x7fdc30125940 2024-04-25T02:10:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.045+0000 7fdc177fe700 1 -- 172.21.15.78:0/3484036177 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fdc20028020 con 0x7fdc30125940 2024-04-25T02:10:24.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.215+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdc30113dd0 con 0x7fdc30125940 2024-04-25T02:10:24.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.215+0000 7fdc177fe700 1 -- 172.21.15.78:0/3484036177 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v17) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdc2002b940 con 0x7fdc30125940 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 >> v1:172.21.15.78:6816/46507 conn(0x7fdc1c02bd00 legacy=0x7fdc1c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 msgr2=0x7fdc30110c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 0x7fdc30110c00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdc20014000 tx=0x7fdc20017000).stop 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 shutdown_connections 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30125dc0 0x7fdc301110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fdc300669e0 0x7fdc30110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 --2- 172.21.15.78:0/3484036177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc30125940 0x7fdc30110c00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 >> 172.21.15.78:0/3484036177 conn(0x7fdc30096210 msgr2=0x7fdc30092eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 shutdown_connections 2024-04-25T02:10:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.217+0000 7fdc35306700 1 -- 172.21.15.78:0/3484036177 wait complete. 2024-04-25T02:10:24.225 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-04-25T02:10:24.235 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:10:24.235 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:10:24.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:10:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.365+0000 7f7c3c926700 1 Processor -- start 2024-04-25T02:10:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.365+0000 7f7c3c926700 1 -- start start 2024-04-25T02:10:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3c926700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c380961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3c926700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c380937a0 0x7f7c381243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3c926700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c38096cf0 con 0x7f7c381274e0 2024-04-25T02:10:24.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3c926700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c38093ba0 con 0x7f7c380937a0 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3c926700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c38092d00 con 0x7f7c38124000 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3659c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c380961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c35d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c380937a0 0x7f7c381243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c36d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7c381274e0 0x7f7c38127950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51730/0 (socket says 172.21.15.78:51730) 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c36d9d700 1 -- 172.21.15.78:0/4215791427 learned_addr learned my addr 172.21.15.78:0/4215791427 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c35d9b700 1 -- 172.21.15.78:0/4215791427 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 msgr2=0x7f7c380961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c35d9b700 1 --2- 172.21.15.78:0/4215791427 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c380961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c35d9b700 1 -- 172.21.15.78:0/4215791427 >> v1:172.21.15.78:6789/0 conn(0x7f7c381274e0 legacy=0x7f7c38127950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c35d9b700 1 -- 172.21.15.78:0/4215791427 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c380933a0 con 0x7f7c380937a0 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3559a700 1 -- 172.21.15.78:0/4215791427 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322680474 0 0) 0x7f7c38096cf0 con 0x7f7c381274e0 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3659c700 1 --2- 172.21.15.78:0/4215791427 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c380961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c35d9b700 1 --2- 172.21.15.78:0/4215791427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 0x7f7c381243e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f7c2800ba00 tx=0x7f7c2800b300).ready entity=mon.0 client_cookie=2c19700443ad1db0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3559a700 1 -- 172.21.15.78:0/4215791427 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800b370 con 0x7f7c380937a0 2024-04-25T02:10:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3559a700 1 -- 172.21.15.78:0/4215791427 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2800da70 con 0x7f7c380937a0 2024-04-25T02:10:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.366+0000 7f7c3559a700 1 -- 172.21.15.78:0/4215791427 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800ddf0 con 0x7f7c380937a0 2024-04-25T02:10:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.367+0000 7f7c3c926700 1 -- 172.21.15.78:0/4215791427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 msgr2=0x7f7c381243e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.367+0000 7f7c3c926700 1 --2- 172.21.15.78:0/4215791427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 0x7f7c381243e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f7c2800ba00 tx=0x7f7c2800b300).stop 2024-04-25T02:10:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.367+0000 7f7c3c926700 1 -- 172.21.15.78:0/4215791427 shutdown_connections 2024-04-25T02:10:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.367+0000 7f7c3c926700 1 --2- 172.21.15.78:0/4215791427 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c380961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.367+0000 7f7c3c926700 1 --2- 172.21.15.78:0/4215791427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 0x7f7c381243e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.367+0000 7f7c3c926700 1 -- 172.21.15.78:0/4215791427 >> 172.21.15.78:0/4215791427 conn(0x7f7c38097450 msgr2=0x7f7c38097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.367+0000 7f7c3c926700 1 -- 172.21.15.78:0/4215791427 shutdown_connections 2024-04-25T02:10:24.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.367+0000 7f7c3c926700 1 -- 172.21.15.78:0/4215791427 wait complete. 2024-04-25T02:10:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.368+0000 7f7c3c926700 1 Processor -- start 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.368+0000 7f7c3c926700 1 -- start start 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3c926700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 0x7f7c38111bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3c926700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c381120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3c926700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c381274e0 0x7f7c38135930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3c926700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c38092440 con 0x7f7c380937a0 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3c926700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c38114990 con 0x7f7c381274e0 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3c926700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c38114c50 con 0x7f7c38124000 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 0x7f7c38111bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 0x7f7c38111bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57982/0 (socket says 172.21.15.78:57982) 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c35d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c381120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3659c700 1 -- 172.21.15.78:0/512342227 learned_addr learned my addr 172.21.15.78:0/512342227 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c36d9d700 1 --2- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c381274e0 0x7f7c38135930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c35d9b700 1 -- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c381274e0 msgr2=0x7f7c38135930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c35d9b700 1 --2- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c381274e0 0x7f7c38135930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c35d9b700 1 -- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 msgr2=0x7f7c38111bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c35d9b700 1 --2- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 0x7f7c38111bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c35d9b700 1 -- 172.21.15.78:0/512342227 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0092a0 con 0x7f7c38124000 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.369+0000 7f7c3659c700 1 --2- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 0x7f7c38111bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.370+0000 7f7c35d9b700 1 --2- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c381120a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7c28016000 tx=0x7f7c2800b300).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.370+0000 7f7c26ffd700 1 -- 172.21.15.78:0/512342227 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28020070 con 0x7f7c38124000 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.370+0000 7f7c26ffd700 1 -- 172.21.15.78:0/512342227 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28006910 con 0x7f7c38124000 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.370+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2800b540 con 0x7f7c38124000 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.370+0000 7f7c26ffd700 1 -- 172.21.15.78:0/512342227 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800ddf0 con 0x7f7c38124000 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.370+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c381155f0 con 0x7f7c38124000 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.371+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c38097f70 con 0x7f7c38124000 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.371+0000 7f7c26ffd700 1 -- 172.21.15.78:0/512342227 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f7c280198f0 con 0x7f7c38124000 2024-04-25T02:10:24.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.371+0000 7f7c26ffd700 1 -- 172.21.15.78:0/512342227 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7c2803e9d0 con 0x7f7c38124000 2024-04-25T02:10:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.375+0000 7f7c26ffd700 1 -- 172.21.15.78:0/512342227 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f7c28017950 con 0x7f7c38124000 2024-04-25T02:10:24.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.537+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c38091b30 con 0x7f7c38124000 2024-04-25T02:10:24.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.538+0000 7f7c26ffd700 1 -- 172.21.15.78:0/512342227 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11308 (secure 0 0 0) 0x7f7c2802a070 con 0x7f7c38124000 2024-04-25T02:10:24.545 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:10:24.545 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:19.745195+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:10:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 >> v1:172.21.15.78:6816/46507 conn(0x7f7c1802bd00 legacy=0x7f7c1802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 msgr2=0x7f7c381120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 --2- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c381120a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7c28016000 tx=0x7f7c2800b300).stop 2024-04-25T02:10:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 shutdown_connections 2024-04-25T02:10:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 --2- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7c381274e0 0x7f7c38135930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 --2- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c380937a0 0x7f7c38111bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 --2- 172.21.15.78:0/512342227 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7c38124000 0x7f7c381120a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 >> 172.21.15.78:0/512342227 conn(0x7f7c38097450 msgr2=0x7f7c381254f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 shutdown_connections 2024-04-25T02:10:24.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.539+0000 7f7c3c926700 1 -- 172.21.15.78:0/512342227 wait complete. 2024-04-25T02:10:24.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:00.989685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:01.680090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:10:24.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:10:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.668+0000 7f3f49b06700 1 Processor -- start 2024-04-25T02:10:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.668+0000 7f3f49b06700 1 -- start start 2024-04-25T02:10:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.668+0000 7f3f49b06700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44062860 0x7f3f44125800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f49b06700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44125370 0x7f3f44125cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f49b06700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f44096e70 con 0x7f3f44093c20 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f49b06700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44096370 con 0x7f3f44125370 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f49b06700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44095320 con 0x7f3f44062860 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f437fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44062860 0x7f3f44125800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f43fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3f44093c20 0x7f3f440940b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51738/0 (socket says 172.21.15.78:51738) 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f42ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44125370 0x7f3f44125cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f43fff700 1 -- 172.21.15.78:0/1112575455 learned_addr learned my addr 172.21.15.78:0/1112575455 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f437fe700 1 -- 172.21.15.78:0/1112575455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44125370 msgr2=0x7f3f44125cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f437fe700 1 --2- 172.21.15.78:0/1112575455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44125370 0x7f3f44125cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f427fc700 1 -- 172.21.15.78:0/1112575455 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310423577 0 0) 0x7f3f3c001490 con 0x7f3f44093c20 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f437fe700 1 -- 172.21.15.78:0/1112575455 >> v1:172.21.15.78:6789/0 conn(0x7f3f44093c20 legacy=0x7f3f440940b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f437fe700 1 -- 172.21.15.78:0/1112575455 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44095fb0 con 0x7f3f44062860 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f42ffd700 1 --2- 172.21.15.78:0/1112575455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44125370 0x7f3f44125cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f437fe700 1 --2- 172.21.15.78:0/1112575455 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44062860 0x7f3f44125800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3f2c009790 tx=0x7f3f2c009060).ready entity=mon.2 client_cookie=a0020835cacc7148 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f427fc700 1 -- 172.21.15.78:0/1112575455 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00f510 con 0x7f3f44062860 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f427fc700 1 -- 172.21.15.78:0/1112575455 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c00f670 con 0x7f3f44062860 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.669+0000 7f3f427fc700 1 -- 172.21.15.78:0/1112575455 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00f9f0 con 0x7f3f44062860 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.670+0000 7f3f49b06700 1 -- 172.21.15.78:0/1112575455 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44062860 msgr2=0x7f3f44125800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.670+0000 7f3f49b06700 1 --2- 172.21.15.78:0/1112575455 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44062860 0x7f3f44125800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3f2c009790 tx=0x7f3f2c009060).stop 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.670+0000 7f3f49b06700 1 -- 172.21.15.78:0/1112575455 shutdown_connections 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.670+0000 7f3f49b06700 1 --2- 172.21.15.78:0/1112575455 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44062860 0x7f3f44125800 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.670+0000 7f3f49b06700 1 --2- 172.21.15.78:0/1112575455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44125370 0x7f3f44125cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.670+0000 7f3f49b06700 1 -- 172.21.15.78:0/1112575455 >> 172.21.15.78:0/1112575455 conn(0x7f3f4409a970 msgr2=0x7f3f4409ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.670+0000 7f3f49b06700 1 -- 172.21.15.78:0/1112575455 shutdown_connections 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.670+0000 7f3f49b06700 1 -- 172.21.15.78:0/1112575455 wait complete. 2024-04-25T02:10:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f49b06700 1 Processor -- start 2024-04-25T02:10:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f49b06700 1 -- start start 2024-04-25T02:10:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f49b06700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44062860 0x7f3f44111ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f49b06700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44093c20 0x7f3f44112090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f49b06700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44112580 0x7f3f4413ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f49b06700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44122c20 con 0x7f3f44062860 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f49b06700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44098850 con 0x7f3f44093c20 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f49b06700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44095990 con 0x7f3f44112580 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f437fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44062860 0x7f3f44111ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f437fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44062860 0x7f3f44111ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57990/0 (socket says 172.21.15.78:57990) 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f437fe700 1 -- 172.21.15.78:0/2392717420 learned_addr learned my addr 172.21.15.78:0/2392717420 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f43fff700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44112580 0x7f3f4413ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.671+0000 7f3f42ffd700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44093c20 0x7f3f44112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f437fe700 1 -- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44112580 msgr2=0x7f3f4413ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f437fe700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44112580 0x7f3f4413ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f437fe700 1 -- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44093c20 msgr2=0x7f3f44112090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f437fe700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44093c20 0x7f3f44112090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f437fe700 1 -- 172.21.15.78:0/2392717420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340092a0 con 0x7f3f44062860 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f42ffd700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44093c20 0x7f3f44112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f437fe700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44062860 0x7f3f44111ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f3f2c00f610 tx=0x7f3f2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f3bfff700 1 -- 172.21.15.78:0/2392717420 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00fe80 con 0x7f3f44062860 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f3bfff700 1 -- 172.21.15.78:0/2392717420 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c00f7e0 con 0x7f3f44062860 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c0092a0 con 0x7f3f44062860 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f3bfff700 1 -- 172.21.15.78:0/2392717420 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c01b640 con 0x7f3f44062860 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.672+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f44115050 con 0x7f3f44062860 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.673+0000 7f3f3bfff700 1 -- 172.21.15.78:0/2392717420 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f3f2c01b9b0 con 0x7f3f44062860 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.673+0000 7f3f3bfff700 1 -- 172.21.15.78:0/2392717420 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3f2c03cbb0 con 0x7f3f44062860 2024-04-25T02:10:24.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.673+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4409b490 con 0x7f3f44062860 2024-04-25T02:10:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.678+0000 7f3f3bfff700 1 -- 172.21.15.78:0/2392717420 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f3f2c028070 con 0x7f3f44062860 2024-04-25T02:10:24.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.839+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3f4406a3e0 con 0x7f3f44062860 2024-04-25T02:10:24.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.840+0000 7f3f3bfff700 1 -- 172.21.15.78:0/2392717420 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3f2c028020 con 0x7f3f44062860 2024-04-25T02:10:24.847 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:10:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 >> v1:172.21.15.78:6816/46507 conn(0x7f3f2402bd00 legacy=0x7f3f2402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44062860 msgr2=0x7f3f44111ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44062860 0x7f3f44111ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f3f2c00f610 tx=0x7f3f2c017000).stop 2024-04-25T02:10:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 shutdown_connections 2024-04-25T02:10:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f44112580 0x7f3f4413ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f44062860 0x7f3f44111ba0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 --2- 172.21.15.78:0/2392717420 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f44093c20 0x7f3f44112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 >> 172.21.15.78:0/2392717420 conn(0x7f3f4409a970 msgr2=0x7f3f44128db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 shutdown_connections 2024-04-25T02:10:24.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.842+0000 7f3f49b06700 1 -- 172.21.15.78:0/2392717420 wait complete. 2024-04-25T02:10:24.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:10:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.970+0000 7fe3c5807700 1 Processor -- start 2024-04-25T02:10:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.970+0000 7fe3c5807700 1 -- start start 2024-04-25T02:10:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3c5807700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c0095b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3c5807700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3c0130380 0x7fe3c0132770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3c5807700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c005ed80 con 0x7fe3c0096000 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3c5807700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c0092ed0 con 0x7fe3c0130380 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3c5807700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00931b0 con 0x7fe3c0092af0 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3beffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c0095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3bf7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3c0130380 0x7fe3c0132770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3beffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c0095b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:60700/0 (socket says 172.21.15.78:60700) 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3be7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe3c0096000 0x7fe3c0096400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51740/0 (socket says 172.21.15.78:51740) 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3bf7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3c0130380 0x7fe3c0132770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58000/0 (socket says 172.21.15.78:58000) 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3beffd700 1 -- 172.21.15.78:0/1211749783 learned_addr learned my addr 172.21.15.78:0/1211749783 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3bf7fe700 1 -- 172.21.15.78:0/1211749783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 msgr2=0x7fe3c0095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3bf7fe700 1 --2- 172.21.15.78:0/1211749783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c0095b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3bf7fe700 1 -- 172.21.15.78:0/1211749783 >> v1:172.21.15.78:6789/0 conn(0x7fe3c0096000 legacy=0x7fe3c0096400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3bdffb700 1 -- 172.21.15.78:0/1211749783 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990196970 0 0) 0x7fe3c005ed80 con 0x7fe3c0096000 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3bf7fe700 1 -- 172.21.15.78:0/1211749783 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c0092640 con 0x7fe3c0130380 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3beffd700 1 --2- 172.21.15.78:0/1211749783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c0095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.971+0000 7fe3bf7fe700 1 --2- 172.21.15.78:0/1211749783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 0x7fe3c0132770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe3b8009e90 tx=0x7fe3b8009780).ready entity=mon.0 client_cookie=d6ca26b1083f2ef9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3bdffb700 1 -- 172.21.15.78:0/1211749783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800e070 con 0x7fe3c0130380 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3bdffb700 1 -- 172.21.15.78:0/1211749783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b800bb20 con 0x7fe3c0130380 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3bdffb700 1 -- 172.21.15.78:0/1211749783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800bea0 con 0x7fe3c0130380 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3c5807700 1 -- 172.21.15.78:0/1211749783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 msgr2=0x7fe3c0132770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3c5807700 1 --2- 172.21.15.78:0/1211749783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 0x7fe3c0132770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe3b8009e90 tx=0x7fe3b8009780).stop 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3c5807700 1 -- 172.21.15.78:0/1211749783 shutdown_connections 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3c5807700 1 --2- 172.21.15.78:0/1211749783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 0x7fe3c0132770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3c5807700 1 --2- 172.21.15.78:0/1211749783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c0095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3c5807700 1 -- 172.21.15.78:0/1211749783 >> 172.21.15.78:0/1211749783 conn(0x7fe3c009abf0 msgr2=0x7fe3c0096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3c5807700 1 -- 172.21.15.78:0/1211749783 shutdown_connections 2024-04-25T02:10:24.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.972+0000 7fe3c5807700 1 -- 172.21.15.78:0/1211749783 wait complete. 2024-04-25T02:10:24.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.973+0000 7fe3c5807700 1 Processor -- start 2024-04-25T02:10:24.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.973+0000 7fe3c5807700 1 -- start start 2024-04-25T02:10:24.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3c5807700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c008ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3c5807700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe3c0096000 0x7fe3c012f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3c5807700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 0x7fe3c012f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3c5807700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c008ea70 con 0x7fe3c0130380 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3c5807700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c008c3c0 con 0x7fe3c0092af0 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3c5807700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c008ef70 con 0x7fe3c0096000 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3be7fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe3c0096000 0x7fe3c012f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3bf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 0x7fe3c012f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3be7fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe3c0096000 0x7fe3c012f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:35598/0 (socket says 172.21.15.78:35598) 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3be7fc700 1 -- 172.21.15.78:0/1963314042 learned_addr learned my addr 172.21.15.78:0/1963314042 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3beffd700 1 --2- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c008ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3bf7fe700 1 -- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe3c0096000 msgr2=0x7fe3c012f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3bf7fe700 1 --2- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe3c0096000 0x7fe3c012f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3bf7fe700 1 -- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 msgr2=0x7fe3c008ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3bf7fe700 1 --2- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c008ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3bf7fe700 1 -- 172.21.15.78:0/1963314042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4009370 con 0x7fe3c0130380 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3be7fc700 1 --2- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe3c0096000 0x7fe3c012f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3bf7fe700 1 --2- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 0x7fe3c012f880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fe3b8014000 tx=0x7fe3c00929f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3a77fe700 1 -- 172.21.15.78:0/1963314042 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b801d630 con 0x7fe3c0130380 2024-04-25T02:10:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3a77fe700 1 -- 172.21.15.78:0/1963314042 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b801d790 con 0x7fe3c0130380 2024-04-25T02:10:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b8009a20 con 0x7fe3c0130380 2024-04-25T02:10:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3a77fe700 1 -- 172.21.15.78:0/1963314042 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b801db50 con 0x7fe3c0130380 2024-04-25T02:10:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.974+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c006abc0 con 0x7fe3c0130380 2024-04-25T02:10:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.975+0000 7fe3a77fe700 1 -- 172.21.15.78:0/1963314042 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fe3b8003040 con 0x7fe3c0130380 2024-04-25T02:10:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.975+0000 7fe3a77fe700 1 -- 172.21.15.78:0/1963314042 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe3b803cfc0 con 0x7fe3c0130380 2024-04-25T02:10:24.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.975+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c008e6f0 con 0x7fe3c0130380 2024-04-25T02:10:24.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:24.980+0000 7fe3a77fe700 1 -- 172.21.15.78:0/1963314042 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fe3c008e6f0 con 0x7fe3c0130380 2024-04-25T02:10:25.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.136+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3c008e6f0 con 0x7fe3c0130380 2024-04-25T02:10:25.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.136+0000 7fe3a77fe700 1 -- 172.21.15.78:0/1963314042 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3c008e6f0 con 0x7fe3c0130380 2024-04-25T02:10:25.143 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:10:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 >> v1:172.21.15.78:6816/46507 conn(0x7fe3ac02bd00 legacy=0x7fe3ac02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 msgr2=0x7fe3c012f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 --2- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 0x7fe3c012f880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fe3b8014000 tx=0x7fe3c00929f0).stop 2024-04-25T02:10:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 shutdown_connections 2024-04-25T02:10:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 --2- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3c0130380 0x7fe3c012f880 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 --2- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3c0092af0 0x7fe3c008ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 --2- 172.21.15.78:0/1963314042 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe3c0096000 0x7fe3c012f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 >> 172.21.15.78:0/1963314042 conn(0x7fe3c009abf0 msgr2=0x7fe3c0068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:25.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 shutdown_connections 2024-04-25T02:10:25.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.138+0000 7fe3c5807700 1 -- 172.21.15.78:0/1963314042 wait complete. 2024-04-25T02:10:25.156 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:10:25.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.267+0000 7f3f35397700 1 Processor -- start 2024-04-25T02:10:25.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.267+0000 7f3f35397700 1 -- start start 2024-04-25T02:10:25.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f35397700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f35397700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3f301300c0 0x7f3f301324b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f35397700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f300652a0 con 0x7f3f30065d60 2024-04-25T02:10:25.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f35397700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f30066140 con 0x7f3f301300c0 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f35397700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30128280 con 0x7f3f300972f0 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2e7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3f301300c0 0x7f3f301324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2e7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:60706/0 (socket says 172.21.15.78:60706) 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2e7fc700 1 -- 172.21.15.78:0/863987706 learned_addr learned my addr 172.21.15.78:0/863987706 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2effd700 1 --1- 172.21.15.78:0/863987706 >> v1:172.21.15.78:6789/0 conn(0x7f3f30065d60 0x7f3f30127b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51750/0 (socket says 172.21.15.78:51750) 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2f7fe700 1 -- 172.21.15.78:0/863987706 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 msgr2=0x7f3f3012fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2f7fe700 1 --2- 172.21.15.78:0/863987706 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2f7fe700 1 -- 172.21.15.78:0/863987706 >> v1:172.21.15.78:6789/0 conn(0x7f3f30065d60 legacy=0x7f3f30127b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2f7fe700 1 -- 172.21.15.78:0/863987706 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300649e0 con 0x7f3f301300c0 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2dffb700 1 -- 172.21.15.78:0/863987706 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628909032 0 0) 0x7f3f300652a0 con 0x7f3f30065d60 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2e7fc700 1 --2- 172.21.15.78:0/863987706 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2f7fe700 1 --2- 172.21.15.78:0/863987706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 0x7f3f301324b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f3f28009e60 tx=0x7f3f28009780).ready entity=mon.0 client_cookie=22650ac1a5b6c703 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2dffb700 1 -- 172.21.15.78:0/863987706 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800e070 con 0x7f3f301300c0 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.268+0000 7f3f2dffb700 1 -- 172.21.15.78:0/863987706 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2800bb60 con 0x7f3f301300c0 2024-04-25T02:10:25.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.269+0000 7f3f2dffb700 1 -- 172.21.15.78:0/863987706 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28012410 con 0x7f3f301300c0 2024-04-25T02:10:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.269+0000 7f3f35397700 1 -- 172.21.15.78:0/863987706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 msgr2=0x7f3f301324b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.269+0000 7f3f35397700 1 --2- 172.21.15.78:0/863987706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 0x7f3f301324b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f3f28009e60 tx=0x7f3f28009780).stop 2024-04-25T02:10:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.269+0000 7f3f35397700 1 -- 172.21.15.78:0/863987706 shutdown_connections 2024-04-25T02:10:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.269+0000 7f3f35397700 1 --2- 172.21.15.78:0/863987706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 0x7f3f301324b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.269+0000 7f3f35397700 1 --2- 172.21.15.78:0/863987706 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.269+0000 7f3f35397700 1 -- 172.21.15.78:0/863987706 >> 172.21.15.78:0/863987706 conn(0x7f3f3009ba80 msgr2=0x7f3f3009be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.269+0000 7f3f35397700 1 -- 172.21.15.78:0/863987706 shutdown_connections 2024-04-25T02:10:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.269+0000 7f3f35397700 1 -- 172.21.15.78:0/863987706 wait complete. 2024-04-25T02:10:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.270+0000 7f3f35397700 1 Processor -- start 2024-04-25T02:10:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.270+0000 7f3f35397700 1 -- start start 2024-04-25T02:10:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.270+0000 7f3f35397700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f30065d60 0x7f3f30112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f35397700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f35397700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 0x7f3f3012d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f35397700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3012e0e0 con 0x7f3f301300c0 2024-04-25T02:10:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f35397700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30064c10 con 0x7f3f300972f0 2024-04-25T02:10:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f35397700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3012e870 con 0x7f3f30065d60 2024-04-25T02:10:25.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2effd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f30065d60 0x7f3f30112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 0x7f3f3012d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 0x7f3f3012d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58032/0 (socket says 172.21.15.78:58032) 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2f7fe700 1 -- 172.21.15.78:0/829364912 learned_addr learned my addr 172.21.15.78:0/829364912 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2e7fc700 1 --2- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2effd700 1 -- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 msgr2=0x7f3f3012cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2effd700 1 --2- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2effd700 1 -- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 msgr2=0x7f3f3012d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2effd700 1 --2- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 0x7f3f3012d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2effd700 1 -- 172.21.15.78:0/829364912 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20009370 con 0x7f3f30065d60 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2f7fe700 1 --2- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 0x7f3f3012d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f2effd700 1 --2- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f30065d60 0x7f3f30112f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3f2400c460 tx=0x7f3f24007d50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f177fe700 1 -- 172.21.15.78:0/829364912 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240070d0 con 0x7f3f30065d60 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f177fe700 1 -- 172.21.15.78:0/829364912 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24007250 con 0x7f3f30065d60 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f28009a20 con 0x7f3f30065d60 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f177fe700 1 -- 172.21.15.78:0/829364912 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240056e0 con 0x7f3f30065d60 2024-04-25T02:10:25.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.271+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f301250a0 con 0x7f3f30065d60 2024-04-25T02:10:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.272+0000 7f3f177fe700 1 -- 172.21.15.78:0/829364912 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f3f24005a90 con 0x7f3f30065d60 2024-04-25T02:10:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.272+0000 7f3f177fe700 1 -- 172.21.15.78:0/829364912 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3f2403a7c0 con 0x7f3f30065d60 2024-04-25T02:10:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.272+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f301126b0 con 0x7f3f30065d60 2024-04-25T02:10:25.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.277+0000 7f3f177fe700 1 -- 172.21.15.78:0/829364912 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f3f301126b0 con 0x7f3f30065d60 2024-04-25T02:10:25.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.435+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f301126b0 con 0x7f3f30065d60 2024-04-25T02:10:25.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.435+0000 7f3f177fe700 1 -- 172.21.15.78:0/829364912 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f24018020 con 0x7f3f30065d60 2024-04-25T02:10:25.442 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 >> v1:172.21.15.78:6816/46507 conn(0x7f3f1c02bd00 legacy=0x7f3f1c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f30065d60 msgr2=0x7f3f30112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 --2- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f30065d60 0x7f3f30112f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3f2400c460 tx=0x7f3f24007d50).stop 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 shutdown_connections 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 --2- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f301300c0 0x7f3f3012d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 --2- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3f30065d60 0x7f3f30112f30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 --2- 172.21.15.78:0/829364912 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f300972f0 0x7f3f3012cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 >> 172.21.15.78:0/829364912 conn(0x7f3f3009ba80 msgr2=0x7f3f30069550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 shutdown_connections 2024-04-25T02:10:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.437+0000 7f3f35397700 1 -- 172.21.15.78:0/829364912 wait complete. 2024-04-25T02:10:25.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:10:25.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.564+0000 7f69da6fb700 1 Processor -- start 2024-04-25T02:10:25.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.564+0000 7f69da6fb700 1 -- start start 2024-04-25T02:10:25.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69da6fb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4095570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69da6fb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69d412d720 0x7f69d412fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69da6fb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d4094c70 con 0x7f69d4095a60 2024-04-25T02:10:25.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69da6fb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d4096570 con 0x7f69d412d720 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69da6fb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d40923f0 con 0x7f69d4095190 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d3fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4095570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d8c98700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69d412d720 0x7f69d412fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d37fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f69d4095a60 0x7f69d412c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51758/0 (socket says 172.21.15.78:51758) 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d8c98700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69d412d720 0x7f69d412fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58036/0 (socket says 172.21.15.78:58036) 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d37fe700 1 -- 172.21.15.78:0/2880411165 learned_addr learned my addr 172.21.15.78:0/2880411165 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d3fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4095570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:60712/0 (socket says 172.21.15.78:60712) 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d8c98700 1 -- 172.21.15.78:0/2880411165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 msgr2=0x7f69d4095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d8c98700 1 --2- 172.21.15.78:0/2880411165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4095570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d8c98700 1 -- 172.21.15.78:0/2880411165 >> v1:172.21.15.78:6789/0 conn(0x7f69d4095a60 legacy=0x7f69d412c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d8c98700 1 -- 172.21.15.78:0/2880411165 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d4096da0 con 0x7f69d412d720 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d2ffd700 1 -- 172.21.15.78:0/2880411165 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481596574 0 0) 0x7f69d4094c70 con 0x7f69d4095a60 2024-04-25T02:10:25.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d3fff700 1 --2- 172.21.15.78:0/2880411165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.565+0000 7f69d8c98700 1 --2- 172.21.15.78:0/2880411165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d412d720 0x7f69d412fb10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f69cc009e60 tx=0x7f69cc009780).ready entity=mon.0 client_cookie=c4c079c6ddf7212f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69d2ffd700 1 -- 172.21.15.78:0/2880411165 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc00e070 con 0x7f69d412d720 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69d2ffd700 1 -- 172.21.15.78:0/2880411165 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc00bb60 con 0x7f69d412d720 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69d2ffd700 1 -- 172.21.15.78:0/2880411165 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc012410 con 0x7f69d412d720 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69da6fb700 1 -- 172.21.15.78:0/2880411165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d412d720 msgr2=0x7f69d412fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69da6fb700 1 --2- 172.21.15.78:0/2880411165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d412d720 0x7f69d412fb10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f69cc009e60 tx=0x7f69cc009780).stop 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69da6fb700 1 -- 172.21.15.78:0/2880411165 shutdown_connections 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69da6fb700 1 --2- 172.21.15.78:0/2880411165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d412d720 0x7f69d412fb10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69da6fb700 1 --2- 172.21.15.78:0/2880411165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69da6fb700 1 -- 172.21.15.78:0/2880411165 >> 172.21.15.78:0/2880411165 conn(0x7f69d409a970 msgr2=0x7f69d409ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69da6fb700 1 -- 172.21.15.78:0/2880411165 shutdown_connections 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.566+0000 7f69da6fb700 1 -- 172.21.15.78:0/2880411165 wait complete. 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.567+0000 7f69da6fb700 1 Processor -- start 2024-04-25T02:10:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.567+0000 7f69da6fb700 1 -- start start 2024-04-25T02:10:25.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69da6fb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69da6fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d4095a60 0x7f69d4116600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69da6fb700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f69d412d720 0x7f69d4116af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69da6fb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d4118fe0 con 0x7f69d4095a60 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69da6fb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d4064b50 con 0x7f69d4095190 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69da6fb700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69d4092540 con 0x7f69d412d720 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d3fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d3fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4116110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:60720/0 (socket says 172.21.15.78:60720) 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d3fff700 1 -- 172.21.15.78:0/2399125895 learned_addr learned my addr 172.21.15.78:0/2399125895 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d37fe700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d4095a60 0x7f69d4116600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d8c98700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f69d412d720 0x7f69d4116af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d37fe700 1 -- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f69d412d720 msgr2=0x7f69d4116af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d37fe700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f69d412d720 0x7f69d4116af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d37fe700 1 -- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 msgr2=0x7f69d4116110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d37fe700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4116110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d37fe700 1 -- 172.21.15.78:0/2399125895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c40092a0 con 0x7f69d4095a60 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d3fff700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d8c98700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f69d412d720 0x7f69d4116af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d37fe700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d4095a60 0x7f69d4116600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f69bc000c00 tx=0x7f69bc007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d0ff9700 1 -- 172.21.15.78:0/2399125895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0070d0 con 0x7f69d4095a60 2024-04-25T02:10:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d0ff9700 1 -- 172.21.15.78:0/2399125895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc007250 con 0x7f69d4095a60 2024-04-25T02:10:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69d0ff9700 1 -- 172.21.15.78:0/2399125895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc007610 con 0x7f69d4095a60 2024-04-25T02:10:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc009a20 con 0x7f69d4095a60 2024-04-25T02:10:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.568+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d4119e00 con 0x7f69d4095a60 2024-04-25T02:10:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.569+0000 7f69d0ff9700 1 -- 172.21.15.78:0/2399125895 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f69bc0059b0 con 0x7f69d4095a60 2024-04-25T02:10:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.569+0000 7f69d0ff9700 1 -- 172.21.15.78:0/2399125895 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f69bc03a600 con 0x7f69d4095a60 2024-04-25T02:10:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.569+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d4116fe0 con 0x7f69d4095a60 2024-04-25T02:10:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.574+0000 7f69d0ff9700 1 -- 172.21.15.78:0/2399125895 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f69bc013970 con 0x7f69d4095a60 2024-04-25T02:10:25.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.732+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69d4119e00 con 0x7f69d4095a60 2024-04-25T02:10:25.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.732+0000 7f69d0ff9700 1 -- 172.21.15.78:0/2399125895 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69d4119e00 con 0x7f69d4095a60 2024-04-25T02:10:25.739 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-25T02:10:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 >> v1:172.21.15.78:6816/46507 conn(0x7f69b402bd00 legacy=0x7f69b402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d4095a60 msgr2=0x7f69d4116600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d4095a60 0x7f69d4116600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f69bc000c00 tx=0x7f69bc007b90).stop 2024-04-25T02:10:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 shutdown_connections 2024-04-25T02:10:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f69d412d720 0x7f69d4116af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d4095190 0x7f69d4116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 --2- 172.21.15.78:0/2399125895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d4095a60 0x7f69d4116600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 >> 172.21.15.78:0/2399125895 conn(0x7f69d409a970 msgr2=0x7f69d4068840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 shutdown_connections 2024-04-25T02:10:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.734+0000 7f69da6fb700 1 -- 172.21.15.78:0/2399125895 wait complete. 2024-04-25T02:10:25.753 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:10:25.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.861+0000 7f809357d700 1 Processor -- start 2024-04-25T02:10:25.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.861+0000 7f809357d700 1 -- start start 2024-04-25T02:10:25.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f809357d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c0961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f809357d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f808c0937a0 0x7f808c1243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f809357d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f809357d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c096cf0 con 0x7f808c0937a0 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f809357d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c093ba0 con 0x7f808c124000 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f809357d700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f808c092d00 con 0x7f808c1274e0 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091b1a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091319700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c0961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8090b18700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f808c0937a0 0x7f808c1243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091b1a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c127990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:35624/0 (socket says 172.21.15.78:35624) 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091319700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c0961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:60724/0 (socket says 172.21.15.78:60724) 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091b1a700 1 -- 172.21.15.78:0/3379212149 learned_addr learned my addr 172.21.15.78:0/3379212149 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091b1a700 1 -- 172.21.15.78:0/3379212149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 msgr2=0x7f808c0961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:25.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091b1a700 1 --2- 172.21.15.78:0/3379212149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c0961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091b1a700 1 -- 172.21.15.78:0/3379212149 >> v2:172.21.15.78:3300/0 conn(0x7f808c0937a0 msgr2=0x7f808c1243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091b1a700 1 --2- 172.21.15.78:0/3379212149 >> v2:172.21.15.78:3300/0 conn(0x7f808c0937a0 0x7f808c1243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091b1a700 1 -- 172.21.15.78:0/3379212149 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0933a0 con 0x7f808c1274e0 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091319700 1 --2- 172.21.15.78:0/3379212149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c0961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8090b18700 1 --2- 172.21.15.78:0/3379212149 >> v2:172.21.15.78:3300/0 conn(0x7f808c0937a0 0x7f808c1243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.862+0000 7f8091b1a700 1 --2- 172.21.15.78:0/3379212149 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c127990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8084009f50 tx=0x7f8084009840).ready entity=mon.2 client_cookie=d1e5f7c2da45cf29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f8083fff700 1 -- 172.21.15.78:0/3379212149 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808400e070 con 0x7f808c1274e0 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f8083fff700 1 -- 172.21.15.78:0/3379212149 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808400b910 con 0x7f808c1274e0 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f8083fff700 1 -- 172.21.15.78:0/3379212149 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808400bc90 con 0x7f808c1274e0 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f809357d700 1 -- 172.21.15.78:0/3379212149 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 msgr2=0x7f808c127990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f809357d700 1 --2- 172.21.15.78:0/3379212149 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c127990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8084009f50 tx=0x7f8084009840).stop 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f809357d700 1 -- 172.21.15.78:0/3379212149 shutdown_connections 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f809357d700 1 --2- 172.21.15.78:0/3379212149 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c0961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f809357d700 1 --2- 172.21.15.78:0/3379212149 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c127990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f809357d700 1 --2- 172.21.15.78:0/3379212149 >> v2:172.21.15.78:3300/0 conn(0x7f808c0937a0 0x7f808c1243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f809357d700 1 -- 172.21.15.78:0/3379212149 >> 172.21.15.78:0/3379212149 conn(0x7f808c097450 msgr2=0x7f808c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:25.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f809357d700 1 -- 172.21.15.78:0/3379212149 shutdown_connections 2024-04-25T02:10:25.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.863+0000 7f809357d700 1 -- 172.21.15.78:0/3379212149 wait complete. 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.864+0000 7f809357d700 1 Processor -- start 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.864+0000 7f809357d700 1 -- start start 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f809357d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f808c0937a0 0x7f808c136d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f809357d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c137270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f809357d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c0684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f809357d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c069960 con 0x7f808c0937a0 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f809357d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c095ca0 con 0x7f808c124000 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f809357d700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f808c092440 con 0x7f808c1274e0 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8091319700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f808c0937a0 0x7f808c136d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8090b18700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c137270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8091319700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f808c0937a0 0x7f808c136d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58054/0 (socket says 172.21.15.78:58054) 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8090b18700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c137270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:60728/0 (socket says 172.21.15.78:60728) 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8091319700 1 -- 172.21.15.78:0/3711053084 learned_addr learned my addr 172.21.15.78:0/3711053084 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8091b1a700 1 --2- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c0684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8091319700 1 -- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 msgr2=0x7f808c0684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8091319700 1 --2- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c0684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8091319700 1 -- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 msgr2=0x7f808c137270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8091319700 1 --2- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c137270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.865+0000 7f8091319700 1 -- 172.21.15.78:0/3711053084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80880092a0 con 0x7f808c0937a0 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.866+0000 7f8091319700 1 --2- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f808c0937a0 0x7f808c136d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f807c00ea20 tx=0x7f807c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.866+0000 7f8081ffb700 1 -- 172.21.15.78:0/3711053084 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c00ee60 con 0x7f808c0937a0 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.866+0000 7f8081ffb700 1 -- 172.21.15.78:0/3711053084 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c00d860 con 0x7f808c0937a0 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.866+0000 7f8081ffb700 1 -- 172.21.15.78:0/3711053084 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c00dbe0 con 0x7f808c0937a0 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.866+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c0092a0 con 0x7f808c0937a0 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.866+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8084009ae0 con 0x7f808c0937a0 2024-04-25T02:10:25.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.867+0000 7f8081ffb700 1 -- 172.21.15.78:0/3711053084 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f807c010440 con 0x7f808c0937a0 2024-04-25T02:10:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.867+0000 7f8081ffb700 1 -- 172.21.15.78:0/3711053084 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f807c03b4e0 con 0x7f808c0937a0 2024-04-25T02:10:25.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.867+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c097f70 con 0x7f808c0937a0 2024-04-25T02:10:25.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:25.872+0000 7f8081ffb700 1 -- 172.21.15.78:0/3711053084 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f807c0168f0 con 0x7f808c0937a0 2024-04-25T02:10:26.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.042+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f808c046ce0 con 0x7f808c0937a0 2024-04-25T02:10:26.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.042+0000 7f8081ffb700 1 -- 172.21.15.78:0/3711053084 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v17) v1 ==== 80+0+0 (secure 0 0 0) 0x7f807c016300 con 0x7f808c0937a0 2024-04-25T02:10:26.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 >> v1:172.21.15.78:6816/46507 conn(0x7f807002bd00 legacy=0x7f807002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f808c0937a0 msgr2=0x7f808c136d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 --2- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f808c0937a0 0x7f808c136d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f807c00ea20 tx=0x7f807c009060).stop 2024-04-25T02:10:26.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 shutdown_connections 2024-04-25T02:10:26.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 --2- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f808c1274e0 0x7f808c0684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:26.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 --2- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f808c0937a0 0x7f808c136d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:26.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 --2- 172.21.15.78:0/3711053084 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f808c124000 0x7f808c137270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:10:26.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 >> 172.21.15.78:0/3711053084 conn(0x7f808c097450 msgr2=0x7f808c126400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:26.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 shutdown_connections 2024-04-25T02:10:26.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:10:26.044+0000 7f809357d700 1 -- 172.21.15.78:0/3711053084 wait complete. 2024-04-25T02:10:26.052 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-04-25T02:10:26.062 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi195.front.sepia.ceph.com... 2024-04-25T02:10:26.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:26.063 DEBUG:teuthology.orchestra.run.smithi195:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T02:10:26.105 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi195.stderr:ceph-fuse[40648]: fuse finished with error 0 and tester_r 0 2024-04-25T02:10:26.107 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:10:32.208 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T02:10:32.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:32.208 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:10:32.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:32.249 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T02:10:32.310 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:10:32.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:32.310 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:10:32.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:32.392 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T02:10:32.490 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T02:10:32.490 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:10:32.499 INFO:teuthology.task.print:**** done unmount client.0 2024-04-25T02:10:32.499 INFO:teuthology.run_tasks:Running task install.upgrade... 2024-04-25T02:10:32.506 INFO:teuthology.task.install:project ceph config {'client.0': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T02:10:32.507 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2024-04-25T02:10:32.507 INFO:teuthology.task.install:remote ubuntu@smithi195.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2024-04-25T02:10:32.507 INFO:teuthology.task.install:extra packages: [] 2024-04-25T02:10:32.512 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T02:10:32.512 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2024-04-25T02:10:32.512 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:10:32.535 INFO:teuthology.orchestra.run.smithi195.stdout:16.2.15-0.el8 2024-04-25T02:10:32.535 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.15-0.el8 2024-04-25T02:10:32.536 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-25T02:10:32.774 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.15-0.el8 to 18.2.3-0 2024-04-25T02:10:32.775 INFO:teuthology.task.install.rpm:Host smithi195 is: centos 8 x86_64 2024-04-25T02:10:32.775 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-25T02:10:33.097 INFO:teuthology.task.install.rpm:Repo base URL: https://chacra.ceph.com/r/ceph/reef/76424b2fe1bb19c32c52140f39764599abf5e035/centos/8/flavors/default/ 2024-04-25T02:10:33.097 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-04-25T02:10:33.162 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/76424b2fe1bb19c32c52140f39764599abf5e035/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/76424b2fe1bb19c32c52140f39764599abf5e035/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/76424b2fe1bb19c32c52140f39764599abf5e035/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:10:33.162 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:10:33.162 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:10:33.203 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:10:33.273 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:10:33.342 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:10:33.400 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-04-25T02:10:33.412 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-04-25T02:10:33.673 INFO:teuthology.orchestra.run.smithi195.stdout:71 files removed 2024-04-25T02:10:33.703 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2024-04-25T02:10:34.203 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 937 kB/s | 80 kB 00:00 2024-04-25T02:10:34.329 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 129 kB/s | 11 kB 00:00 2024-04-25T02:10:34.454 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 18 kB/s | 1.8 kB 00:00 2024-04-25T02:10:35.147 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - AppStream 42 MB/s | 28 MB 00:00 2024-04-25T02:10:40.789 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-25T02:10:42.939 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2024-04-25T02:10:43.390 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 7.7 kB 00:00 2024-04-25T02:10:44.183 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 8 - PowerTools 7.0 MB/s | 5.0 MB 00:00 2024-04-25T02:10:45.293 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2024-04-25T02:10:47.327 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2024-04-25T02:10:51.161 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 359 kB/s | 24 kB 00:00 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi195.stderr:Package cephadm available, but not installed. 2024-04-25T02:10:54.836 INFO:teuthology.orchestra.run.smithi195.stdout:No match for argument: cephadm 2024-04-25T02:10:54.836 INFO:teuthology.orchestra.run.smithi195.stderr:Package ceph-immutable-object-cache available, but not installed. 2024-04-25T02:10:54.836 INFO:teuthology.orchestra.run.smithi195.stdout:No match for argument: ceph-immutable-object-cache 2024-04-25T02:10:54.847 INFO:teuthology.orchestra.run.smithi195.stderr:Package ceph-mgr-cephadm available, but not installed. 2024-04-25T02:10:54.847 INFO:teuthology.orchestra.run.smithi195.stdout:No match for argument: ceph-mgr-cephadm 2024-04-25T02:10:54.850 INFO:teuthology.orchestra.run.smithi195.stderr:Package ceph-volume available, but not installed. 2024-04-25T02:10:54.850 INFO:teuthology.orchestra.run.smithi195.stdout:No match for argument: ceph-volume 2024-04-25T02:10:54.955 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T02:10:54.960 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T02:10:54.960 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-25T02:10:54.960 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T02:10:54.960 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-04-25T02:10:54.960 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:18.2.3-0.el8 ceph 6.3 k 2024-04-25T02:10:54.960 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:18.2.3-0.el8 ceph 5.5 M 2024-04-25T02:10:54.960 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:18.2.3-0.el8 ceph 22 M 2024-04-25T02:10:54.960 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:18.2.3-0.el8 ceph 859 k 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:18.2.3-0.el8 ceph-noarch 24 k 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:18.2.3-0.el8 ceph 2.3 M 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:18.2.3-0.el8 ceph 1.6 M 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:18.2.3-0.el8 ceph-noarch 3.5 M 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.3-0.el8 ceph-noarch 7.4 M 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:18.2.3-0.el8 ceph-noarch 245 k 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:18.2.3-0.el8 ceph-noarch 49 k 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:18.2.3-0.el8 ceph 4.8 M 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:18.2.3-0.el8 ceph 18 M 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:18.2.3-0.el8 ceph-noarch 15 k 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:18.2.3-0.el8 ceph 13 M 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:18.2.3-0.el8 ceph 24 k 2024-04-25T02:10:54.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:18.2.3-0.el8 ceph 47 M 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:18.2.3-0.el8 ceph 31 k 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:18.2.3-0.el8 ceph 781 k 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:18.2.3-0.el8 ceph 142 k 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:18.2.3-0.el8 ceph 139 k 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:18.2.3-0.el8 ceph 3.7 M 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:18.2.3-0.el8 ceph 474 k 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:18.2.3-0.el8 ceph 3.6 M 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:18.2.3-0.el8 ceph 6.6 M 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:18.2.3-0.el8 ceph 45 k 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:18.2.3-0.el8 ceph 129 k 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:18.2.3-0.el8 ceph 197 k 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:18.2.3-0.el8 ceph 370 k 2024-04-25T02:10:54.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:18.2.3-0.el8 ceph 364 k 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:18.2.3-0.el8 ceph 106 k 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:18.2.3-0.el8 ceph 95 k 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:18.2.3-0.el8 ceph 3.5 M 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:18.2.3-0.el8 ceph 181 k 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 34 Packages 2024-04-25T02:10:54.963 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:10:54.964 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 149 M 2024-04-25T02:10:54.964 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-25T02:10:55.178 INFO:teuthology.orchestra.run.smithi195.stdout:(1/35): ceph-18.2.3-0.el8.x86_64.rpm 87 kB/s | 6.3 kB 00:00 2024-04-25T02:10:55.279 INFO:teuthology.orchestra.run.smithi195.stdout:(2/35): ceph-base-18.2.3-0.el8.x86_64.rpm 32 MB/s | 5.5 MB 00:00 2024-04-25T02:10:55.312 INFO:teuthology.orchestra.run.smithi195.stdout:(3/35): ceph-fuse-18.2.3-0.el8.x86_64.rpm 25 MB/s | 859 kB 00:00 2024-04-25T02:10:55.371 INFO:teuthology.orchestra.run.smithi195.stdout:(4/35): ceph-mds-18.2.3-0.el8.x86_64.rpm 39 MB/s | 2.3 MB 00:00 2024-04-25T02:10:55.421 INFO:teuthology.orchestra.run.smithi195.stdout:(5/35): ceph-mgr-18.2.3-0.el8.x86_64.rpm 31 MB/s | 1.6 MB 00:00 2024-04-25T02:10:55.532 INFO:teuthology.orchestra.run.smithi195.stdout:(6/35): ceph-mon-18.2.3-0.el8.x86_64.rpm 44 MB/s | 4.8 MB 00:00 2024-04-25T02:10:55.574 INFO:teuthology.orchestra.run.smithi195.stdout:(7/35): thrift-0.13.0-2.el8.x86_64.rpm 3.7 MB/s | 1.7 MB 00:00 2024-04-25T02:10:55.883 INFO:teuthology.orchestra.run.smithi195.stdout:(8/35): ceph-common-18.2.3-0.el8.x86_64.rpm 31 MB/s | 22 MB 00:00 2024-04-25T02:10:55.908 INFO:teuthology.orchestra.run.smithi195.stdout:(9/35): ceph-selinux-18.2.3-0.el8.x86_64.rpm 983 kB/s | 24 kB 00:00 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi195.stdout:(10/35): ceph-radosgw-18.2.3-0.el8.x86_64.rpm 24 MB/s | 13 MB 00:00 2024-04-25T02:10:56.142 INFO:teuthology.orchestra.run.smithi195.stdout:(11/35): libcephfs-devel-18.2.3-0.el8.x86_64.rp 1.2 MB/s | 31 kB 00:00 2024-04-25T02:10:56.184 INFO:teuthology.orchestra.run.smithi195.stdout:(12/35): libcephfs2-18.2.3-0.el8.x86_64.rpm 18 MB/s | 781 kB 00:00 2024-04-25T02:10:56.209 INFO:teuthology.orchestra.run.smithi195.stdout:(13/35): libcephsqlite-18.2.3-0.el8.x86_64.rpm 5.6 MB/s | 142 kB 00:00 2024-04-25T02:10:56.234 INFO:teuthology.orchestra.run.smithi195.stdout:(14/35): librados-devel-18.2.3-0.el8.x86_64.rpm 5.5 MB/s | 139 kB 00:00 2024-04-25T02:10:56.451 INFO:teuthology.orchestra.run.smithi195.stdout:(15/35): ceph-osd-18.2.3-0.el8.x86_64.rpm 20 MB/s | 18 MB 00:00 2024-04-25T02:10:56.504 INFO:teuthology.orchestra.run.smithi195.stdout:(16/35): libradosstriper1-18.2.3-0.el8.x86_64.r 8.9 MB/s | 474 kB 00:00 2024-04-25T02:10:56.577 INFO:teuthology.orchestra.run.smithi195.stdout:(17/35): librados2-18.2.3-0.el8.x86_64.rpm 11 MB/s | 3.7 MB 00:00 2024-04-25T02:10:56.677 INFO:teuthology.orchestra.run.smithi195.stdout:(18/35): librbd1-18.2.3-0.el8.x86_64.rpm 21 MB/s | 3.6 MB 00:00 2024-04-25T02:10:56.702 INFO:teuthology.orchestra.run.smithi195.stdout:(19/35): python3-ceph-argparse-18.2.3-0.el8.x86 1.8 MB/s | 45 kB 00:00 2024-04-25T02:10:56.728 INFO:teuthology.orchestra.run.smithi195.stdout:(20/35): python3-ceph-common-18.2.3-0.el8.x86_6 5.0 MB/s | 129 kB 00:00 2024-04-25T02:10:56.753 INFO:teuthology.orchestra.run.smithi195.stdout:(21/35): python3-cephfs-18.2.3-0.el8.x86_64.rpm 7.8 MB/s | 197 kB 00:00 2024-04-25T02:10:56.786 INFO:teuthology.orchestra.run.smithi195.stdout:(22/35): python3-rados-18.2.3-0.el8.x86_64.rpm 11 MB/s | 370 kB 00:00 2024-04-25T02:10:56.820 INFO:teuthology.orchestra.run.smithi195.stdout:(23/35): python3-rbd-18.2.3-0.el8.x86_64.rpm 11 MB/s | 364 kB 00:00 2024-04-25T02:10:56.846 INFO:teuthology.orchestra.run.smithi195.stdout:(24/35): python3-rgw-18.2.3-0.el8.x86_64.rpm 4.2 MB/s | 106 kB 00:00 2024-04-25T02:10:56.871 INFO:teuthology.orchestra.run.smithi195.stdout:(25/35): rbd-fuse-18.2.3-0.el8.x86_64.rpm 3.7 MB/s | 95 kB 00:00 2024-04-25T02:10:56.988 INFO:teuthology.orchestra.run.smithi195.stdout:(26/35): librgw2-18.2.3-0.el8.x86_64.rpm 16 MB/s | 6.6 MB 00:00 2024-04-25T02:10:57.005 INFO:teuthology.orchestra.run.smithi195.stdout:(27/35): rbd-nbd-18.2.3-0.el8.x86_64.rpm 11 MB/s | 181 kB 00:00 2024-04-25T02:10:57.022 INFO:teuthology.orchestra.run.smithi195.stdout:(28/35): ceph-grafana-dashboards-18.2.3-0.el8.n 1.4 MB/s | 24 kB 00:00 2024-04-25T02:10:57.097 INFO:teuthology.orchestra.run.smithi195.stdout:(29/35): rbd-mirror-18.2.3-0.el8.x86_64.rpm 15 MB/s | 3.5 MB 00:00 2024-04-25T02:10:57.164 INFO:teuthology.orchestra.run.smithi195.stdout:(30/35): ceph-mgr-dashboard-18.2.3-0.el8.noarch 25 MB/s | 3.5 MB 00:00 2024-04-25T02:10:57.189 INFO:teuthology.orchestra.run.smithi195.stdout:(31/35): ceph-mgr-modules-core-18.2.3-0.el8.noa 9.7 MB/s | 245 kB 00:00 2024-04-25T02:10:57.214 INFO:teuthology.orchestra.run.smithi195.stdout:(32/35): ceph-mgr-rook-18.2.3-0.el8.noarch.rpm 1.9 MB/s | 49 kB 00:00 2024-04-25T02:10:57.248 INFO:teuthology.orchestra.run.smithi195.stdout:(33/35): ceph-prometheus-alerts-18.2.3-0.el8.no 438 kB/s | 15 kB 00:00 2024-04-25T02:10:57.366 INFO:teuthology.orchestra.run.smithi195.stdout:(34/35): ceph-mgr-diskprediction-local-18.2.3-0 28 MB/s | 7.4 MB 00:00 2024-04-25T02:10:57.874 INFO:teuthology.orchestra.run.smithi195.stdout:(35/35): ceph-test-18.2.3-0.el8.x86_64.rpm 24 MB/s | 47 MB 00:01 2024-04-25T02:10:57.877 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:10:57.877 INFO:teuthology.orchestra.run.smithi195.stdout:Total 51 MB/s | 149 MB 00:02 2024-04-25T02:10:57.878 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-25T02:10:57.948 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-25T02:10:57.948 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-25T02:10:58.623 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-25T02:10:58.626 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-25T02:11:00.963 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-25T02:11:01.135 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2024-04-25T02:11:01.666 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2024-04-25T02:11:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:18.2.3-0.el8.x86_64 2/69 2024-04-25T02:11:02.363 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:18.2.3-0.el8.x86_64 2/69 2024-04-25T02:11:02.561 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:18.2.3-0.el8.x86_64 3/69 2024-04-25T02:11:02.685 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:18.2.3-0.el8.x86_64 3/69 2024-04-25T02:11:02.902 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libcephfs2-2:18.2.3-0.el8.x86_64 4/69 2024-04-25T02:11:03.652 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:18.2.3-0.el8.x86_64 4/69 2024-04-25T02:11:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librgw2-2:18.2.3-0.el8.x86_64 5/69 2024-04-25T02:11:04.001 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:18.2.3-0.el8.x86_64 5/69 2024-04-25T02:11:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : python3-rados-2:18.2.3-0.el8.x86_64 6/69 2024-04-25T02:11:04.435 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libcephsqlite-2:18.2.3-0.el8.x86_64 7/69 2024-04-25T02:11:04.535 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:18.2.3-0.el8.x86_64 7/69 2024-04-25T02:11:04.743 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libradosstriper1-2:18.2.3-0.el8.x86_64 8/69 2024-04-25T02:11:04.817 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:18.2.3-0.el8.x86_64 8/69 2024-04-25T02:11:04.972 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : python3-ceph-argparse-2:18.2.3-0.el8.x86_64 9/69 2024-04-25T02:11:05.238 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : python3-cephfs-2:18.2.3-0.el8.x86_64 10/69 2024-04-25T02:11:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : python3-rbd-2:18.2.3-0.el8.x86_64 11/69 2024-04-25T02:11:05.709 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : python3-rgw-2:18.2.3-0.el8.x86_64 12/69 2024-04-25T02:11:05.904 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados-devel-2:18.2.3-0.el8.x86_64 13/69 2024-04-25T02:11:06.060 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.3-0.el8.noarch 14/69 2024-04-25T02:11:06.254 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.3-0.el8.noarch 15/69 2024-04-25T02:11:06.494 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : python3-ceph-common-2:18.2.3-0.el8.x86_64 16/69 2024-04-25T02:11:08.729 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.2.3-0.el8.x86_64 17/69 2024-04-25T02:11:09.027 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-common-2:18.2.3-0.el8.x86_64 17/69 2024-04-25T02:11:09.705 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.2.3-0.el8.x86_64 17/69 2024-04-25T02:11:10.016 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-base-2:18.2.3-0.el8.x86_64 18/69 2024-04-25T02:11:10.082 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:18.2.3-0.el8.x86_64 18/69 2024-04-25T02:11:10.234 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-selinux-2:18.2.3-0.el8.x86_64 19/69 2024-04-25T02:11:28.820 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:18.2.3-0.el8.x86_64 19/69 2024-04-25T02:11:29.096 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.3-0.el8.noarch 20/69 2024-04-25T02:11:30.295 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.3-0.el8.noarch 20/69 2024-04-25T02:11:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.3-0.el8.noarc 21/69 2024-04-25T02:11:30.589 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.3-0.el8.noarc 21/69 2024-04-25T02:11:31.011 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.3-0.el8.noarch 22/69 2024-04-25T02:11:31.280 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-mgr-2:18.2.3-0.el8.x86_64 23/69 2024-04-25T02:11:31.306 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:18.2.3-0.el8.x86_64 23/69 2024-04-25T02:11:31.506 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-mgr-rook-2:18.2.3-0.el8.noarch 24/69 2024-04-25T02:11:31.750 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.3-0.el8.noarch 24/69 2024-04-25T02:11:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-mds-2:18.2.3-0.el8.x86_64 25/69 2024-04-25T02:11:32.437 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:18.2.3-0.el8.x86_64 25/69 2024-04-25T02:11:32.698 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-mon-2:18.2.3-0.el8.x86_64 26/69 2024-04-25T02:11:34.654 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:18.2.3-0.el8.x86_64 26/69 2024-04-25T02:11:34.888 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-osd-2:18.2.3-0.el8.x86_64 27/69 2024-04-25T02:11:34.899 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:18.2.3-0.el8.x86_64 27/69 2024-04-25T02:11:36.439 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-2:18.2.3-0.el8.x86_64 28/69 2024-04-25T02:11:36.695 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-radosgw-2:18.2.3-0.el8.x86_64 29/69 2024-04-25T02:11:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:18.2.3-0.el8.x86_64 29/69 2024-04-25T02:11:37.355 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : rbd-mirror-2:18.2.3-0.el8.x86_64 30/69 2024-04-25T02:11:42.506 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:18.2.3-0.el8.x86_64 30/69 2024-04-25T02:11:42.917 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-test-2:18.2.3-0.el8.x86_64 31/69 2024-04-25T02:11:43.138 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libcephfs-devel-2:18.2.3-0.el8.x86_64 32/69 2024-04-25T02:11:43.354 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : rbd-fuse-2:18.2.3-0.el8.x86_64 33/69 2024-04-25T02:11:43.665 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : rbd-nbd-2:18.2.3-0.el8.x86_64 34/69 2024-04-25T02:11:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : ceph-fuse-2:18.2.3-0.el8.x86_64 35/69 2024-04-25T02:11:44.040 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-2:16.2.15-0.el8.x86_64 36/69 2024-04-25T02:11:44.280 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-test-2:16.2.15-0.el8.x86_64 37/69 2024-04-25T02:11:44.289 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64 38/69 2024-04-25T02:11:44.290 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-radosgw-2:16.2.15-0.el8.x86_64 38/69 2024-04-25T02:11:44.579 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64 38/69 2024-04-25T02:11:44.730 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libcephfs-devel-2:16.2.15-0.el8.x86_64 39/69 2024-04-25T02:11:44.730 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-mgr-rook-2:16.2.15-0.el8.noarch 40/69 2024-04-25T02:11:44.914 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.15-0.el8.noarch 40/69 2024-04-25T02:11:44.921 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64 41/69 2024-04-25T02:11:44.921 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-mgr-2:16.2.15-0.el8.x86_64 41/69 2024-04-25T02:11:45.141 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64 41/69 2024-04-25T02:11:45.361 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 42/69 2024-04-25T02:11:45.555 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : rbd-nbd-2:16.2.15-0.el8.x86_64 43/69 2024-04-25T02:11:45.562 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64 44/69 2024-04-25T02:11:45.562 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : rbd-mirror-2:16.2.15-0.el8.x86_64 44/69 2024-04-25T02:11:45.797 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64 44/69 2024-04-25T02:11:45.963 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : rbd-fuse-2:16.2.15-0.el8.x86_64 45/69 2024-04-25T02:11:45.963 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libcephsqlite-2:16.2.15-0.el8.x86_64 46/69 2024-04-25T02:11:46.197 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:16.2.15-0.el8.x86_64 46/69 2024-04-25T02:11:46.372 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados-devel-2:16.2.15-0.el8.x86_64 47/69 2024-04-25T02:11:46.379 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64 48/69 2024-04-25T02:11:46.380 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-osd-2:16.2.15-0.el8.x86_64 48/69 2024-04-25T02:11:46.748 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64 48/69 2024-04-25T02:11:46.748 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 49/69 2024-04-25T02:11:47.005 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 49/69 2024-04-25T02:11:47.011 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64 50/69 2024-04-25T02:11:47.011 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-mds-2:16.2.15-0.el8.x86_64 50/69 2024-04-25T02:11:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64 50/69 2024-04-25T02:11:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64 51/69 2024-04-25T02:11:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-mon-2:16.2.15-0.el8.x86_64 51/69 2024-04-25T02:11:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64 51/69 2024-04-25T02:11:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-selinux-2:16.2.15-0.el8.x86_64 52/69 2024-04-25T02:11:47.522 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:16.2.15-0.el8.x86_64 52/69 2024-04-25T02:11:47.543 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64 53/69 2024-04-25T02:11:47.543 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-base-2:16.2.15-0.el8.x86_64 53/69 2024-04-25T02:11:47.847 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64 53/69 2024-04-25T02:11:47.847 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-common-2:16.2.15-0.el8.x86_64 54/69 2024-04-25T02:11:48.096 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 54/69 2024-04-25T02:11:48.096 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libradosstriper1-2:16.2.15-0.el8.x86_64 55/69 2024-04-25T02:11:48.313 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:16.2.15-0.el8.x86_64 55/69 2024-04-25T02:11:48.546 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : python3-cephfs-2:16.2.15-0.el8.x86_64 56/69 2024-04-25T02:11:48.747 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : python3-rbd-2:16.2.15-0.el8.x86_64 57/69 2024-04-25T02:11:48.747 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.15-0.el8.x86_64 58/69 2024-04-25T02:11:49.046 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.15-0.el8.x86_64 58/69 2024-04-25T02:11:49.271 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : python3-rgw-2:16.2.15-0.el8.x86_64 59/69 2024-04-25T02:11:49.271 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librgw2-2:16.2.15-0.el8.x86_64 60/69 2024-04-25T02:11:49.496 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:16.2.15-0.el8.x86_64 60/69 2024-04-25T02:11:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : python3-rados-2:16.2.15-0.el8.x86_64 61/69 2024-04-25T02:11:49.662 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libcephfs2-2:16.2.15-0.el8.x86_64 62/69 2024-04-25T02:11:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:16.2.15-0.el8.x86_64 62/69 2024-04-25T02:11:50.071 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-fuse-2:16.2.15-0.el8.x86_64 63/69 2024-04-25T02:11:50.205 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 64/69 2024-04-25T02:11:50.387 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : python3-ceph-common-2:16.2.15-0.el8.x86_64 65/69 2024-04-25T02:11:50.529 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 66/69 2024-04-25T02:11:50.664 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 67/69 2024-04-25T02:11:50.664 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noar 68/69 2024-04-25T02:11:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noar 68/69 2024-04-25T02:11:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.15-0.el8.x86_64 69/69 2024-04-25T02:11:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.15-0.el8.x86_64 69/69 2024-04-25T02:11:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2024-04-25T02:11:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:18.2.3-0.el8.x86_64 2/69 2024-04-25T02:11:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:16.2.15-0.el8.x86_64 3/69 2024-04-25T02:11:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:18.2.3-0.el8.x86_64 4/69 2024-04-25T02:11:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:16.2.15-0.el8.x86_64 5/69 2024-04-25T02:11:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:18.2.3-0.el8.x86_64 6/69 2024-04-25T02:11:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:16.2.15-0.el8.x86_64 7/69 2024-04-25T02:11:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:18.2.3-0.el8.x86_64 8/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:16.2.15-0.el8.x86_64 9/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:18.2.3-0.el8.x86_64 10/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:16.2.15-0.el8.x86_64 11/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:18.2.3-0.el8.x86_64 12/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:16.2.15-0.el8.x86_64 13/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:18.2.3-0.el8.x86_64 14/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:16.2.15-0.el8.x86_64 15/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:18.2.3-0.el8.x86_64 16/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:16.2.15-0.el8.x86_64 17/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:18.2.3-0.el8.x86_64 18/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:16.2.15-0.el8.x86_64 19/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:18.2.3-0.el8.x86_64 20/69 2024-04-25T02:11:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:16.2.15-0.el8.x86_64 21/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:18.2.3-0.el8.x86_64 22/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:16.2.15-0.el8.x86_64 23/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:18.2.3-0.el8.x86_64 24/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:16.2.15-0.el8.x86_64 25/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:18.2.3-0.el8.x86_64 26/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:16.2.15-0.el8.x86_64 27/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:18.2.3-0.el8.x86_64 28/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:16.2.15-0.el8.x86_64 29/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:18.2.3-0.el8.x86_64 30/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:16.2.15-0.el8.x86_64 31/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:18.2.3-0.el8.x86_64 32/69 2024-04-25T02:11:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.15-0.el8.x86_64 33/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:18.2.3-0.el8.x86_64 34/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:16.2.15-0.el8.x86_64 35/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:18.2.3-0.el8.x86_64 36/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.15-0.el8.x86_64 37/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:18.2.3-0.el8.x86_64 38/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:16.2.15-0.el8.x86_64 39/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:18.2.3-0.el8.x86_64 40/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 41/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:18.2.3-0.el8.x86_64 42/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:16.2.15-0.el8.x86_64 43/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:18.2.3-0.el8.x86_64 44/69 2024-04-25T02:11:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:16.2.15-0.el8.x86_64 45/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:18.2.3-0.el8.x86_64 46/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:16.2.15-0.el8.x86_64 47/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:18.2.3-0.el8.x86_64 48/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:16.2.15-0.el8.x86_64 49/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:18.2.3-0.el8.x86_64 50/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:16.2.15-0.el8.x86_64 51/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:18.2.3-0.el8.x86_64 52/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:16.2.15-0.el8.x86_64 53/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:18.2.3-0.el8.x86_64 54/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:16.2.15-0.el8.x86_64 55/69 2024-04-25T02:11:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:18.2.3-0.el8.x86_64 56/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:16.2.15-0.el8.x86_64 57/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:18.2.3-0.el8.noarch 58/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 59/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:18.2.3-0.el8.noarch 60/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 61/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.3-0.el8.noarc 62/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noar 63/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:18.2.3-0.el8.noarch 64/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 65/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:18.2.3-0.el8.noarch 66/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:16.2.15-0.el8.noarch 67/69 2024-04-25T02:11:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:18.2.3-0.el8.noarch 68/69 2024-04-25T02:11:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 69/69 2024-04-25T02:11:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:11:53.018 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-04-25T02:11:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:18.2.3-0.el8.noarch 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:18.2.3-0.el8.noarch 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:18.2.3-0.el8.noarch 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:18.2.3-0.el8.noarch 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:18.2.3-0.el8.noarch 2024-04-25T02:11:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:18.2.3-0.el8.noarch 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:18.2.3-0.el8.x86_64 2024-04-25T02:11:53.021 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-25T02:11:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-25T02:11:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T02:11:53.022 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-25T02:11:53.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-25T02:11:53.479 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:11:53.503 INFO:teuthology.orchestra.run.smithi195.stdout:18.2.3-0.el8 2024-04-25T02:11:53.503 INFO:teuthology.packaging:The installed version of ceph is 18.2.3-0.el8 2024-04-25T02:11:53.503 INFO:teuthology.task.install:The correct ceph version 18.2.3-0 is installed. 2024-04-25T02:11:53.505 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:11:53.515 INFO:teuthology.task.print:**** done install.upgrade on client.0 2024-04-25T02:11:53.515 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-04-25T02:11:53.523 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:11:53.523 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:11:53.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T02:11:53.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.642+0000 7fb4ca591700 1 Processor -- start 2024-04-25T02:11:53.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4ca591700 1 -- start start 2024-04-25T02:11:53.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4ca591700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4c4124000 0x7fb4c40961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4ca591700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4127bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4ca591700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c4096cf0 con 0x7fb4c40937a0 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4ca591700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c4093ba0 con 0x7fb4c4124000 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4ca591700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4092d00 con 0x7fb4c41243e0 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c8b2e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4c4124000 0x7fb4c40961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c8b2e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4127bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42118/0 (socket says 172.21.15.78:42118) 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c3fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb4c4124000 0x7fb4c40961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60480/0 (socket says 172.21.15.78:60480) 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c8b2e700 1 -- 172.21.15.78:0/82697037 learned_addr learned my addr 172.21.15.78:0/82697037 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c37fe700 1 --1- 172.21.15.78:0/82697037 >> v1:172.21.15.78:6789/0 conn(0x7fb4c40937a0 0x7fb4c41274e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39738/0 (socket says 172.21.15.78:39738) 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c3fff700 1 -- 172.21.15.78:0/82697037 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 msgr2=0x7fb4c4127bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c3fff700 1 --2- 172.21.15.78:0/82697037 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4127bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c3fff700 1 -- 172.21.15.78:0/82697037 >> v1:172.21.15.78:6789/0 conn(0x7fb4c40937a0 legacy=0x7fb4c41274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c2ffd700 1 -- 172.21.15.78:0/82697037 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340138642 0 0) 0x7fb4c4096cf0 con 0x7fb4c40937a0 2024-04-25T02:11:53.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c3fff700 1 -- 172.21.15.78:0/82697037 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40933a0 con 0x7fb4c4124000 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.643+0000 7fb4c8b2e700 1 --2- 172.21.15.78:0/82697037 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4127bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4c3fff700 1 --2- 172.21.15.78:0/82697037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 0x7fb4c40961a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb4b4009760 tx=0x7fb4b4009060).ready entity=mon.0 client_cookie=a744697ddbc46f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4c2ffd700 1 -- 172.21.15.78:0/82697037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40090d0 con 0x7fb4c4124000 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4c2ffd700 1 -- 172.21.15.78:0/82697037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400f510 con 0x7fb4c4124000 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4c2ffd700 1 -- 172.21.15.78:0/82697037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400f890 con 0x7fb4c4124000 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4ca591700 1 -- 172.21.15.78:0/82697037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 msgr2=0x7fb4c40961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4ca591700 1 --2- 172.21.15.78:0/82697037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 0x7fb4c40961a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb4b4009760 tx=0x7fb4b4009060).stop 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4ca591700 1 -- 172.21.15.78:0/82697037 shutdown_connections 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4ca591700 1 --2- 172.21.15.78:0/82697037 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4127bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4ca591700 1 --2- 172.21.15.78:0/82697037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 0x7fb4c40961a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4ca591700 1 -- 172.21.15.78:0/82697037 >> 172.21.15.78:0/82697037 conn(0x7fb4c4097450 msgr2=0x7fb4c4097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4ca591700 1 -- 172.21.15.78:0/82697037 shutdown_connections 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.644+0000 7fb4ca591700 1 -- 172.21.15.78:0/82697037 wait complete. 2024-04-25T02:11:53.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.645+0000 7fb4ca591700 1 Processor -- start 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.645+0000 7fb4ca591700 1 -- start start 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4ca591700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4c40937a0 0x7fb4c4119b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4ca591700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 0x7fb4c4125410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4ca591700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4125900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4ca591700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4119670 con 0x7fb4c4124000 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4ca591700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4062ab0 con 0x7fb4c40937a0 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4ca591700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4092440 con 0x7fb4c41243e0 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c8b2e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4125900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c3fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4c40937a0 0x7fb4c4119b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c8b2e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4125900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42120/0 (socket says 172.21.15.78:42120) 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c3fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4c40937a0 0x7fb4c4119b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51412/0 (socket says 172.21.15.78:51412) 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c8b2e700 1 -- 172.21.15.78:0/3668943760 learned_addr learned my addr 172.21.15.78:0/3668943760 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c37fe700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 0x7fb4c4125410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c8b2e700 1 -- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4c40937a0 msgr2=0x7fb4c4119b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c8b2e700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4c40937a0 0x7fb4c4119b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c8b2e700 1 -- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 msgr2=0x7fb4c4125410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c8b2e700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 0x7fb4c4125410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c8b2e700 1 -- 172.21.15.78:0/3668943760 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc009ae0 con 0x7fb4c41243e0 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c37fe700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 0x7fb4c4125410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c3fff700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4c40937a0 0x7fb4c4119b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.646+0000 7fb4c8b2e700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4125900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb4bc00c0c0 tx=0x7fb4bc00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.647+0000 7fb4c0ff9700 1 -- 172.21.15.78:0/3668943760 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0092e0 con 0x7fb4c41243e0 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.647+0000 7fb4c0ff9700 1 -- 172.21.15.78:0/3668943760 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc00f040 con 0x7fb4c41243e0 2024-04-25T02:11:53.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.647+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b40092a0 con 0x7fb4c41243e0 2024-04-25T02:11:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.647+0000 7fb4c0ff9700 1 -- 172.21.15.78:0/3668943760 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc00cc00 con 0x7fb4c41243e0 2024-04-25T02:11:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.647+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c4127030 con 0x7fb4c41243e0 2024-04-25T02:11:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.647+0000 7fb4c0ff9700 1 -- 172.21.15.78:0/3668943760 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fb4bc007400 con 0x7fb4c41243e0 2024-04-25T02:11:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.647+0000 7fb4c0ff9700 1 -- 172.21.15.78:0/3668943760 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fb4bc03b320 con 0x7fb4c41243e0 2024-04-25T02:11:53.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.648+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c4097c10 con 0x7fb4c41243e0 2024-04-25T02:11:53.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.653+0000 7fb4c0ff9700 1 -- 172.21.15.78:0/3668943760 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fb4bc0112c0 con 0x7fb4c41243e0 2024-04-25T02:11:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.850+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb4c4097f70 con 0x7fb4c41243e0 2024-04-25T02:11:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.852+0000 7fb4c0ff9700 1 -- 172.21.15.78:0/3668943760 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64325 (secure 0 0 0) 0x7fb4bc012b50 con 0x7fb4c41243e0 2024-04-25T02:11:53.860 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:11:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.853+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 >> v1:172.21.15.78:6816/46507 conn(0x7fb4a402bd00 legacy=0x7fb4a402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.853+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 msgr2=0x7fb4c4125900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.853+0000 7fb4ca591700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4125900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb4bc00c0c0 tx=0x7fb4bc00b040).stop 2024-04-25T02:11:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.853+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 shutdown_connections 2024-04-25T02:11:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.853+0000 7fb4ca591700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb4c41243e0 0x7fb4c4125900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.853+0000 7fb4ca591700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb4c40937a0 0x7fb4c4119b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.853+0000 7fb4ca591700 1 --2- 172.21.15.78:0/3668943760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4c4124000 0x7fb4c4125410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.853+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 >> 172.21.15.78:0/3668943760 conn(0x7fb4c4097450 msgr2=0x7fb4c4099f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.854+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 shutdown_connections 2024-04-25T02:11:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.854+0000 7fb4ca591700 1 -- 172.21.15.78:0/3668943760 wait complete. 2024-04-25T02:11:53.872 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6816","nonce":46507}]},"active_addr":"172.21.15.78:6816/46507","active_change":"2024-04-25T02:09:52.189524+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2142937370}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1080180923}]}]} 2024-04-25T02:11:53.874 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T02:11:53.874 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:11:53.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.982+0000 7f4e9a727700 1 Processor -- start 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.982+0000 7f4e9a727700 1 -- start start 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e9a727700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e940972f0 0x7f4e941279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e9a727700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e94127ee0 0x7f4e9412a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e9a727700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e94097c30 con 0x7f4e9412acc0 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e9a727700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940976d0 con 0x7f4e940972f0 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e9a727700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94065420 con 0x7f4e94127ee0 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e937fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e94127ee0 0x7f4e9412a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e93fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e940972f0 0x7f4e941279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e98cc4700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4e9412acc0 0x7f4e94131b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39746/0 (socket says 172.21.15.78:39746) 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e98cc4700 1 -- 172.21.15.78:0/2318172411 learned_addr learned my addr 172.21.15.78:0/2318172411 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e92ffd700 1 -- 172.21.15.78:0/2318172411 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666301562 0 0) 0x7f4e94097c30 con 0x7f4e9412acc0 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e93fff700 1 -- 172.21.15.78:0/2318172411 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e94127ee0 msgr2=0x7f4e9412a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e93fff700 1 --2- 172.21.15.78:0/2318172411 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e94127ee0 0x7f4e9412a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e93fff700 1 -- 172.21.15.78:0/2318172411 >> v1:172.21.15.78:6789/0 conn(0x7f4e9412acc0 legacy=0x7f4e94131b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e93fff700 1 -- 172.21.15.78:0/2318172411 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e94064e60 con 0x7f4e940972f0 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e937fe700 1 --2- 172.21.15.78:0/2318172411 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e94127ee0 0x7f4e9412a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e93fff700 1 --2- 172.21.15.78:0/2318172411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e940972f0 0x7f4e941279f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4e84009790 tx=0x7f4e84009060).ready entity=mon.1 client_cookie=ac6cc1a7fe8bb09e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e92ffd700 1 -- 172.21.15.78:0/2318172411 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8400f510 con 0x7f4e940972f0 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e92ffd700 1 -- 172.21.15.78:0/2318172411 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8400f670 con 0x7f4e940972f0 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.983+0000 7f4e92ffd700 1 -- 172.21.15.78:0/2318172411 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8400f9f0 con 0x7f4e940972f0 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.984+0000 7f4e9a727700 1 -- 172.21.15.78:0/2318172411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e940972f0 msgr2=0x7f4e941279f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.984+0000 7f4e9a727700 1 --2- 172.21.15.78:0/2318172411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e940972f0 0x7f4e941279f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4e84009790 tx=0x7f4e84009060).stop 2024-04-25T02:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.984+0000 7f4e9a727700 1 -- 172.21.15.78:0/2318172411 shutdown_connections 2024-04-25T02:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.984+0000 7f4e9a727700 1 --2- 172.21.15.78:0/2318172411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e940972f0 0x7f4e941279f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.984+0000 7f4e9a727700 1 --2- 172.21.15.78:0/2318172411 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e94127ee0 0x7f4e9412a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.984+0000 7f4e9a727700 1 -- 172.21.15.78:0/2318172411 >> 172.21.15.78:0/2318172411 conn(0x7f4e9409c550 msgr2=0x7f4e940983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.984+0000 7f4e9a727700 1 -- 172.21.15.78:0/2318172411 shutdown_connections 2024-04-25T02:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.984+0000 7f4e9a727700 1 -- 172.21.15.78:0/2318172411 wait complete. 2024-04-25T02:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e9a727700 1 Processor -- start 2024-04-25T02:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e9a727700 1 -- start start 2024-04-25T02:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e9a727700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e94127ee0 0x7f4e941268e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e9a727700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e9412acc0 0x7f4e941157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e9a727700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e94115cb0 0x7f4e94116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e9a727700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94119320 con 0x7f4e94127ee0 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e9a727700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94116bc0 con 0x7f4e94115cb0 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e9a727700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94064a40 con 0x7f4e9412acc0 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e93fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e94127ee0 0x7f4e941268e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e93fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e94127ee0 0x7f4e941268e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60488/0 (socket says 172.21.15.78:60488) 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e93fff700 1 -- 172.21.15.78:0/537893175 learned_addr learned my addr 172.21.15.78:0/537893175 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e98cc4700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e94115cb0 0x7f4e94116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.985+0000 7f4e937fe700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e9412acc0 0x7f4e941157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e98cc4700 1 -- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e9412acc0 msgr2=0x7f4e941157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e98cc4700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e9412acc0 0x7f4e941157c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e98cc4700 1 -- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e94127ee0 msgr2=0x7f4e941268e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e98cc4700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e94127ee0 0x7f4e941268e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e98cc4700 1 -- 172.21.15.78:0/537893175 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0092a0 con 0x7f4e94115cb0 2024-04-25T02:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e93fff700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e94127ee0 0x7f4e941268e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e98cc4700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e94115cb0 0x7f4e94116110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4e8c002230 tx=0x7f4e8c007eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e90ff9700 1 -- 172.21.15.78:0/537893175 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c005d30 con 0x7f4e94115cb0 2024-04-25T02:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e90ff9700 1 -- 172.21.15.78:0/537893175 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c005e90 con 0x7f4e94115cb0 2024-04-25T02:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e840092a0 con 0x7f4e94115cb0 2024-04-25T02:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e90ff9700 1 -- 172.21.15.78:0/537893175 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c007360 con 0x7f4e94115cb0 2024-04-25T02:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.986+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e94126dd0 con 0x7f4e94115cb0 2024-04-25T02:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.987+0000 7f4e90ff9700 1 -- 172.21.15.78:0/537893175 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f4e8c007750 con 0x7f4e94115cb0 2024-04-25T02:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.987+0000 7f4e90ff9700 1 -- 172.21.15.78:0/537893175 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f4e8c03b130 con 0x7f4e94115cb0 2024-04-25T02:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.987+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e94099a70 con 0x7f4e94115cb0 2024-04-25T02:11:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:53.992+0000 7f4e90ff9700 1 -- 172.21.15.78:0/537893175 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f4e8c01c3e0 con 0x7f4e94115cb0 2024-04-25T02:11:54.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.151+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e94098af0 con 0x7f4e94115cb0 2024-04-25T02:11:54.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.152+0000 7f4e90ff9700 1 -- 172.21.15.78:0/537893175 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11609 (secure 0 0 0) 0x7f4e8c01a300 con 0x7f4e94115cb0 2024-04-25T02:11:54.160 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:11:54.160 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:53.832053+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 >> v1:172.21.15.78:6816/46507 conn(0x7f4e7402bd30 legacy=0x7f4e7402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e94115cb0 msgr2=0x7f4e94116110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e94115cb0 0x7f4e94116110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4e8c002230 tx=0x7f4e8c007eb0).stop 2024-04-25T02:11:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 shutdown_connections 2024-04-25T02:11:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e94115cb0 0x7f4e94116110 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e94127ee0 0x7f4e941268e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 --2- 172.21.15.78:0/537893175 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4e9412acc0 0x7f4e941157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 >> 172.21.15.78:0/537893175 conn(0x7f4e940972f0 msgr2=0x7f4e94129900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 shutdown_connections 2024-04-25T02:11:54.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.154+0000 7f4e9a727700 1 -- 172.21.15.78:0/537893175 wait complete. 2024-04-25T02:11:54.173 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:11:54.173 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:54.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff691cbd700 1 Processor -- start 2024-04-25T02:11:54.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff691cbd700 1 -- start start 2024-04-25T02:11:54.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff691cbd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c05e960 0x7ff68c098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff691cbd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c099330 0x7ff68c099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff691cbd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff68c12d120 0x7ff68c12f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff691cbd700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68c05ed40 con 0x7ff68c12d120 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff691cbd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c067f10 con 0x7ff68c099330 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff691cbd700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c06ad70 con 0x7ff68c05e960 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff68b7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c05e960 0x7ff68c098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff68bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff68c12d120 0x7ff68c12f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff68affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c099330 0x7ff68c099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff68b7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c05e960 0x7ff68c098e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42152/0 (socket says 172.21.15.78:42152) 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff68bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff68c12d120 0x7ff68c12f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60492/0 (socket says 172.21.15.78:60492) 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff68b7fe700 1 -- 172.21.15.78:0/2197945665 learned_addr learned my addr 172.21.15.78:0/2197945665 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.281+0000 7ff68affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c099330 0x7ff68c099730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51442/0 (socket says 172.21.15.78:51442) 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68affd700 1 -- 172.21.15.78:0/2197945665 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c05e960 msgr2=0x7ff68c098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68affd700 1 --2- 172.21.15.78:0/2197945665 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c05e960 0x7ff68c098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68affd700 1 -- 172.21.15.78:0/2197945665 >> v2:172.21.15.78:3300/0 conn(0x7ff68c12d120 msgr2=0x7ff68c12f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68affd700 1 --2- 172.21.15.78:0/2197945665 >> v2:172.21.15.78:3300/0 conn(0x7ff68c12d120 0x7ff68c12f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68affd700 1 -- 172.21.15.78:0/2197945665 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c068d10 con 0x7ff68c099330 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68b7fe700 1 --2- 172.21.15.78:0/2197945665 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c05e960 0x7ff68c098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68bfff700 1 --2- 172.21.15.78:0/2197945665 >> v2:172.21.15.78:3300/0 conn(0x7ff68c12d120 0x7ff68c12f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68affd700 1 --2- 172.21.15.78:0/2197945665 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c099330 0x7ff68c099730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff680009790 tx=0x7ff680009060).ready entity=mon.1 client_cookie=34b2bc49b20504bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68a7fc700 1 -- 172.21.15.78:0/2197945665 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000d4a0 con 0x7ff68c099330 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68a7fc700 1 -- 172.21.15.78:0/2197945665 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68000d600 con 0x7ff68c099330 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff68a7fc700 1 -- 172.21.15.78:0/2197945665 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000d980 con 0x7ff68c099330 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff691cbd700 1 -- 172.21.15.78:0/2197945665 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c099330 msgr2=0x7ff68c099730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff691cbd700 1 --2- 172.21.15.78:0/2197945665 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c099330 0x7ff68c099730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff680009790 tx=0x7ff680009060).stop 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff691cbd700 1 -- 172.21.15.78:0/2197945665 shutdown_connections 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff691cbd700 1 --2- 172.21.15.78:0/2197945665 >> v2:172.21.15.78:3300/0 conn(0x7ff68c12d120 0x7ff68c12f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff691cbd700 1 --2- 172.21.15.78:0/2197945665 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c05e960 0x7ff68c098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff691cbd700 1 --2- 172.21.15.78:0/2197945665 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c099330 0x7ff68c099730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff691cbd700 1 -- 172.21.15.78:0/2197945665 >> 172.21.15.78:0/2197945665 conn(0x7ff68c0974d0 msgr2=0x7ff68c099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff691cbd700 1 -- 172.21.15.78:0/2197945665 shutdown_connections 2024-04-25T02:11:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.282+0000 7ff691cbd700 1 -- 172.21.15.78:0/2197945665 wait complete. 2024-04-25T02:11:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.283+0000 7ff691cbd700 1 Processor -- start 2024-04-25T02:11:54.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.283+0000 7ff691cbd700 1 -- start start 2024-04-25T02:11:54.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff691cbd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff68c05e960 0x7ff68c126010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff691cbd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c099330 0x7ff68c126500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff691cbd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c12d120 0x7ff68c1269f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff691cbd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c126ee0 con 0x7ff68c05e960 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff691cbd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c091560 con 0x7ff68c12d120 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff691cbd700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c12a6a0 con 0x7ff68c099330 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff68c05e960 0x7ff68c126010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c12d120 0x7ff68c1269f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c12d120 0x7ff68c1269f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51448/0 (socket says 172.21.15.78:51448) 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff68c05e960 0x7ff68c126010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60508/0 (socket says 172.21.15.78:60508) 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68bfff700 1 -- 172.21.15.78:0/1843165721 learned_addr learned my addr 172.21.15.78:0/1843165721 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68affd700 1 --2- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c099330 0x7ff68c126500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68bfff700 1 -- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c099330 msgr2=0x7ff68c126500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68bfff700 1 --2- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c099330 0x7ff68c126500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68bfff700 1 -- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff68c05e960 msgr2=0x7ff68c126010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68bfff700 1 --2- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff68c05e960 0x7ff68c126010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68bfff700 1 -- 172.21.15.78:0/1843165721 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c009370 con 0x7ff68c12d120 2024-04-25T02:11:54.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68b7fe700 1 --2- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff68c05e960 0x7ff68c126010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.284+0000 7ff68bfff700 1 --2- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c12d120 0x7ff68c1269f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff684009fc0 tx=0x7ff68400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.285+0000 7ff673fff700 1 -- 172.21.15.78:0/1843165721 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68400cbd0 con 0x7ff68c12d120 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.285+0000 7ff673fff700 1 -- 172.21.15.78:0/1843165721 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68400f040 con 0x7ff68c12d120 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.285+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff684009a20 con 0x7ff68c12d120 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.285+0000 7ff673fff700 1 -- 172.21.15.78:0/1843165721 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684013400 con 0x7ff68c12d120 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.285+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800092a0 con 0x7ff68c12d120 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.285+0000 7ff673fff700 1 -- 172.21.15.78:0/1843165721 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7ff6840137b0 con 0x7ff68c12d120 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.286+0000 7ff673fff700 1 -- 172.21.15.78:0/1843165721 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7ff68403bb30 con 0x7ff68c12d120 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.286+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68c129a20 con 0x7ff68c12d120 2024-04-25T02:11:54.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.290+0000 7ff673fff700 1 -- 172.21.15.78:0/1843165721 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7ff684007da0 con 0x7ff68c12d120 2024-04-25T02:11:54.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.451+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff68c09a660 con 0x7ff68c12d120 2024-04-25T02:11:54.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.452+0000 7ff673fff700 1 -- 172.21.15.78:0/1843165721 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11609 (secure 0 0 0) 0x7ff68402c090 con 0x7ff68c12d120 2024-04-25T02:11:54.460 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:11:54.460 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:53.832053+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 >> v1:172.21.15.78:6816/46507 conn(0x7ff67802bd30 legacy=0x7ff67802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c12d120 msgr2=0x7ff68c1269f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 --2- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c12d120 0x7ff68c1269f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff684009fc0 tx=0x7ff68400b040).stop 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 shutdown_connections 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 --2- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff68c12d120 0x7ff68c1269f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 --2- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff68c05e960 0x7ff68c126010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 --2- 172.21.15.78:0/1843165721 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff68c099330 0x7ff68c126500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 >> 172.21.15.78:0/1843165721 conn(0x7ff68c0974d0 msgr2=0x7ff68c092b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 shutdown_connections 2024-04-25T02:11:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.454+0000 7ff691cbd700 1 -- 172.21.15.78:0/1843165721 wait complete. 2024-04-25T02:11:54.473 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T02:11:54.474 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T02:11:54.474 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T02:11:54.475 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T02:11:54.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.591+0000 7f7957b07700 1 Processor -- start 2024-04-25T02:11:54.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5ce1a4700 1 Processor -- start 2024-04-25T02:11:54.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5ce1a4700 1 -- start start 2024-04-25T02:11:54.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7f7957b07700 1 -- start start 2024-04-25T02:11:54.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7f7957b07700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7950091cc0 0x7f79501343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7f7957b07700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950093a70 0x7f79501368a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7f7957b07700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7950090550 con 0x7f7950091620 2024-04-25T02:11:54.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7f7957b07700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79500979c0 con 0x7f7950091cc0 2024-04-25T02:11:54.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7f7957b07700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7950094110 con 0x7f7950093a70 2024-04-25T02:11:54.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7f79558a3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7950091620 0x7f7950093360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39774/0 (socket says 172.21.15.78:39774) 2024-04-25T02:11:54.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7f79558a3700 1 -- 172.21.15.78:0/2687596618 learned_addr learned my addr 172.21.15.78:0/2687596618 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:11:54.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7f79550a2700 1 --2- 172.21.15.78:0/2687596618 >> v2:172.21.15.78:3300/0 conn(0x7f7950091cc0 0x7f79501343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7f79560a4700 1 --2- 172.21.15.78:0/2687596618 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950093a70 0x7f79501368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5ce1a4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5c8099930 0x7fe5c8130150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5ce1a4700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8130640 0x7fe5c8132a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5ce1a4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c8091dc0 con 0x7fe5c8098e40 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5ce1a4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c8092330 con 0x7fe5c8099930 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5ce1a4700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c809aea0 con 0x7fe5c8130640 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5c6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5c8099930 0x7fe5c8130150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5c7fff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8130640 0x7fe5c8132a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5c6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5c8099930 0x7fe5c8130150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60516/0 (socket says 172.21.15.78:60516) 2024-04-25T02:11:54.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5c6ffd700 1 -- 172.21.15.78:0/1769876627 learned_addr learned my addr 172.21.15.78:0/1769876627 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.592+0000 7fe5c7fff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8130640 0x7fe5c8132a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42168/0 (socket says 172.21.15.78:42168) 2024-04-25T02:11:54.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7f79560a4700 1 -- 172.21.15.78:0/2687596618 >> v2:172.21.15.78:3300/0 conn(0x7f7950091cc0 msgr2=0x7f79501343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7f79560a4700 1 --2- 172.21.15.78:0/2687596618 >> v2:172.21.15.78:3300/0 conn(0x7f7950091cc0 0x7f79501343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7f79560a4700 1 -- 172.21.15.78:0/2687596618 >> v1:172.21.15.78:6789/0 conn(0x7f7950091620 legacy=0x7f7950093360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7f79560a4700 1 -- 172.21.15.78:0/2687596618 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500907e0 con 0x7f7950093a70 2024-04-25T02:11:54.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7f79560a4700 1 --2- 172.21.15.78:0/2687596618 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950093a70 0x7f79501368a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7948009e60 tx=0x7f7948009780).ready entity=mon.2 client_cookie=6eb835434482682e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7fe5c7fff700 1 -- 172.21.15.78:0/1769876627 >> v2:172.21.15.78:3300/0 conn(0x7fe5c8099930 msgr2=0x7fe5c8130150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7fe5c7fff700 1 --2- 172.21.15.78:0/1769876627 >> v2:172.21.15.78:3300/0 conn(0x7fe5c8099930 0x7fe5c8130150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7fe5c7fff700 1 -- 172.21.15.78:0/1769876627 >> v1:172.21.15.78:6789/0 conn(0x7fe5c8098e40 legacy=0x7fe5c8099220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7fe5c7fff700 1 -- 172.21.15.78:0/1769876627 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c8091450 con 0x7fe5c8130640 2024-04-25T02:11:54.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7fe5c6ffd700 1 --2- 172.21.15.78:0/1769876627 >> v2:172.21.15.78:3300/0 conn(0x7fe5c8099930 0x7fe5c8130150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:54.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7fe5c7fff700 1 --2- 172.21.15.78:0/1769876627 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8130640 0x7fe5c8132a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe5c0009e60 tx=0x7fe5c0009780).ready entity=mon.2 client_cookie=1fac6bf1e3146c18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7f79548a1700 1 -- 172.21.15.78:0/2687596618 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794800e070 con 0x7f7950093a70 2024-04-25T02:11:54.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7f79548a1700 1 -- 172.21.15.78:0/2687596618 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794800bc30 con 0x7f7950093a70 2024-04-25T02:11:54.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7f79548a1700 1 -- 172.21.15.78:0/2687596618 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948012410 con 0x7f7950093a70 2024-04-25T02:11:54.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7fe5c67fc700 1 -- 172.21.15.78:0/1769876627 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000e070 con 0x7fe5c8130640 2024-04-25T02:11:54.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7fe5c67fc700 1 -- 172.21.15.78:0/1769876627 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c000bc30 con 0x7fe5c8130640 2024-04-25T02:11:54.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.593+0000 7fe5c67fc700 1 -- 172.21.15.78:0/1769876627 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0012410 con 0x7fe5c8130640 2024-04-25T02:11:54.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7f7957b07700 1 -- 172.21.15.78:0/2687596618 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950093a70 msgr2=0x7f79501368a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7f7957b07700 1 --2- 172.21.15.78:0/2687596618 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950093a70 0x7f79501368a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7948009e60 tx=0x7f7948009780).stop 2024-04-25T02:11:54.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/1769876627 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8130640 msgr2=0x7fe5c8132a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7fe5ce1a4700 1 --2- 172.21.15.78:0/1769876627 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8130640 0x7fe5c8132a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe5c0009e60 tx=0x7fe5c0009780).stop 2024-04-25T02:11:54.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7f7957b07700 1 -- 172.21.15.78:0/2687596618 shutdown_connections 2024-04-25T02:11:54.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7f7957b07700 1 --2- 172.21.15.78:0/2687596618 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950093a70 0x7f79501368a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7f7957b07700 1 --2- 172.21.15.78:0/2687596618 >> v2:172.21.15.78:3300/0 conn(0x7f7950091cc0 0x7f79501343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7f7957b07700 1 -- 172.21.15.78:0/2687596618 >> 172.21.15.78:0/2687596618 conn(0x7f79500974d0 msgr2=0x7f7950099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/1769876627 shutdown_connections 2024-04-25T02:11:54.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7fe5ce1a4700 1 --2- 172.21.15.78:0/1769876627 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8130640 0x7fe5c8132a30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7fe5ce1a4700 1 --2- 172.21.15.78:0/1769876627 >> v2:172.21.15.78:3300/0 conn(0x7fe5c8099930 0x7fe5c8130150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/1769876627 >> 172.21.15.78:0/1769876627 conn(0x7fe5c80974d0 msgr2=0x7fe5c8099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/1769876627 shutdown_connections 2024-04-25T02:11:54.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/1769876627 wait complete. 2024-04-25T02:11:54.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.594+0000 7f7957b07700 1 -- 172.21.15.78:0/2687596618 shutdown_connections 2024-04-25T02:11:54.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.595+0000 7f7957b07700 1 -- 172.21.15.78:0/2687596618 wait complete. 2024-04-25T02:11:54.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.595+0000 7fe5ce1a4700 1 Processor -- start 2024-04-25T02:11:54.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.595+0000 7f7957b07700 1 Processor -- start 2024-04-25T02:11:54.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.595+0000 7f7957b07700 1 -- start start 2024-04-25T02:11:54.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5ce1a4700 1 -- start start 2024-04-25T02:11:54.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f7957b07700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950091620 0x7f7950069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f7957b07700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7950093a70 0x7f7950069b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f7957b07700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795006a030 0x7f7950136480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f7957b07700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795008f5d0 con 0x7f795006a030 2024-04-25T02:11:54.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f7957b07700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7950094340 con 0x7f7950093a70 2024-04-25T02:11:54.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f7957b07700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7950069390 con 0x7f7950091620 2024-04-25T02:11:54.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5ce1a4700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8098e40 0x7fe5c808f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5ce1a4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c8099930 0x7fe5c808df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f79560a4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795006a030 0x7f7950136480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f79560a4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795006a030 0x7f7950136480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60538/0 (socket says 172.21.15.78:60538) 2024-04-25T02:11:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f79560a4700 1 -- 172.21.15.78:0/2448328510 learned_addr learned my addr 172.21.15.78:0/2448328510 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f79550a2700 1 --2- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7950093a70 0x7f7950069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7f79558a3700 1 --2- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950091620 0x7f7950069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5ce1a4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5c8130640 0x7fe5c808b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5ce1a4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c808e480 con 0x7fe5c8099930 2024-04-25T02:11:54.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5ce1a4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c808f7e0 con 0x7fe5c8130640 2024-04-25T02:11:54.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5ce1a4700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c808ccf0 con 0x7fe5c8098e40 2024-04-25T02:11:54.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5c77fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8098e40 0x7fe5c808f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5c77fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8098e40 0x7fe5c808f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42186/0 (socket says 172.21.15.78:42186) 2024-04-25T02:11:54.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5c77fe700 1 -- 172.21.15.78:0/406616900 learned_addr learned my addr 172.21.15.78:0/406616900 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.596+0000 7fe5c6ffd700 1 --2- 172.21.15.78:0/406616900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c8099930 0x7fe5c808df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79558a3700 1 -- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7950093a70 msgr2=0x7f7950069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79558a3700 1 --2- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7950093a70 0x7f7950069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79558a3700 1 -- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795006a030 msgr2=0x7f7950136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79558a3700 1 --2- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795006a030 0x7f7950136480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79558a3700 1 -- 172.21.15.78:0/2448328510 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7948009a20 con 0x7f7950091620 2024-04-25T02:11:54.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79560a4700 1 --2- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795006a030 0x7f7950136480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79550a2700 1 --2- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7950093a70 0x7f7950069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79558a3700 1 --2- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950091620 0x7f7950069650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f794c00c440 tx=0x7f794c007d30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7fe5c77fe700 1 -- 172.21.15.78:0/406616900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5c8130640 msgr2=0x7fe5c808b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7fe5c77fe700 1 --2- 172.21.15.78:0/406616900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5c8130640 0x7fe5c808b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:54.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7fe5c77fe700 1 -- 172.21.15.78:0/406616900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c8099930 msgr2=0x7fe5c808df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7fe5c77fe700 1 --2- 172.21.15.78:0/406616900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c8099930 0x7fe5c808df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7fe5c77fe700 1 -- 172.21.15.78:0/406616900 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0009a20 con 0x7fe5c8098e40 2024-04-25T02:11:54.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79467fc700 1 -- 172.21.15.78:0/2448328510 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0070d0 con 0x7f7950091620 2024-04-25T02:11:54.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7950088f00 con 0x7f7950091620 2024-04-25T02:11:54.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7950089a80 con 0x7f7950091620 2024-04-25T02:11:54.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7fe5c77fe700 1 --2- 172.21.15.78:0/406616900 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8098e40 0x7fe5c808f100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe5b800c4c0 tx=0x7fe5b8007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79467fc700 1 -- 172.21.15.78:0/2448328510 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c007440 con 0x7f7950091620 2024-04-25T02:11:54.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.597+0000 7f79467fc700 1 -- 172.21.15.78:0/2448328510 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0075b0 con 0x7f7950091620 2024-04-25T02:11:54.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7938000fc0 con 0x7f7950091620 2024-04-25T02:11:54.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7fe5affff700 1 -- 172.21.15.78:0/406616900 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8007020 con 0x7fe5c8098e40 2024-04-25T02:11:54.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7f79467fc700 1 -- 172.21.15.78:0/2448328510 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f794c0057a0 con 0x7f7950091620 2024-04-25T02:11:54.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7fe5affff700 1 -- 172.21.15.78:0/406616900 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8001e90 con 0x7fe5c8098e40 2024-04-25T02:11:54.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c806aa10 con 0x7fe5c8098e40 2024-04-25T02:11:54.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7fe5affff700 1 -- 172.21.15.78:0/406616900 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80073d0 con 0x7fe5c8098e40 2024-04-25T02:11:54.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c808ec00 con 0x7fe5c8098e40 2024-04-25T02:11:54.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7f79467fc700 1 -- 172.21.15.78:0/2448328510 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f794c03a490 con 0x7f7950091620 2024-04-25T02:11:54.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7f79467fc700 1 -- 172.21.15.78:0/2448328510 --> v1:172.21.15.78:6804/47107 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7934038900 con 0x7f7934034bf0 2024-04-25T02:11:54.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.598+0000 7f79467fc700 1 -- 172.21.15.78:0/2448328510 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f794c03cca0 con 0x7f7950091620 2024-04-25T02:11:54.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.599+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5c809a660 con 0x7fe5c8098e40 2024-04-25T02:11:54.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.599+0000 7fe5affff700 1 -- 172.21.15.78:0/406616900 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fe5b80068b0 con 0x7fe5c8098e40 2024-04-25T02:11:54.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.600+0000 7fe5affff700 1 -- 172.21.15.78:0/406616900 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fe5b803b2e0 con 0x7fe5c8098e40 2024-04-25T02:11:54.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.600+0000 7fe5affff700 1 -- 172.21.15.78:0/406616900 --> v1:172.21.15.78:6809/47117 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5b4038a50 con 0x7fe5b4034d40 2024-04-25T02:11:54.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.600+0000 7fe5affff700 1 -- 172.21.15.78:0/406616900 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5b803b640 con 0x7fe5c8098e40 2024-04-25T02:11:54.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.601+0000 7f79467fc700 1 -- 172.21.15.78:0/2448328510 <== osd.0 v1:172.21.15.78:6804/47107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f7934038900 con 0x7f7934034bf0 2024-04-25T02:11:54.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.601+0000 7f419087d700 1 Processor -- start 2024-04-25T02:11:54.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.601+0000 7f419087d700 1 -- start start 2024-04-25T02:11:54.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.601+0000 7fe5affff700 1 -- 172.21.15.78:0/406616900 <== osd.3 v1:172.21.15.78:6809/47117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7fe5b4038a50 con 0x7fe5b4034d40 2024-04-25T02:11:54.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f3fff710700 1 Processor -- start 2024-04-25T02:11:54.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f419087d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f418c091450 0x7f418c091830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f419087d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 0x7f418c090070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f419087d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c093d70 con 0x7f418c090560 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f419087d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c06c260 con 0x7f418c091450 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f419087d700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f418c099570 con 0x7f418c091d20 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f418a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f418c091450 0x7f418c091830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f418a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f418c091450 0x7f418c091830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60562/0 (socket says 172.21.15.78:60562) 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f4189d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 0x7f418c090070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f418a59c700 1 -- 172.21.15.78:0/2795440511 learned_addr learned my addr 172.21.15.78:0/2795440511 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f4189d9b700 1 -- 172.21.15.78:0/2795440511 >> v2:172.21.15.78:3300/0 conn(0x7f418c091450 msgr2=0x7f418c091830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f4189d9b700 1 --2- 172.21.15.78:0/2795440511 >> v2:172.21.15.78:3300/0 conn(0x7f418c091450 0x7f418c091830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f4189d9b700 1 -- 172.21.15.78:0/2795440511 >> v1:172.21.15.78:6789/0 conn(0x7f418c090560 legacy=0x7f418c12e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f4189d9b700 1 -- 172.21.15.78:0/2795440511 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c093ad0 con 0x7f418c091d20 2024-04-25T02:11:54.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.602+0000 7f3fff710700 1 -- start start 2024-04-25T02:11:54.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3fff710700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3ff8091620 0x7f3ff8093360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3fff710700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8093850 0x7f3ff8099550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3fff710700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff8090550 con 0x7f3ff8091cc0 2024-04-25T02:11:54.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3fff710700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff80979c0 con 0x7f3ff8091620 2024-04-25T02:11:54.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3fff710700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8094110 con 0x7f3ff8093850 2024-04-25T02:11:54.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f4189d9b700 1 --2- 172.21.15.78:0/2795440511 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 0x7f418c090070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f418000dbb0 tx=0x7f418000d500).ready entity=mon.2 client_cookie=1866e2f833e32004 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3ffccab700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3ff8091cc0 0x7f3ff8098e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39790/0 (socket says 172.21.15.78:39790) 2024-04-25T02:11:54.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3ffccab700 1 -- 172.21.15.78:0/2641681128 learned_addr learned my addr 172.21.15.78:0/2641681128 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:11:54.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3ffdcad700 1 --2- 172.21.15.78:0/2641681128 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8093850 0x7f3ff8099550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f418959a700 1 -- 172.21.15.78:0/2795440511 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180012070 con 0x7f418c091d20 2024-04-25T02:11:54.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f418959a700 1 -- 172.21.15.78:0/2795440511 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000d2e0 con 0x7f418c091d20 2024-04-25T02:11:54.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3ffd4ac700 1 --2- 172.21.15.78:0/2641681128 >> v2:172.21.15.78:3300/0 conn(0x7f3ff8091620 0x7f3ff8093360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f418959a700 1 -- 172.21.15.78:0/2795440511 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000f860 con 0x7f418c091d20 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3feffff700 1 -- 172.21.15.78:0/2641681128 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195847976 0 0) 0x7f3ff8090550 con 0x7f3ff8091cc0 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3feffff700 1 -- 172.21.15.78:0/2641681128 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe40033f0 con 0x7f3ff8091cc0 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3ffdcad700 1 -- 172.21.15.78:0/2641681128 >> v2:172.21.15.78:3300/0 conn(0x7f3ff8091620 msgr2=0x7f3ff8093360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3ffdcad700 1 --2- 172.21.15.78:0/2641681128 >> v2:172.21.15.78:3300/0 conn(0x7f3ff8091620 0x7f3ff8093360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3ffdcad700 1 -- 172.21.15.78:0/2641681128 >> v1:172.21.15.78:6789/0 conn(0x7f3ff8091cc0 legacy=0x7f3ff8098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3ffdcad700 1 -- 172.21.15.78:0/2641681128 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80907e0 con 0x7f3ff8093850 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.603+0000 7f3ffdcad700 1 --2- 172.21.15.78:0/2641681128 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8093850 0x7f3ff8099550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3ff0009e60 tx=0x7f3ff0009780).ready entity=mon.1 client_cookie=cd6784b7d8d9e85f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f3feffff700 1 -- 172.21.15.78:0/2641681128 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000e070 con 0x7f3ff8093850 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f3feffff700 1 -- 172.21.15.78:0/2641681128 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff000bab0 con 0x7f3ff8093850 2024-04-25T02:11:54.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f3feffff700 1 -- 172.21.15.78:0/2641681128 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000be30 con 0x7f3ff8093850 2024-04-25T02:11:54.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f419087d700 1 -- 172.21.15.78:0/2795440511 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 msgr2=0x7f418c090070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f419087d700 1 --2- 172.21.15.78:0/2795440511 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 0x7f418c090070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f418000dbb0 tx=0x7f418000d500).stop 2024-04-25T02:11:54.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f419087d700 1 -- 172.21.15.78:0/2795440511 shutdown_connections 2024-04-25T02:11:54.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f419087d700 1 --2- 172.21.15.78:0/2795440511 >> v2:172.21.15.78:3300/0 conn(0x7f418c091450 0x7f418c091830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f419087d700 1 --2- 172.21.15.78:0/2795440511 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 0x7f418c090070 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f419087d700 1 -- 172.21.15.78:0/2795440511 >> 172.21.15.78:0/2795440511 conn(0x7f418c0974d0 msgr2=0x7f418c099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f419087d700 1 -- 172.21.15.78:0/2795440511 shutdown_connections 2024-04-25T02:11:54.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f419087d700 1 -- 172.21.15.78:0/2795440511 wait complete. 2024-04-25T02:11:54.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f3fff710700 1 -- 172.21.15.78:0/2641681128 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8093850 msgr2=0x7f3ff8099550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f3fff710700 1 --2- 172.21.15.78:0/2641681128 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8093850 0x7f3ff8099550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3ff0009e60 tx=0x7f3ff0009780).stop 2024-04-25T02:11:54.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f3fff710700 1 -- 172.21.15.78:0/2641681128 shutdown_connections 2024-04-25T02:11:54.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f3fff710700 1 --2- 172.21.15.78:0/2641681128 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8093850 0x7f3ff8099550 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f3fff710700 1 --2- 172.21.15.78:0/2641681128 >> v2:172.21.15.78:3300/0 conn(0x7f3ff8091620 0x7f3ff8093360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.604+0000 7f3fff710700 1 -- 172.21.15.78:0/2641681128 >> 172.21.15.78:0/2641681128 conn(0x7f3ff80974d0 msgr2=0x7f3ff8099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.605+0000 7f419087d700 1 Processor -- start 2024-04-25T02:11:54.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.605+0000 7f3fff710700 1 -- 172.21.15.78:0/2641681128 shutdown_connections 2024-04-25T02:11:54.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.605+0000 7f419087d700 1 -- start start 2024-04-25T02:11:54.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f419087d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f418c090560 0x7f418c123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f419087d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f418c091450 0x7f418c1238f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f419087d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 0x7f418c123de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f419087d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c1269f0 con 0x7f418c090560 2024-04-25T02:11:54.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f419087d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c124d40 con 0x7f418c091450 2024-04-25T02:11:54.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f419087d700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f418c093f00 con 0x7f418c091d20 2024-04-25T02:11:54.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f3fff710700 1 -- 172.21.15.78:0/2641681128 wait complete. 2024-04-25T02:11:54.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f4189d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f418c091450 0x7f418c1238f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f4189d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f418c091450 0x7f418c1238f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51480/0 (socket says 172.21.15.78:51480) 2024-04-25T02:11:54.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f4189d9b700 1 -- 172.21.15.78:0/1430571968 learned_addr learned my addr 172.21.15.78:0/1430571968 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f418a59c700 1 --2- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f418c090560 0x7f418c123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f418ad9d700 1 --2- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 0x7f418c123de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f4189d9b700 1 -- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 msgr2=0x7f418c123de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f4189d9b700 1 --2- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 0x7f418c123de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f4189d9b700 1 -- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f418c090560 msgr2=0x7f418c123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f4189d9b700 1 --2- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f418c090560 0x7f418c123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f4189d9b700 1 -- 172.21.15.78:0/1430571968 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418000d740 con 0x7f418c091450 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f418ad9d700 1 --2- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f418c091d20 0x7f418c123de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f418a59c700 1 --2- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f418c090560 0x7f418c123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.606+0000 7f4189d9b700 1 --2- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f418c091450 0x7f418c1238f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4180014000 tx=0x7f418000d500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.607+0000 7f417affd700 1 -- 172.21.15.78:0/1430571968 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180006910 con 0x7f418c091450 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.607+0000 7f417affd700 1 -- 172.21.15.78:0/1430571968 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000bbc0 con 0x7f418c091450 2024-04-25T02:11:54.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.607+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c095ca0 con 0x7f418c091450 2024-04-25T02:11:54.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.607+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c1274e0 con 0x7f418c091450 2024-04-25T02:11:54.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.607+0000 7f3fff710700 1 Processor -- start 2024-04-25T02:11:54.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.607+0000 7f417affd700 1 -- 172.21.15.78:0/1430571968 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180023480 con 0x7f418c091450 2024-04-25T02:11:54.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.607+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4170000fc0 con 0x7f418c091450 2024-04-25T02:11:54.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f417affd700 1 -- 172.21.15.78:0/1430571968 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f4180017420 con 0x7f418c091450 2024-04-25T02:11:54.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.607+0000 7f3fff710700 1 -- start start 2024-04-25T02:11:54.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f417affd700 1 -- 172.21.15.78:0/1430571968 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f41800408b0 con 0x7f418c091450 2024-04-25T02:11:54.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f417affd700 1 -- 172.21.15.78:0/1430571968 --> v1:172.21.15.78:6808/47116 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f416c038900 con 0x7f416c034bf0 2024-04-25T02:11:54.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3fff710700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8091620 0x7f3ff8069710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3fff710700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3ff8093850 0x7f3ff80873b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3fff710700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff80878a0 0x7f3ff8087d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3fff710700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff808f4d0 con 0x7f3ff80878a0 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3fff710700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff806aba0 con 0x7f3ff8091620 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3fff710700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80943b0 con 0x7f3ff8093850 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3ffdcad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff80878a0 0x7f3ff8087d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3ffdcad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff80878a0 0x7f3ff8087d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60606/0 (socket says 172.21.15.78:60606) 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3ffdcad700 1 -- 172.21.15.78:0/2894310107 learned_addr learned my addr 172.21.15.78:0/2894310107 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3ffd4ac700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8091620 0x7f3ff8069710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f3ffccab700 1 --2- 172.21.15.78:0/2894310107 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3ff8093850 0x7f3ff80873b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3ffdcad700 1 -- 172.21.15.78:0/2894310107 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3ff8093850 msgr2=0x7f3ff80873b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3ffdcad700 1 --2- 172.21.15.78:0/2894310107 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3ff8093850 0x7f3ff80873b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3ffdcad700 1 -- 172.21.15.78:0/2894310107 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8091620 msgr2=0x7f3ff8069710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3ffdcad700 1 --2- 172.21.15.78:0/2894310107 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3ff8091620 0x7f3ff8069710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3ffdcad700 1 -- 172.21.15.78:0/2894310107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff0009a20 con 0x7f3ff80878a0 2024-04-25T02:11:54.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.608+0000 7f417affd700 1 -- 172.21.15.78:0/1430571968 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41800176d0 con 0x7f418c091450 2024-04-25T02:11:54.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3ffccab700 1 --2- 172.21.15.78:0/2894310107 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3ff8093850 0x7f3ff80873b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3ffdcad700 1 --2- 172.21.15.78:0/2894310107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff80878a0 0x7f3ff8087d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f3ff000b610 tx=0x7f3ff809ae60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3fedffb700 1 -- 172.21.15.78:0/2894310107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0021070 con 0x7f3ff80878a0 2024-04-25T02:11:54.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3fedffb700 1 -- 172.21.15.78:0/2894310107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0013e70 con 0x7f3ff80878a0 2024-04-25T02:11:54.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3fedffb700 1 -- 172.21.15.78:0/2894310107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff001d860 con 0x7f3ff80878a0 2024-04-25T02:11:54.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff81381e0 con 0x7f3ff80878a0 2024-04-25T02:11:54.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.609+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff808ef50 con 0x7f3ff80878a0 2024-04-25T02:11:54.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.610+0000 7f417affd700 1 -- 172.21.15.78:0/1430571968 <== osd.2 v1:172.21.15.78:6808/47116 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f416c038900 con 0x7f416c034bf0 2024-04-25T02:11:54.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.610+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ff808a2a0 con 0x7f3ff80878a0 2024-04-25T02:11:54.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.611+0000 7f3fedffb700 1 -- 172.21.15.78:0/2894310107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f3ff0003040 con 0x7f3ff80878a0 2024-04-25T02:11:54.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.611+0000 7f3fedffb700 1 -- 172.21.15.78:0/2894310107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f3ff003cfb0 con 0x7f3ff80878a0 2024-04-25T02:11:54.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.611+0000 7f3fedffb700 1 -- 172.21.15.78:0/2894310107 --> v1:172.21.15.78:6800/47106 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fdc0389b0 con 0x7f3fdc034ca0 2024-04-25T02:11:54.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.611+0000 7f3fedffb700 1 -- 172.21.15.78:0/2894310107 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ff003f510 con 0x7f3ff80878a0 2024-04-25T02:11:54.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.615+0000 7f3fedffb700 1 -- 172.21.15.78:0/2894310107 <== osd.1 v1:172.21.15.78:6800/47106 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f3fdc0389b0 con 0x7f3fdc034ca0 2024-04-25T02:11:54.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 --> v1:172.21.15.78:6804/47107 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7938002b10 con 0x7f7934034bf0 2024-04-25T02:11:54.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 --> v1:172.21.15.78:6809/47117 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe5c8098710 con 0x7fe5b4034d40 2024-04-25T02:11:54.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7f79467fc700 1 -- 172.21.15.78:0/2448328510 <== osd.0 v1:172.21.15.78:6804/47107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3078851935) 0x7f7938002b10 con 0x7f7934034bf0 2024-04-25T02:11:54.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7fe5affff700 1 -- 172.21.15.78:0/406616900 <== osd.3 v1:172.21.15.78:6809/47117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3078851935) 0x7fe5c8098710 con 0x7fe5b4034d40 2024-04-25T02:11:54.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 >> v1:172.21.15.78:6804/47107 conn(0x7f7934034bf0 legacy=0x7f7934037090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 >> v1:172.21.15.78:6809/47117 conn(0x7fe5b4034d40 legacy=0x7fe5b40371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 >> v1:172.21.15.78:6816/46507 conn(0x7f793402bd00 legacy=0x7f793402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950091620 msgr2=0x7f7950069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7f7957b07700 1 --2- 172.21.15.78:0/2448328510 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7950091620 0x7f7950069650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f794c00c440 tx=0x7f794c007d30).stop 2024-04-25T02:11:54.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7f79560a4700 1 -- 172.21.15.78:0/2448328510 reap_dead start 2024-04-25T02:11:54.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.631+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 shutdown_connections 2024-04-25T02:11:54.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.631+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 >> 172.21.15.78:0/2448328510 conn(0x7f79500974d0 msgr2=0x7f7950094860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 >> v1:172.21.15.78:6816/46507 conn(0x7fe5b402bd50 legacy=0x7fe5b402e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8098e40 msgr2=0x7fe5c808f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.630+0000 7fe5ce1a4700 1 --2- 172.21.15.78:0/406616900 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe5c8098e40 0x7fe5c808f100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe5b800c4c0 tx=0x7fe5b8007e00).stop 2024-04-25T02:11:54.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.631+0000 7fe5c7fff700 1 -- 172.21.15.78:0/406616900 reap_dead start 2024-04-25T02:11:54.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.631+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 shutdown_connections 2024-04-25T02:11:54.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.631+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 >> 172.21.15.78:0/406616900 conn(0x7fe5c80974d0 msgr2=0x7fe5c8097d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.631+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 shutdown_connections 2024-04-25T02:11:54.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.631+0000 7fe5ce1a4700 1 -- 172.21.15.78:0/406616900 wait complete. 2024-04-25T02:11:54.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.631+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 shutdown_connections 2024-04-25T02:11:54.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.631+0000 7f7957b07700 1 -- 172.21.15.78:0/2448328510 wait complete. 2024-04-25T02:11:54.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.634+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 --> v1:172.21.15.78:6808/47116 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4170002b10 con 0x7f416c034bf0 2024-04-25T02:11:54.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f417affd700 1 -- 172.21.15.78:0/1430571968 <== osd.2 v1:172.21.15.78:6808/47116 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1172835932) 0x7f4170002b10 con 0x7f416c034bf0 2024-04-25T02:11:54.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 >> v1:172.21.15.78:6808/47116 conn(0x7f416c034bf0 legacy=0x7f416c037090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 >> v1:172.21.15.78:6816/46507 conn(0x7f416c02bd00 legacy=0x7f416c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f418c091450 msgr2=0x7f418c1238f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f419087d700 1 --2- 172.21.15.78:0/1430571968 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f418c091450 0x7f418c1238f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4180014000 tx=0x7f418000d500).stop 2024-04-25T02:11:54.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f418ad9d700 1 -- 172.21.15.78:0/1430571968 reap_dead start 2024-04-25T02:11:54.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 shutdown_connections 2024-04-25T02:11:54.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 >> 172.21.15.78:0/1430571968 conn(0x7f418c0974d0 msgr2=0x7f418c094930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 shutdown_connections 2024-04-25T02:11:54.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.635+0000 7f419087d700 1 -- 172.21.15.78:0/1430571968 wait complete. 2024-04-25T02:11:54.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.643+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 --> v1:172.21.15.78:6800/47106 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ff809a660 con 0x7f3fdc034ca0 2024-04-25T02:11:54.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.643+0000 7f3fedffb700 1 -- 172.21.15.78:0/2894310107 <== osd.1 v1:172.21.15.78:6800/47106 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1172835932) 0x7f3ff809a660 con 0x7f3fdc034ca0 2024-04-25T02:11:54.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.644+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 >> v1:172.21.15.78:6800/47106 conn(0x7f3fdc034ca0 legacy=0x7f3fdc037140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.644+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 >> v1:172.21.15.78:6816/46507 conn(0x7f3fdc02bd30 legacy=0x7f3fdc02e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.644+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff80878a0 msgr2=0x7f3ff8087d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.644+0000 7f3fff710700 1 --2- 172.21.15.78:0/2894310107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff80878a0 0x7f3ff8087d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f3ff000b610 tx=0x7f3ff809ae60).stop 2024-04-25T02:11:54.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.644+0000 7f3ffdcad700 1 -- 172.21.15.78:0/2894310107 reap_dead start 2024-04-25T02:11:54.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.644+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 shutdown_connections 2024-04-25T02:11:54.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.644+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 >> 172.21.15.78:0/2894310107 conn(0x7f3ff80974d0 msgr2=0x7f3ff80864f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.644+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 shutdown_connections 2024-04-25T02:11:54.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.644+0000 7f3fff710700 1 -- 172.21.15.78:0/2894310107 wait complete. 2024-04-25T02:11:54.666 INFO:teuthology.orchestra.run.smithi078.stdout:38654705690 2024-04-25T02:11:54.667 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:11:54.668 INFO:teuthology.orchestra.run.smithi078.stdout:38654705690 2024-04-25T02:11:54.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:11:54.669 INFO:teuthology.orchestra.run.smithi078.stdout:38654705691 2024-04-25T02:11:54.669 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:11:54.670 INFO:teuthology.orchestra.run.smithi078.stdout:38654705691 2024-04-25T02:11:54.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:11:54.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.826+0000 7f613e873700 1 Processor -- start 2024-04-25T02:11:54.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.826+0000 7f613e873700 1 -- start start 2024-04-25T02:11:54.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.826+0000 7fd0a8e06700 1 Processor -- start 2024-04-25T02:11:54.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7fd0a8e06700 1 -- start start 2024-04-25T02:11:54.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f613e873700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138098e40 0x7f6138099220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f613e873700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138130860 0x7f6138132c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7fd0a8e06700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 0x7fd0a4099950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7fd0a8e06700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0a412e130 0x7fd0a4130520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7fd0a8e06700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40682e0 con 0x7fd0a405e960 2024-04-25T02:11:54.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7fd0a8e06700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a406ad80 con 0x7fd0a412e130 2024-04-25T02:11:54.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7fd0a8e06700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a405ed40 con 0x7fd0a4099550 2024-04-25T02:11:54.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f613e873700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6138092070 con 0x7f6138099710 2024-04-25T02:11:54.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f613e873700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6138092ff0 con 0x7f6138098e40 2024-04-25T02:11:54.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f613e873700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61380978e0 con 0x7f6138130860 2024-04-25T02:11:54.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f6137fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138098e40 0x7f6138099220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f6137fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138098e40 0x7f6138099220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51500/0 (socket says 172.21.15.78:51500) 2024-04-25T02:11:54.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f6137fff700 1 -- 172.21.15.78:0/1694920201 learned_addr learned my addr 172.21.15.78:0/1694920201 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f613ce10700 1 --2- 172.21.15.78:0/1694920201 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138130860 0x7f6138132c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7fd0a2d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0a412e130 0x7fd0a4130520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7fd0a2d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0a412e130 0x7fd0a4130520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60616/0 (socket says 172.21.15.78:60616) 2024-04-25T02:11:54.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7fd0a2d9d700 1 -- 172.21.15.78:0/309883826 learned_addr learned my addr 172.21.15.78:0/309883826 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.827+0000 7f613ce10700 1 -- 172.21.15.78:0/1694920201 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138098e40 msgr2=0x7f6138099220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7f613ce10700 1 --2- 172.21.15.78:0/1694920201 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138098e40 0x7f6138099220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7f613ce10700 1 -- 172.21.15.78:0/1694920201 >> v1:172.21.15.78:6789/0 conn(0x7f6138099710 legacy=0x7f613812f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7f613ce10700 1 -- 172.21.15.78:0/1694920201 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138090e50 con 0x7f6138130860 2024-04-25T02:11:54.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a1d9b700 1 --2- 172.21.15.78:0/309883826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 0x7fd0a4099950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7f6137fff700 1 --2- 172.21.15.78:0/1694920201 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138098e40 0x7f6138099220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:54.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7f613ce10700 1 --2- 172.21.15.78:0/1694920201 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138130860 0x7f6138132c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6130009e90 tx=0x7f6130009780).ready entity=mon.2 client_cookie=2c3c0851819cccbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a1d9b700 1 -- 172.21.15.78:0/309883826 >> v2:172.21.15.78:3300/0 conn(0x7fd0a412e130 msgr2=0x7fd0a4130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a1d9b700 1 --2- 172.21.15.78:0/309883826 >> v2:172.21.15.78:3300/0 conn(0x7fd0a412e130 0x7fd0a4130520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a1d9b700 1 -- 172.21.15.78:0/309883826 >> v1:172.21.15.78:6789/0 conn(0x7fd0a405e960 legacy=0x7fd0a4098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a1d9b700 1 -- 172.21.15.78:0/309883826 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a4069060 con 0x7fd0a4099550 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a2d9d700 1 --2- 172.21.15.78:0/309883826 >> v2:172.21.15.78:3300/0 conn(0x7fd0a412e130 0x7fd0a4130520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a1d9b700 1 --2- 172.21.15.78:0/309883826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 0x7fd0a4099950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd098009760 tx=0x7fd098009060).ready entity=mon.1 client_cookie=7283913f6d5d3890 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a159a700 1 -- 172.21.15.78:0/309883826 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800f510 con 0x7fd0a4099550 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a159a700 1 -- 172.21.15.78:0/309883826 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800f670 con 0x7fd0a4099550 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.828+0000 7fd0a159a700 1 -- 172.21.15.78:0/309883826 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800f9f0 con 0x7fd0a4099550 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.829+0000 7fd0a8e06700 1 -- 172.21.15.78:0/309883826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 msgr2=0x7fd0a4099950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.829+0000 7fd0a8e06700 1 --2- 172.21.15.78:0/309883826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 0x7fd0a4099950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd098009760 tx=0x7fd098009060).stop 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.829+0000 7fd0a8e06700 1 -- 172.21.15.78:0/309883826 shutdown_connections 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.829+0000 7fd0a8e06700 1 --2- 172.21.15.78:0/309883826 >> v2:172.21.15.78:3300/0 conn(0x7fd0a412e130 0x7fd0a4130520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.829+0000 7fd0a8e06700 1 --2- 172.21.15.78:0/309883826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 0x7fd0a4099950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.829+0000 7fd0a8e06700 1 -- 172.21.15.78:0/309883826 >> 172.21.15.78:0/309883826 conn(0x7fd0a40974d0 msgr2=0x7fd0a4099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.829+0000 7fd0a8e06700 1 -- 172.21.15.78:0/309883826 shutdown_connections 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.829+0000 7fd0a8e06700 1 -- 172.21.15.78:0/309883826 wait complete. 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.830+0000 7fd0a8e06700 1 Processor -- start 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.830+0000 7fd0a8e06700 1 -- start start 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a8e06700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a405e960 0x7fd0a408e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a8e06700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 0x7fd0a412d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a8e06700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a412e130 0x7fd0a412d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a8e06700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4091000 con 0x7fd0a412e130 2024-04-25T02:11:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a8e06700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a408bdf0 con 0x7fd0a4099550 2024-04-25T02:11:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a8e06700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a408d7d0 con 0x7fd0a405e960 2024-04-25T02:11:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a259c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a405e960 0x7fd0a408e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a1d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 0x7fd0a412d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a259c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a405e960 0x7fd0a408e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42234/0 (socket says 172.21.15.78:42234) 2024-04-25T02:11:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a259c700 1 -- 172.21.15.78:0/1503517552 learned_addr learned my addr 172.21.15.78:0/1503517552 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7f6136ffd700 1 -- 172.21.15.78:0/1694920201 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613000e070 con 0x7f6138130860 2024-04-25T02:11:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7f6136ffd700 1 -- 172.21.15.78:0/1694920201 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613000bc30 con 0x7f6138130860 2024-04-25T02:11:54.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7f6136ffd700 1 -- 172.21.15.78:0/1694920201 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130012410 con 0x7f6138130860 2024-04-25T02:11:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a2d9d700 1 --2- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a412e130 0x7fd0a412d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a2d9d700 1 -- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a405e960 msgr2=0x7fd0a408e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a2d9d700 1 --2- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a405e960 0x7fd0a408e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a2d9d700 1 -- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 msgr2=0x7fd0a412d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a2d9d700 1 --2- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 0x7fd0a412d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a2d9d700 1 -- 172.21.15.78:0/1503517552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c009ae0 con 0x7fd0a412e130 2024-04-25T02:11:54.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.831+0000 7fd0a2d9d700 1 --2- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a412e130 0x7fd0a412d840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd09c009f10 tx=0x7fd09c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7f613e873700 1 -- 172.21.15.78:0/1694920201 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138130860 msgr2=0x7f6138132c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7f613e873700 1 --2- 172.21.15.78:0/1694920201 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138130860 0x7f6138132c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6130009e90 tx=0x7f6130009780).stop 2024-04-25T02:11:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7f613e873700 1 -- 172.21.15.78:0/1694920201 shutdown_connections 2024-04-25T02:11:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7f613e873700 1 --2- 172.21.15.78:0/1694920201 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138130860 0x7f6138132c50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7f613e873700 1 --2- 172.21.15.78:0/1694920201 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138098e40 0x7f6138099220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7f613e873700 1 -- 172.21.15.78:0/1694920201 >> 172.21.15.78:0/1694920201 conn(0x7f61380974d0 msgr2=0x7f6138099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7fd092ffd700 1 -- 172.21.15.78:0/1503517552 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0092e0 con 0x7fd0a412e130 2024-04-25T02:11:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7fd092ffd700 1 -- 172.21.15.78:0/1503517552 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c00f040 con 0x7fd0a412e130 2024-04-25T02:11:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7fd092ffd700 1 -- 172.21.15.78:0/1503517552 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00cc20 con 0x7fd0a412e130 2024-04-25T02:11:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7f613e873700 1 -- 172.21.15.78:0/1694920201 shutdown_connections 2024-04-25T02:11:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7f613e873700 1 -- 172.21.15.78:0/1694920201 wait complete. 2024-04-25T02:11:54.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0980092a0 con 0x7fd0a412e130 2024-04-25T02:11:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.832+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a40684a0 con 0x7fd0a412e130 2024-04-25T02:11:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.833+0000 7f613e873700 1 Processor -- start 2024-04-25T02:11:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.833+0000 7fd092ffd700 1 -- 172.21.15.78:0/1503517552 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fd09c014460 con 0x7fd0a412e130 2024-04-25T02:11:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.833+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a4090e50 con 0x7fd0a412e130 2024-04-25T02:11:54.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.833+0000 7f613e873700 1 -- start start 2024-04-25T02:11:54.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.833+0000 7fd092ffd700 1 -- 172.21.15.78:0/1503517552 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fd09c03b350 con 0x7fd0a412e130 2024-04-25T02:11:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f613e873700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138098e40 0x7f613808f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f613e873700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138099710 0x7f613808e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f613e873700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6138130860 0x7f613808b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f613e873700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613808d960 con 0x7f6138130860 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f613e873700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6138091ac0 con 0x7f6138099710 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f613e873700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f613808f9b0 con 0x7f6138098e40 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f61377fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138099710 0x7f613808e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f61377fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138099710 0x7f613808e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51540/0 (socket says 172.21.15.78:51540) 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f61377fe700 1 -- 172.21.15.78:0/2228752057 learned_addr learned my addr 172.21.15.78:0/2228752057 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f6137fff700 1 --2- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138098e40 0x7f613808f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f613ce10700 1 --2- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6138130860 0x7f613808b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f61377fe700 1 -- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138098e40 msgr2=0x7f613808f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f61377fe700 1 --2- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138098e40 0x7f613808f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f61377fe700 1 -- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6138130860 msgr2=0x7f613808b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f61377fe700 1 --2- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6138130860 0x7f613808b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f61377fe700 1 -- 172.21.15.78:0/2228752057 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130009a20 con 0x7f6138099710 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f61377fe700 1 --2- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138099710 0x7f613808e1e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f612c00c4c0 tx=0x7f612c007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f6134ff9700 1 -- 172.21.15.78:0/2228752057 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c007020 con 0x7f6138099710 2024-04-25T02:11:54.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f6134ff9700 1 -- 172.21.15.78:0/2228752057 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c007180 con 0x7f6138099710 2024-04-25T02:11:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f6134ff9700 1 -- 172.21.15.78:0/2228752057 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c007540 con 0x7f6138099710 2024-04-25T02:11:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.834+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613808ddb0 con 0x7f6138099710 2024-04-25T02:11:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.835+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613808eaf0 con 0x7f6138099710 2024-04-25T02:11:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.835+0000 7f6134ff9700 1 -- 172.21.15.78:0/2228752057 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f612c0068b0 con 0x7f6138099710 2024-04-25T02:11:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.835+0000 7f6134ff9700 1 -- 172.21.15.78:0/2228752057 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f612c03a6c0 con 0x7f6138099710 2024-04-25T02:11:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.837+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613809a660 con 0x7f6138099710 2024-04-25T02:11:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.841+0000 7fd092ffd700 1 -- 172.21.15.78:0/1503517552 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fd09c012540 con 0x7fd0a412e130 2024-04-25T02:11:54.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.842+0000 7f6134ff9700 1 -- 172.21.15.78:0/2228752057 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f612c010300 con 0x7f6138099710 2024-04-25T02:11:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.842+0000 7fa284f3a700 1 Processor -- start 2024-04-25T02:11:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.842+0000 7fa284f3a700 1 -- start start 2024-04-25T02:11:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.843+0000 7fa284f3a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2800961a0 0x7fa2800937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.843+0000 7fa284f3a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2801243e0 0x7fa280127bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.843+0000 7fa284f3a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa280096cf0 con 0x7fa280124000 2024-04-25T02:11:54.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.843+0000 7fa284f3a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa280124850 con 0x7fa2801243e0 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.843+0000 7fa284f3a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa280092d00 con 0x7fa2800961a0 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.843+0000 7fa27ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2801243e0 0x7fa280127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.843+0000 7fa27ed9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2801243e0 0x7fa280127bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60652/0 (socket says 172.21.15.78:60652) 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.843+0000 7fa27ed9d700 1 -- 172.21.15.78:0/1298552847 learned_addr learned my addr 172.21.15.78:0/1298552847 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.843+0000 7fa27e59c700 1 --1- 172.21.15.78:0/1298552847 >> v1:172.21.15.78:6789/0 conn(0x7fa280124000 0x7fa2801274e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39822/0 (socket says 172.21.15.78:39822) 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.844+0000 7fa27ed9d700 1 -- 172.21.15.78:0/1298552847 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2800961a0 msgr2=0x7fa2800937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.844+0000 7fa27ed9d700 1 --2- 172.21.15.78:0/1298552847 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2800961a0 0x7fa2800937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.844+0000 7fa27ed9d700 1 -- 172.21.15.78:0/1298552847 >> v1:172.21.15.78:6789/0 conn(0x7fa280124000 legacy=0x7fa2801274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.844+0000 7fa27ed9d700 1 -- 172.21.15.78:0/1298552847 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800933a0 con 0x7fa2801243e0 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.844+0000 7fa27ed9d700 1 --2- 172.21.15.78:0/1298552847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2801243e0 0x7fa280127bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa278009f50 tx=0x7fa278009840).ready entity=mon.0 client_cookie=527bb07da31297fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.844+0000 7fa27d59a700 1 -- 172.21.15.78:0/1298552847 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800e070 con 0x7fa2801243e0 2024-04-25T02:11:54.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.844+0000 7fa27d59a700 1 -- 172.21.15.78:0/1298552847 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800b9b0 con 0x7fa2801243e0 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.844+0000 7fa27d59a700 1 -- 172.21.15.78:0/1298552847 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800bd30 con 0x7fa2801243e0 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.845+0000 7fa284f3a700 1 -- 172.21.15.78:0/1298552847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2801243e0 msgr2=0x7fa280127bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.845+0000 7fa284f3a700 1 --2- 172.21.15.78:0/1298552847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2801243e0 0x7fa280127bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa278009f50 tx=0x7fa278009840).stop 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.845+0000 7fa284f3a700 1 -- 172.21.15.78:0/1298552847 shutdown_connections 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.845+0000 7fa284f3a700 1 --2- 172.21.15.78:0/1298552847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2801243e0 0x7fa280127bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.845+0000 7fa284f3a700 1 --2- 172.21.15.78:0/1298552847 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2800961a0 0x7fa2800937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.845+0000 7fa284f3a700 1 -- 172.21.15.78:0/1298552847 >> 172.21.15.78:0/1298552847 conn(0x7fa280097450 msgr2=0x7fa280097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.845+0000 7fa284f3a700 1 -- 172.21.15.78:0/1298552847 shutdown_connections 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.845+0000 7fa284f3a700 1 -- 172.21.15.78:0/1298552847 wait complete. 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.846+0000 7fa284f3a700 1 Processor -- start 2024-04-25T02:11:54.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.846+0000 7fa284f3a700 1 -- start start 2024-04-25T02:11:54.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.846+0000 7fa284f3a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2800961a0 0x7fa280069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.846+0000 7fa284f3a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa280124000 0x7fa280137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.846+0000 7fa284f3a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2801243e0 0x7fa280138420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.846+0000 7fa284f3a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28012b2f0 con 0x7fa2800961a0 2024-04-25T02:11:54.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.846+0000 7fa284f3a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28012b580 con 0x7fa280124000 2024-04-25T02:11:54.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.846+0000 7fa284f3a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa280092440 con 0x7fa2801243e0 2024-04-25T02:11:54.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7f8b93f33700 1 Processor -- start 2024-04-25T02:11:54.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2800961a0 0x7fa280069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27dd9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa280124000 0x7fa280137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2800961a0 0x7fa280069c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60666/0 (socket says 172.21.15.78:60666) 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27e59c700 1 -- 172.21.15.78:0/3412582094 learned_addr learned my addr 172.21.15.78:0/3412582094 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27dd9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa280124000 0x7fa280137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51542/0 (socket says 172.21.15.78:51542) 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27ed9d700 1 --2- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2801243e0 0x7fa280138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27ed9d700 1 -- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa280124000 msgr2=0x7fa280137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27ed9d700 1 --2- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa280124000 0x7fa280137f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27ed9d700 1 -- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2800961a0 msgr2=0x7fa280069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27ed9d700 1 --2- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2800961a0 0x7fa280069c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27ed9d700 1 -- 172.21.15.78:0/3412582094 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278009ae0 con 0x7fa2801243e0 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27dd9b700 1 --2- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa280124000 0x7fa280137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa27ed9d700 1 --2- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2801243e0 0x7fa280138420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa278012000 tx=0x7fa278009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7f8b93f33700 1 -- start start 2024-04-25T02:11:54.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa26effd700 1 -- 172.21.15.78:0/3412582094 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780092e0 con 0x7fa2801243e0 2024-04-25T02:11:54.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa26effd700 1 -- 172.21.15.78:0/3412582094 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa278007610 con 0x7fa2801243e0 2024-04-25T02:11:54.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.847+0000 7fa26effd700 1 -- 172.21.15.78:0/3412582094 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780079d0 con 0x7fa2801243e0 2024-04-25T02:11:54.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.848+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28012c170 con 0x7fa2801243e0 2024-04-25T02:11:54.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.848+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa280137b80 con 0x7fa2801243e0 2024-04-25T02:11:54.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.848+0000 7f8b93f33700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c065d90 0x7f8b8c0962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.848+0000 7f8b93f33700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b8c0967d0 0x7f8b8c096c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.848+0000 7f8b93f33700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c1314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.848+0000 7f8b93f33700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8c066170 con 0x7f8b8c0967d0 2024-04-25T02:11:54.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.848+0000 7f8b93f33700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c064640 con 0x7f8b8c065d90 2024-04-25T02:11:54.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.848+0000 7f8b93f33700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c065040 con 0x7f8b8c12f0d0 2024-04-25T02:11:54.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b924d0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c1314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b924d0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c1314c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42266/0 (socket says 172.21.15.78:42266) 2024-04-25T02:11:54.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b924d0700 1 -- 172.21.15.78:0/3329881140 learned_addr learned my addr 172.21.15.78:0/3329881140 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.848+0000 7fa26effd700 1 -- 172.21.15.78:0/3412582094 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fa278003020 con 0x7fa2801243e0 2024-04-25T02:11:54.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7fa26effd700 1 -- 172.21.15.78:0/3412582094 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fa27803c4d0 con 0x7fa2801243e0 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b914ce700 1 --2- 172.21.15.78:0/3329881140 >> v2:172.21.15.78:3300/0 conn(0x7f8b8c0967d0 0x7f8b8c096c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b91ccf700 1 --2- 172.21.15.78:0/3329881140 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c065d90 0x7f8b8c0962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b91ccf700 1 -- 172.21.15.78:0/3329881140 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 msgr2=0x7f8b8c1314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b91ccf700 1 --2- 172.21.15.78:0/3329881140 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c1314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b91ccf700 1 -- 172.21.15.78:0/3329881140 >> v2:172.21.15.78:3300/0 conn(0x7f8b8c0967d0 msgr2=0x7f8b8c096c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b91ccf700 1 --2- 172.21.15.78:0/3329881140 >> v2:172.21.15.78:3300/0 conn(0x7f8b8c0967d0 0x7f8b8c096c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b91ccf700 1 -- 172.21.15.78:0/3329881140 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c0652d0 con 0x7f8b8c065d90 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b914ce700 1 --2- 172.21.15.78:0/3329881140 >> v2:172.21.15.78:3300/0 conn(0x7f8b8c0967d0 0x7f8b8c096c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b924d0700 1 --2- 172.21.15.78:0/3329881140 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c1314c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b91ccf700 1 --2- 172.21.15.78:0/3329881140 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c065d90 0x7f8b8c0962e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8b7c009760 tx=0x7f8b7c009060).ready entity=mon.1 client_cookie=832bd32b57bc5d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b90ccd700 1 -- 172.21.15.78:0/3329881140 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0090d0 con 0x7f8b8c065d90 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b90ccd700 1 -- 172.21.15.78:0/3329881140 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c00f510 con 0x7f8b8c065d90 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.849+0000 7f8b90ccd700 1 -- 172.21.15.78:0/3329881140 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00f890 con 0x7f8b8c065d90 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.850+0000 7f8b93f33700 1 -- 172.21.15.78:0/3329881140 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c065d90 msgr2=0x7f8b8c0962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.850+0000 7f8b93f33700 1 --2- 172.21.15.78:0/3329881140 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c065d90 0x7f8b8c0962e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8b7c009760 tx=0x7f8b7c009060).stop 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.850+0000 7f8b93f33700 1 -- 172.21.15.78:0/3329881140 shutdown_connections 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.850+0000 7f8b93f33700 1 --2- 172.21.15.78:0/3329881140 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c065d90 0x7f8b8c0962e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.850+0000 7f8b93f33700 1 --2- 172.21.15.78:0/3329881140 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c1314c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.850+0000 7f8b93f33700 1 --2- 172.21.15.78:0/3329881140 >> v2:172.21.15.78:3300/0 conn(0x7f8b8c0967d0 0x7f8b8c096c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.850+0000 7f8b93f33700 1 -- 172.21.15.78:0/3329881140 >> 172.21.15.78:0/3329881140 conn(0x7f8b8c09c550 msgr2=0x7f8b8c0983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.850+0000 7f8b93f33700 1 -- 172.21.15.78:0/3329881140 shutdown_connections 2024-04-25T02:11:54.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.850+0000 7f8b93f33700 1 -- 172.21.15.78:0/3329881140 wait complete. 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.851+0000 7f8b93f33700 1 Processor -- start 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.851+0000 7f8b93f33700 1 -- start start 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b93f33700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c0967d0 0x7f8b8c1166f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b93f33700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c116be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b93f33700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b8c1170d0 0x7f8b8c13a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b93f33700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c118df0 con 0x7f8b8c1170d0 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b93f33700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c11aea0 con 0x7f8b8c0967d0 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b93f33700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c0694a0 con 0x7f8b8c12f0d0 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b924d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b8c1170d0 0x7f8b8c13a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b91ccf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c0967d0 0x7f8b8c1166f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b91ccf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c0967d0 0x7f8b8c1166f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51564/0 (socket says 172.21.15.78:51564) 2024-04-25T02:11:54.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b924d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b8c1170d0 0x7f8b8c13a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60684/0 (socket says 172.21.15.78:60684) 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b91ccf700 1 -- 172.21.15.78:0/2897397839 learned_addr learned my addr 172.21.15.78:0/2897397839 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b914ce700 1 --2- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c116be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b91ccf700 1 -- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 msgr2=0x7f8b8c116be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b91ccf700 1 --2- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c116be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b91ccf700 1 -- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b8c1170d0 msgr2=0x7f8b8c13a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b91ccf700 1 --2- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b8c1170d0 0x7f8b8c13a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b91ccf700 1 -- 172.21.15.78:0/2897397839 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b880092a0 con 0x7f8b8c0967d0 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.852+0000 7f8b924d0700 1 --2- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b8c1170d0 0x7f8b8c13a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.853+0000 7f8b91ccf700 1 --2- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c0967d0 0x7f8b8c1166f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8b7c009e00 tx=0x7f8b7c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.853+0000 7f8b827fc700 1 -- 172.21.15.78:0/2897397839 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0118c0 con 0x7f8b8c0967d0 2024-04-25T02:11:54.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.853+0000 7f8b827fc700 1 -- 172.21.15.78:0/2897397839 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c011a40 con 0x7f8b8c0967d0 2024-04-25T02:11:54.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.853+0000 7f8b827fc700 1 -- 172.21.15.78:0/2897397839 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c011e00 con 0x7f8b8c0967d0 2024-04-25T02:11:54.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.853+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c0092a0 con 0x7f8b8c0967d0 2024-04-25T02:11:54.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.853+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8c117530 con 0x7f8b8c0967d0 2024-04-25T02:11:54.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.854+0000 7f8b827fc700 1 -- 172.21.15.78:0/2897397839 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f8b7c01b650 con 0x7f8b8c0967d0 2024-04-25T02:11:54.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.854+0000 7f8b827fc700 1 -- 172.21.15.78:0/2897397839 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f8b7c03c610 con 0x7f8b8c0967d0 2024-04-25T02:11:54.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.854+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8c098af0 con 0x7f8b8c0967d0 2024-04-25T02:11:54.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.855+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa280097f70 con 0x7fa2801243e0 2024-04-25T02:11:54.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.859+0000 7f8b827fc700 1 -- 172.21.15.78:0/2897397839 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f8b7c025460 con 0x7f8b8c0967d0 2024-04-25T02:11:54.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:54.860+0000 7fa26effd700 1 -- 172.21.15.78:0/3412582094 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fa278007dc0 con 0x7fa2801243e0 2024-04-25T02:11:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.013+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd0a4095bc0 con 0x7fd0a412e130 2024-04-25T02:11:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.014+0000 7fd092ffd700 1 -- 172.21.15.78:0/1503517552 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd09c01d3b0 con 0x7fd0a412e130 2024-04-25T02:11:55.021 INFO:teuthology.orchestra.run.smithi078.stdout:38654705689 2024-04-25T02:11:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.016+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 >> v1:172.21.15.78:6816/46507 conn(0x7fd08402bd50 legacy=0x7fd08402e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.016+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a412e130 msgr2=0x7fd0a412d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.016+0000 7fd0a8e06700 1 --2- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a412e130 0x7fd0a412d840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd09c009f10 tx=0x7fd09c00b040).stop 2024-04-25T02:11:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.017+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 shutdown_connections 2024-04-25T02:11:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.017+0000 7fd0a8e06700 1 --2- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a412e130 0x7fd0a412d840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.017+0000 7fd0a8e06700 1 --2- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a405e960 0x7fd0a408e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.017+0000 7fd0a8e06700 1 --2- 172.21.15.78:0/1503517552 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4099550 0x7fd0a412d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.017+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 >> 172.21.15.78:0/1503517552 conn(0x7fd0a40974d0 msgr2=0x7fd0a4092a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.017+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 shutdown_connections 2024-04-25T02:11:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.017+0000 7fd0a8e06700 1 -- 172.21.15.78:0/1503517552 wait complete. 2024-04-25T02:11:55.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705689 for osd.0 2024-04-25T02:11:55.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.040+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa280046ce0 con 0x7fa2801243e0 2024-04-25T02:11:55.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.041+0000 7fa26effd700 1 -- 172.21.15.78:0/3412582094 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa278011b60 con 0x7fa2801243e0 2024-04-25T02:11:55.048 INFO:teuthology.orchestra.run.smithi078.stdout:38654705690 2024-04-25T02:11:55.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.043+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 >> v1:172.21.15.78:6816/46507 conn(0x7fa26002bd00 legacy=0x7fa26002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.043+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2801243e0 msgr2=0x7fa280138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.043+0000 7fa284f3a700 1 --2- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2801243e0 0x7fa280138420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa278012000 tx=0x7fa278009840).stop 2024-04-25T02:11:55.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.043+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 shutdown_connections 2024-04-25T02:11:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.043+0000 7fa284f3a700 1 --2- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa2801243e0 0x7fa280138420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.043+0000 7fa284f3a700 1 --2- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2800961a0 0x7fa280069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.043+0000 7fa284f3a700 1 --2- 172.21.15.78:0/3412582094 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa280124000 0x7fa280137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.043+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 >> 172.21.15.78:0/3412582094 conn(0x7fa280097450 msgr2=0x7fa28012fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.044+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 shutdown_connections 2024-04-25T02:11:55.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.044+0000 7fa284f3a700 1 -- 172.21.15.78:0/3412582094 wait complete. 2024-04-25T02:11:55.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.050+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f613806a420 con 0x7f6138099710 2024-04-25T02:11:55.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.050+0000 7f6134ff9700 1 -- 172.21.15.78:0/2228752057 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f612c011360 con 0x7f6138099710 2024-04-25T02:11:55.058 INFO:teuthology.orchestra.run.smithi078.stdout:38654705689 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 >> v1:172.21.15.78:6816/46507 conn(0x7f612402bcd0 legacy=0x7f612402e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138099710 msgr2=0x7f613808e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 --2- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138099710 0x7f613808e1e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f612c00c4c0 tx=0x7f612c007dd0).stop 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 shutdown_connections 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 --2- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6138130860 0x7f613808b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 --2- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f6138098e40 0x7f613808f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 --2- 172.21.15.78:0/2228752057 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6138099710 0x7f613808e1e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 >> 172.21.15.78:0/2228752057 conn(0x7f61380974d0 msgr2=0x7f61380683f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 shutdown_connections 2024-04-25T02:11:55.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.052+0000 7f613e873700 1 -- 172.21.15.78:0/2228752057 wait complete. 2024-04-25T02:11:55.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.2 2024-04-25T02:11:55.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.059+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b8c046ce0 con 0x7f8b8c0967d0 2024-04-25T02:11:55.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.059+0000 7f8b827fc700 1 -- 172.21.15.78:0/2897397839 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b7c018350 con 0x7f8b8c0967d0 2024-04-25T02:11:55.067 INFO:teuthology.orchestra.run.smithi078.stdout:38654705690 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 >> v1:172.21.15.78:6816/46507 conn(0x7f8b7002bd30 legacy=0x7f8b7002e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c0967d0 msgr2=0x7f8b8c1166f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 --2- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c0967d0 0x7f8b8c1166f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8b7c009e00 tx=0x7f8b7c017000).stop 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 shutdown_connections 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 --2- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b8c1170d0 0x7f8b8c13a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 --2- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8b8c0967d0 0x7f8b8c1166f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 --2- 172.21.15.78:0/2897397839 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8b8c12f0d0 0x7f8b8c116be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 >> 172.21.15.78:0/2897397839 conn(0x7f8b8c065d90 msgr2=0x7f8b8c12da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 shutdown_connections 2024-04-25T02:11:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:55.061+0000 7f8b93f33700 1 -- 172.21.15.78:0/2897397839 wait complete. 2024-04-25T02:11:55.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705689 for osd.3 2024-04-25T02:11:55.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.1 2024-04-25T02:11:56.040 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:11:56.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:11:56.074 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:11:56.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:11:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.180+0000 7f78674fb700 1 Processor -- start 2024-04-25T02:11:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.180+0000 7f78674fb700 1 -- start start 2024-04-25T02:11:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f78674fb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7860065d90 0x7f78600962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f78674fb700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f7860096c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f78674fb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7860064640 con 0x7f786012f0d0 2024-04-25T02:11:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f78674fb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7860066170 con 0x7f7860065d90 2024-04-25T02:11:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f78674fb700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7860065040 con 0x7f78600967d0 2024-04-25T02:11:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7864a96700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f7860096c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7865297700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7860065d90 0x7f78600962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7864a96700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f7860096c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42288/0 (socket says 172.21.15.78:42288) 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7865297700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7860065d90 0x7f78600962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60688/0 (socket says 172.21.15.78:60688) 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7864a96700 1 -- 172.21.15.78:0/1862054221 learned_addr learned my addr 172.21.15.78:0/1862054221 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7864a96700 1 -- 172.21.15.78:0/1862054221 >> v2:172.21.15.78:3300/0 conn(0x7f7860065d90 msgr2=0x7f78600962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7864a96700 1 --2- 172.21.15.78:0/1862054221 >> v2:172.21.15.78:3300/0 conn(0x7f7860065d90 0x7f78600962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7864a96700 1 -- 172.21.15.78:0/1862054221 >> v1:172.21.15.78:6789/0 conn(0x7f786012f0d0 legacy=0x7f78601314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7857fff700 1 -- 172.21.15.78:0/1862054221 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100911585 0 0) 0x7f7860064640 con 0x7f786012f0d0 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.181+0000 7f7864a96700 1 -- 172.21.15.78:0/1862054221 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600652d0 con 0x7f78600967d0 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f7864a96700 1 --2- 172.21.15.78:0/1862054221 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f7860096c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7850006fd0 tx=0x7f78500090f0).ready entity=mon.2 client_cookie=5b49a008102dbe8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f7857fff700 1 -- 172.21.15.78:0/1862054221 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785000b580 con 0x7f78600967d0 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f7857fff700 1 -- 172.21.15.78:0/1862054221 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785000b6e0 con 0x7f78600967d0 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f7857fff700 1 -- 172.21.15.78:0/1862054221 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785000ba80 con 0x7f78600967d0 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f78674fb700 1 -- 172.21.15.78:0/1862054221 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 msgr2=0x7f7860096c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f78674fb700 1 --2- 172.21.15.78:0/1862054221 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f7860096c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7850006fd0 tx=0x7f78500090f0).stop 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f78674fb700 1 -- 172.21.15.78:0/1862054221 shutdown_connections 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f78674fb700 1 --2- 172.21.15.78:0/1862054221 >> v2:172.21.15.78:3300/0 conn(0x7f7860065d90 0x7f78600962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f78674fb700 1 --2- 172.21.15.78:0/1862054221 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f7860096c10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.182+0000 7f78674fb700 1 -- 172.21.15.78:0/1862054221 >> 172.21.15.78:0/1862054221 conn(0x7f786009c550 msgr2=0x7f78600983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.183+0000 7f78674fb700 1 -- 172.21.15.78:0/1862054221 shutdown_connections 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.183+0000 7f78674fb700 1 -- 172.21.15.78:0/1862054221 wait complete. 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.183+0000 7f78674fb700 1 Processor -- start 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f78674fb700 1 -- start start 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f78674fb700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f786013a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f78674fb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f786012f0d0 0x7f786013ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f78674fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f786013b020 0x7f7860116a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f78674fb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860118530 con 0x7f786013b020 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f78674fb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7860067700 con 0x7f786012f0d0 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f78674fb700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7860064d40 con 0x7f78600967d0 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f7864a96700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f786012f0d0 0x7f786013ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f7865a98700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f786013b020 0x7f7860116a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f7864a96700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f786012f0d0 0x7f786013ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51570/0 (socket says 172.21.15.78:51570) 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f7864a96700 1 -- 172.21.15.78:0/101518833 learned_addr learned my addr 172.21.15.78:0/101518833 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.184+0000 7f7865297700 1 --2- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f786013a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f7865a98700 1 -- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 msgr2=0x7f786013a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f7865a98700 1 --2- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f786013a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f7865a98700 1 -- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f786012f0d0 msgr2=0x7f786013ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f7865a98700 1 --2- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f786012f0d0 0x7f786013ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f7865a98700 1 -- 172.21.15.78:0/101518833 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850009370 con 0x7f786013b020 2024-04-25T02:11:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f7865a98700 1 --2- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f786013b020 0x7f7860116a40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f786006a1e0 tx=0x7f7858007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f7855ffb700 1 -- 172.21.15.78:0/101518833 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800e4a0 con 0x7f786013b020 2024-04-25T02:11:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f7855ffb700 1 -- 172.21.15.78:0/101518833 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785800e660 con 0x7f786013b020 2024-04-25T02:11:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7860118ef0 con 0x7f786013b020 2024-04-25T02:11:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786011ab20 con 0x7f786013b020 2024-04-25T02:11:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.185+0000 7f7855ffb700 1 -- 172.21.15.78:0/101518833 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800e810 con 0x7f786013b020 2024-04-25T02:11:56.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.186+0000 7f7855ffb700 1 -- 172.21.15.78:0/101518833 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f785800eb80 con 0x7f786013b020 2024-04-25T02:11:56.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.186+0000 7f7855ffb700 1 -- 172.21.15.78:0/101518833 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f785803ab50 con 0x7f786013b020 2024-04-25T02:11:56.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.187+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7840005120 con 0x7f786013b020 2024-04-25T02:11:56.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.195+0000 7f7855ffb700 1 -- 172.21.15.78:0/101518833 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f785800ee30 con 0x7f786013b020 2024-04-25T02:11:56.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.209+0000 7f17e9d8e700 1 Processor -- start 2024-04-25T02:11:56.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e9d8e700 1 -- start start 2024-04-25T02:11:56.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e9d8e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f17e4124000 0x7f17e40961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e9d8e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e40937a0 0x7f17e41243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e9d8e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e4096cf0 con 0x7f17e41274e0 2024-04-25T02:11:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e9d8e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4093ba0 con 0x7f17e40937a0 2024-04-25T02:11:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e9d8e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4092d00 con 0x7f17e4124000 2024-04-25T02:11:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e2ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e40937a0 0x7f17e41243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e2ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e40937a0 0x7f17e41243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51584/0 (socket says 172.21.15.78:51584) 2024-04-25T02:11:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e3fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f17e41274e0 0x7f17e4127960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39840/0 (socket says 172.21.15.78:39840) 2024-04-25T02:11:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e2ffd700 1 -- 172.21.15.78:0/3921587399 learned_addr learned my addr 172.21.15.78:0/3921587399 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:56.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e37fe700 1 --2- 172.21.15.78:0/3921587399 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f17e4124000 0x7f17e40961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e2ffd700 1 -- 172.21.15.78:0/3921587399 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f17e4124000 msgr2=0x7f17e40961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e2ffd700 1 --2- 172.21.15.78:0/3921587399 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f17e4124000 0x7f17e40961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e27fc700 1 -- 172.21.15.78:0/3921587399 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952296989 0 0) 0x7f17e4096cf0 con 0x7f17e41274e0 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.210+0000 7f17e2ffd700 1 -- 172.21.15.78:0/3921587399 >> v1:172.21.15.78:6789/0 conn(0x7f17e41274e0 legacy=0x7f17e4127960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.211+0000 7f17e2ffd700 1 -- 172.21.15.78:0/3921587399 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40933a0 con 0x7f17e40937a0 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.211+0000 7f17e2ffd700 1 --2- 172.21.15.78:0/3921587399 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e40937a0 0x7f17e41243e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f17d8009830 tx=0x7f17d80090f0).ready entity=mon.1 client_cookie=52fc33c98b687077 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.211+0000 7f17e27fc700 1 -- 172.21.15.78:0/3921587399 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800b580 con 0x7f17e40937a0 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.211+0000 7f17e27fc700 1 -- 172.21.15.78:0/3921587399 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d800b6e0 con 0x7f17e40937a0 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.211+0000 7f17e27fc700 1 -- 172.21.15.78:0/3921587399 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800ba80 con 0x7f17e40937a0 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.211+0000 7f17e9d8e700 1 -- 172.21.15.78:0/3921587399 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e40937a0 msgr2=0x7f17e41243e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.211+0000 7f17e9d8e700 1 --2- 172.21.15.78:0/3921587399 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e40937a0 0x7f17e41243e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f17d8009830 tx=0x7f17d80090f0).stop 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.212+0000 7f17e9d8e700 1 -- 172.21.15.78:0/3921587399 shutdown_connections 2024-04-25T02:11:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.212+0000 7f17e9d8e700 1 --2- 172.21.15.78:0/3921587399 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f17e4124000 0x7f17e40961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.212+0000 7f17e9d8e700 1 --2- 172.21.15.78:0/3921587399 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e40937a0 0x7f17e41243e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.212+0000 7f17e9d8e700 1 -- 172.21.15.78:0/3921587399 >> 172.21.15.78:0/3921587399 conn(0x7f17e4097450 msgr2=0x7f17e4097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.212+0000 7f17e9d8e700 1 -- 172.21.15.78:0/3921587399 shutdown_connections 2024-04-25T02:11:56.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.212+0000 7f17e9d8e700 1 -- 172.21.15.78:0/3921587399 wait complete. 2024-04-25T02:11:56.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.212+0000 7fcc1793f700 1 Processor -- start 2024-04-25T02:11:56.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.212+0000 7fcc1793f700 1 -- start start 2024-04-25T02:11:56.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.212+0000 7f17e9d8e700 1 Processor -- start 2024-04-25T02:11:56.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7f17e9d8e700 1 -- start start 2024-04-25T02:11:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc1793f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1005e960 0x7fcc10098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc1793f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 0x7fcc10099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc1793f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc100682e0 con 0x7fcc1012d120 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc1793f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1006ad80 con 0x7fcc1005e960 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc1793f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1005ed40 con 0x7fcc10099330 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc156db700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1005e960 0x7fcc10098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc156db700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1005e960 0x7fcc10098e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51592/0 (socket says 172.21.15.78:51592) 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc156db700 1 -- 172.21.15.78:0/3798541069 learned_addr learned my addr 172.21.15.78:0/3798541069 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc156db700 1 -- 172.21.15.78:0/3798541069 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 msgr2=0x7fcc10099730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc156db700 1 --2- 172.21.15.78:0/3798541069 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 0x7fcc10099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc156db700 1 -- 172.21.15.78:0/3798541069 >> v1:172.21.15.78:6789/0 conn(0x7fcc1012d120 legacy=0x7fcc1012f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc156db700 1 -- 172.21.15.78:0/3798541069 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10069060 con 0x7fcc1005e960 2024-04-25T02:11:56.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7fcc156db700 1 --2- 172.21.15.78:0/3798541069 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1005e960 0x7fcc10098e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fcc0c009830 tx=0x7fcc0c0090f0).ready entity=mon.1 client_cookie=ad09164e2b0d1b3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7f17e9d8e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40937a0 0x7f17e4119a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7f17e9d8e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f17e4124000 0x7f17e4115a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7f17e9d8e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e41274e0 0x7f17e4115f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7f17e9d8e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4118f80 con 0x7f17e40937a0 2024-04-25T02:11:56.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7f17e9d8e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4095320 con 0x7f17e41274e0 2024-04-25T02:11:56.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.213+0000 7f17e9d8e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4092440 con 0x7f17e4124000 2024-04-25T02:11:56.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.214+0000 7fcc07fff700 1 -- 172.21.15.78:0/3798541069 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00b600 con 0x7fcc1005e960 2024-04-25T02:11:56.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.214+0000 7fcc07fff700 1 -- 172.21.15.78:0/3798541069 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c00b760 con 0x7fcc1005e960 2024-04-25T02:11:56.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.214+0000 7fcc07fff700 1 -- 172.21.15.78:0/3798541069 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00bae0 con 0x7fcc1005e960 2024-04-25T02:11:56.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.214+0000 7f17e37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40937a0 0x7f17e4119a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.214+0000 7f17e37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40937a0 0x7f17e4119a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60708/0 (socket says 172.21.15.78:60708) 2024-04-25T02:11:56.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.214+0000 7f17e37fe700 1 -- 172.21.15.78:0/2394349863 learned_addr learned my addr 172.21.15.78:0/2394349863 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:56.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7fcc1793f700 1 -- 172.21.15.78:0/3798541069 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1005e960 msgr2=0x7fcc10098e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7fcc1793f700 1 --2- 172.21.15.78:0/3798541069 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1005e960 0x7fcc10098e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fcc0c009830 tx=0x7fcc0c0090f0).stop 2024-04-25T02:11:56.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17e37fe700 1 -- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f17e4124000 msgr2=0x7f17e4115a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17e37fe700 1 --2- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f17e4124000 0x7f17e4115a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17e37fe700 1 -- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e41274e0 msgr2=0x7f17e4115f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17e37fe700 1 --2- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e41274e0 0x7f17e4115f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17e37fe700 1 -- 172.21.15.78:0/2394349863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8009370 con 0x7f17e40937a0 2024-04-25T02:11:56.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7fcc1793f700 1 -- 172.21.15.78:0/3798541069 shutdown_connections 2024-04-25T02:11:56.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7fcc1793f700 1 --2- 172.21.15.78:0/3798541069 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1005e960 0x7fcc10098e40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7fcc1793f700 1 --2- 172.21.15.78:0/3798541069 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 0x7fcc10099730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7fcc1793f700 1 -- 172.21.15.78:0/3798541069 >> 172.21.15.78:0/3798541069 conn(0x7fcc100974d0 msgr2=0x7fcc10099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17e37fe700 1 --2- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40937a0 0x7f17e4119a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f17d400ebb0 tx=0x7f17d400b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7fcc1793f700 1 -- 172.21.15.78:0/3798541069 shutdown_connections 2024-04-25T02:11:56.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7fcc1793f700 1 -- 172.21.15.78:0/3798541069 wait complete. 2024-04-25T02:11:56.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17cbfff700 1 -- 172.21.15.78:0/2394349863 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400dbd0 con 0x7f17e40937a0 2024-04-25T02:11:56.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17cbfff700 1 -- 172.21.15.78:0/2394349863 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d400dd30 con 0x7f17e40937a0 2024-04-25T02:11:56.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e4116ba0 con 0x7f17e40937a0 2024-04-25T02:11:56.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17cbfff700 1 -- 172.21.15.78:0/2394349863 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400dea0 con 0x7f17e40937a0 2024-04-25T02:11:56.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.215+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e41177d0 con 0x7f17e40937a0 2024-04-25T02:11:56.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.216+0000 7fcc1793f700 1 Processor -- start 2024-04-25T02:11:56.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.216+0000 7f17cbfff700 1 -- 172.21.15.78:0/2394349863 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f17d40108e0 con 0x7f17e40937a0 2024-04-25T02:11:56.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.216+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e4097bb0 con 0x7f17e40937a0 2024-04-25T02:11:56.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.216+0000 7f17cbfff700 1 -- 172.21.15.78:0/2394349863 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f17d403bc10 con 0x7f17e40937a0 2024-04-25T02:11:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.216+0000 7fcc1793f700 1 -- start start 2024-04-25T02:11:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc1793f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1005e960 0x7fcc1012cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc1793f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 0x7fcc10123d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc1793f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1012d120 0x7fcc10124210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc1793f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10098940 con 0x7fcc1005e960 2024-04-25T02:11:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc1793f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100684a0 con 0x7fcc1012d120 2024-04-25T02:11:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc1793f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc101274a0 con 0x7fcc10099330 2024-04-25T02:11:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc14eda700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 0x7fcc10123d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc14eda700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 0x7fcc10123d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42330/0 (socket says 172.21.15.78:42330) 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc14eda700 1 -- 172.21.15.78:0/2626642631 learned_addr learned my addr 172.21.15.78:0/2626642631 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc15edc700 1 --2- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1012d120 0x7fcc10124210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc14eda700 1 -- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1012d120 msgr2=0x7fcc10124210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc14eda700 1 --2- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1012d120 0x7fcc10124210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc14eda700 1 -- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1005e960 msgr2=0x7fcc1012cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc14eda700 1 --2- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1005e960 0x7fcc1012cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.218+0000 7fcc14eda700 1 -- 172.21.15.78:0/2626642631 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c009370 con 0x7fcc10099330 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.219+0000 7fcc14eda700 1 --2- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 0x7fcc10123d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fcc0000b560 tx=0x7fcc000090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.219+0000 7fcc05ffb700 1 -- 172.21.15.78:0/2626642631 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00002320 con 0x7fcc10099330 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.219+0000 7fcc05ffb700 1 -- 172.21.15.78:0/2626642631 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc000024a0 con 0x7fcc10099330 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.219+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc10127c80 con 0x7fcc10099330 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.219+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc10125870 con 0x7fcc10099330 2024-04-25T02:11:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.219+0000 7fcc05ffb700 1 -- 172.21.15.78:0/2626642631 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00002860 con 0x7fcc10099330 2024-04-25T02:11:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.220+0000 7fcc05ffb700 1 -- 172.21.15.78:0/2626642631 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fcc00002bd0 con 0x7fcc10099330 2024-04-25T02:11:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.220+0000 7fcc05ffb700 1 -- 172.21.15.78:0/2626642631 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fcc0003b050 con 0x7fcc10099330 2024-04-25T02:11:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.221+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf0005120 con 0x7fcc10099330 2024-04-25T02:11:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.222+0000 7fd184c27700 1 Processor -- start 2024-04-25T02:11:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.222+0000 7f17cbfff700 1 -- 172.21.15.78:0/2394349863 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f17d4020d40 con 0x7f17e40937a0 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.222+0000 7fd184c27700 1 -- start start 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd184c27700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180064ad0 0x7fd18012abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd184c27700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd18012fac0 0x7fd180131eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd184c27700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd180065750 con 0x7fd18012a750 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd184c27700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd180064eb0 con 0x7fd180064ad0 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd184c27700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd180099930 con 0x7fd18012fac0 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd17dd9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd18012a750 0x7fd18012b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39862/0 (socket says 172.21.15.78:39862) 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd17dd9b700 1 -- 172.21.15.78:0/507734493 learned_addr learned my addr 172.21.15.78:0/507734493 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd17ed9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd18012fac0 0x7fd180131eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd17d59a700 1 -- 172.21.15.78:0/507734493 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649183388 0 0) 0x7fd180065750 con 0x7fd18012a750 2024-04-25T02:11:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd17ed9d700 1 -- 172.21.15.78:0/507734493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180064ad0 msgr2=0x7fd18012abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd17ed9d700 1 --2- 172.21.15.78:0/507734493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180064ad0 0x7fd18012abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd17ed9d700 1 -- 172.21.15.78:0/507734493 >> v1:172.21.15.78:6789/0 conn(0x7fd18012a750 legacy=0x7fd18012b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.223+0000 7fd17ed9d700 1 -- 172.21.15.78:0/507734493 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180065b40 con 0x7fd18012fac0 2024-04-25T02:11:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.224+0000 7fd17ed9d700 1 --2- 172.21.15.78:0/507734493 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd18012fac0 0x7fd180131eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fd178009e90 tx=0x7fd178009780).ready entity=mon.2 client_cookie=249d792d2a87b6dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.226+0000 7fd17d59a700 1 -- 172.21.15.78:0/507734493 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17800e070 con 0x7fd18012fac0 2024-04-25T02:11:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.226+0000 7fd17d59a700 1 -- 172.21.15.78:0/507734493 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17800bc30 con 0x7fd18012fac0 2024-04-25T02:11:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.226+0000 7fd17d59a700 1 -- 172.21.15.78:0/507734493 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178012410 con 0x7fd18012fac0 2024-04-25T02:11:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.227+0000 7fcc05ffb700 1 -- 172.21.15.78:0/2626642631 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fcc0001b3e0 con 0x7fcc10099330 2024-04-25T02:11:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.227+0000 7fd184c27700 1 -- 172.21.15.78:0/507734493 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd18012fac0 msgr2=0x7fd180131eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.227+0000 7fd184c27700 1 --2- 172.21.15.78:0/507734493 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd18012fac0 0x7fd180131eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fd178009e90 tx=0x7fd178009780).stop 2024-04-25T02:11:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.227+0000 7fd184c27700 1 -- 172.21.15.78:0/507734493 shutdown_connections 2024-04-25T02:11:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.227+0000 7fd184c27700 1 --2- 172.21.15.78:0/507734493 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd18012fac0 0x7fd180131eb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.227+0000 7fd184c27700 1 --2- 172.21.15.78:0/507734493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180064ad0 0x7fd18012abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.227+0000 7fd184c27700 1 -- 172.21.15.78:0/507734493 >> 172.21.15.78:0/507734493 conn(0x7fd18009a630 msgr2=0x7fd18009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.227+0000 7fd184c27700 1 -- 172.21.15.78:0/507734493 shutdown_connections 2024-04-25T02:11:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.227+0000 7fd184c27700 1 -- 172.21.15.78:0/507734493 wait complete. 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.228+0000 7fd184c27700 1 Processor -- start 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.228+0000 7fd184c27700 1 -- start start 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd184c27700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd180064ad0 0x7fd180127b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd184c27700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd18012fac0 0x7fd180093320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd184c27700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180093810 0x7fd180093c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd184c27700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd180096920 con 0x7fd18012fac0 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd184c27700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd180094180 con 0x7fd180093810 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd184c27700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1800954f0 con 0x7fd180064ad0 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17e59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd180064ad0 0x7fd180127b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17e59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd180064ad0 0x7fd180127b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42340/0 (socket says 172.21.15.78:42340) 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17e59c700 1 -- 172.21.15.78:0/233955250 learned_addr learned my addr 172.21.15.78:0/233955250 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17ed9d700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180093810 0x7fd180093c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17dd9b700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd18012fac0 0x7fd180093320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17e59c700 1 -- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180093810 msgr2=0x7fd180093c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17e59c700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180093810 0x7fd180093c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17e59c700 1 -- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd18012fac0 msgr2=0x7fd180093320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17e59c700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd18012fac0 0x7fd180093320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.229+0000 7fd17e59c700 1 -- 172.21.15.78:0/233955250 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd178009a20 con 0x7fd180064ad0 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.230+0000 7fd17ed9d700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180093810 0x7fd180093c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.230+0000 7fd17e59c700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd180064ad0 0x7fd180127b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd17000b560 tx=0x7fd1700090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.230+0000 7fd16effd700 1 -- 172.21.15.78:0/233955250 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170002320 con 0x7fd180064ad0 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.230+0000 7fd16effd700 1 -- 172.21.15.78:0/233955250 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700024a0 con 0x7fd180064ad0 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.230+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd180096b70 con 0x7fd180064ad0 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.230+0000 7fd16effd700 1 -- 172.21.15.78:0/233955250 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170002860 con 0x7fd180064ad0 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.230+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd180095730 con 0x7fd180064ad0 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.231+0000 7fd16effd700 1 -- 172.21.15.78:0/233955250 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fd170002bd0 con 0x7fd180064ad0 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.231+0000 7fd16effd700 1 -- 172.21.15.78:0/233955250 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fd17003b130 con 0x7fd180064ad0 2024-04-25T02:11:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.231+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18009b150 con 0x7fd180064ad0 2024-04-25T02:11:56.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.236+0000 7fd16effd700 1 -- 172.21.15.78:0/233955250 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fd17001b3e0 con 0x7fd180064ad0 2024-04-25T02:11:56.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.369+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78400057f0 con 0x7f786013b020 2024-04-25T02:11:56.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.370+0000 7f7855ffb700 1 -- 172.21.15.78:0/101518833 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7858019310 con 0x7f786013b020 2024-04-25T02:11:56.377 INFO:teuthology.orchestra.run.smithi078.stdout:38654705689 2024-04-25T02:11:56.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.371+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 >> v1:172.21.15.78:6816/46507 conn(0x7f784402bd00 legacy=0x7f784402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.372+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f786013b020 msgr2=0x7f7860116a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.372+0000 7f78674fb700 1 --2- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f786013b020 0x7f7860116a40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f786006a1e0 tx=0x7f7858007e60).stop 2024-04-25T02:11:56.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.372+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 shutdown_connections 2024-04-25T02:11:56.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.372+0000 7f78674fb700 1 --2- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f786013b020 0x7f7860116a40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.372+0000 7f78674fb700 1 --2- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f78600967d0 0x7f786013a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.372+0000 7f78674fb700 1 --2- 172.21.15.78:0/101518833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f786012f0d0 0x7f786013ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.372+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 >> 172.21.15.78:0/101518833 conn(0x7f7860065d90 msgr2=0x7f786012dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.372+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 shutdown_connections 2024-04-25T02:11:56.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.372+0000 7f78674fb700 1 -- 172.21.15.78:0/101518833 wait complete. 2024-04-25T02:11:56.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705689 for osd.0 2024-04-25T02:11:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.391+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f17e4097f70 con 0x7f17e40937a0 2024-04-25T02:11:56.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.392+0000 7f17cbfff700 1 -- 172.21.15.78:0/2394349863 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17d4020300 con 0x7f17e40937a0 2024-04-25T02:11:56.399 INFO:teuthology.orchestra.run.smithi078.stdout:38654705690 2024-04-25T02:11:56.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 >> v1:172.21.15.78:6816/46507 conn(0x7f17d002bd00 legacy=0x7f17d002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40937a0 msgr2=0x7f17e4119a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 --2- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40937a0 0x7f17e4119a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f17d400ebb0 tx=0x7f17d400b300).stop 2024-04-25T02:11:56.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 shutdown_connections 2024-04-25T02:11:56.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 --2- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17e41274e0 0x7f17e4115f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 --2- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17e40937a0 0x7f17e4119a20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 --2- 172.21.15.78:0/2394349863 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f17e4124000 0x7f17e4115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 >> 172.21.15.78:0/2394349863 conn(0x7f17e4097450 msgr2=0x7f17e41267a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 shutdown_connections 2024-04-25T02:11:56.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.394+0000 7f17e9d8e700 1 -- 172.21.15.78:0/2394349863 wait complete. 2024-04-25T02:11:56.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.1 2024-04-25T02:11:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.418+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcbf00057f0 con 0x7fcc10099330 2024-04-25T02:11:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.419+0000 7fcc05ffb700 1 -- 172.21.15.78:0/2626642631 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc00019300 con 0x7fcc10099330 2024-04-25T02:11:56.426 INFO:teuthology.orchestra.run.smithi078.stdout:38654705689 2024-04-25T02:11:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 >> v1:172.21.15.78:6816/46507 conn(0x7fcbf402bd00 legacy=0x7fcbf402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 msgr2=0x7fcc10123d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 --2- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 0x7fcc10123d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fcc0000b560 tx=0x7fcc000090f0).stop 2024-04-25T02:11:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 shutdown_connections 2024-04-25T02:11:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 --2- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcc1012d120 0x7fcc10124210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 --2- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc1005e960 0x7fcc1012cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 --2- 172.21.15.78:0/2626642631 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcc10099330 0x7fcc10123d20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 >> 172.21.15.78:0/2626642631 conn(0x7fcc100974d0 msgr2=0x7fcc10093ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 shutdown_connections 2024-04-25T02:11:56.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.421+0000 7fcc1793f700 1 -- 172.21.15.78:0/2626642631 wait complete. 2024-04-25T02:11:56.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.425+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1800995b0 con 0x7fd180064ad0 2024-04-25T02:11:56.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.426+0000 7fd16effd700 1 -- 172.21.15.78:0/233955250 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd170019300 con 0x7fd180064ad0 2024-04-25T02:11:56.433 INFO:teuthology.orchestra.run.smithi078.stdout:38654705690 2024-04-25T02:11:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 >> v1:172.21.15.78:6816/46507 conn(0x7fd16002bd00 legacy=0x7fd16002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd180064ad0 msgr2=0x7fd180127b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd180064ad0 0x7fd180127b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd17000b560 tx=0x7fd1700090f0).stop 2024-04-25T02:11:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 shutdown_connections 2024-04-25T02:11:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd180093810 0x7fd180093c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd180064ad0 0x7fd180127b00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 --2- 172.21.15.78:0/233955250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd18012fac0 0x7fd180093320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 >> 172.21.15.78:0/233955250 conn(0x7fd18009a630 msgr2=0x7fd180129680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 shutdown_connections 2024-04-25T02:11:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:56.428+0000 7fd184c27700 1 -- 172.21.15.78:0/233955250 wait complete. 2024-04-25T02:11:56.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705689 for osd.3 2024-04-25T02:11:56.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.2 2024-04-25T02:11:57.392 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:11:57.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:11:57.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:11:57.447 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:11:57.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.522+0000 7f7acca93700 1 Processor -- start 2024-04-25T02:11:57.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.522+0000 7f7acca93700 1 -- start start 2024-04-25T02:11:57.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7acca93700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac8062860 0x7f7ac81271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7acca93700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7ac812fb30 0x7f7ac8131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7acca93700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac8096490 con 0x7f7ac81277a0 2024-04-25T02:11:57.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7acca93700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac8062c40 con 0x7f7ac812fb30 2024-04-25T02:11:57.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7acca93700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8091b90 con 0x7f7ac8062860 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac6d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7ac812fb30 0x7f7ac8131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac5d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7ac81277a0 0x7f7ac8127ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39872/0 (socket says 172.21.15.78:39872) 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac5d9b700 1 -- 172.21.15.78:0/3788738967 learned_addr learned my addr 172.21.15.78:0/3788738967 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac659c700 1 --2- 172.21.15.78:0/3788738967 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac8062860 0x7f7ac81271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac559a700 1 -- 172.21.15.78:0/3788738967 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952449999 0 0) 0x7f7ac8096490 con 0x7f7ac81277a0 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac559a700 1 -- 172.21.15.78:0/3788738967 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab00033f0 con 0x7f7ac81277a0 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac6d9d700 1 -- 172.21.15.78:0/3788738967 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac8062860 msgr2=0x7f7ac81271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac6d9d700 1 --2- 172.21.15.78:0/3788738967 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac8062860 0x7f7ac81271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac6d9d700 1 -- 172.21.15.78:0/3788738967 >> v1:172.21.15.78:6789/0 conn(0x7f7ac81277a0 legacy=0x7f7ac8127ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac6d9d700 1 -- 172.21.15.78:0/3788738967 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8091e50 con 0x7f7ac812fb30 2024-04-25T02:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac659c700 1 --2- 172.21.15.78:0/3788738967 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac8062860 0x7f7ac81271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.523+0000 7f7ac6d9d700 1 --2- 172.21.15.78:0/3788738967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac812fb30 0x7f7ac8131f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f7ac0009e60 tx=0x7f7ac0009780).ready entity=mon.0 client_cookie=dfcecb3983c8e2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.524+0000 7f7ac559a700 1 -- 172.21.15.78:0/3788738967 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000e070 con 0x7f7ac812fb30 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.524+0000 7f7ac559a700 1 -- 172.21.15.78:0/3788738967 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000bb60 con 0x7f7ac812fb30 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.524+0000 7f7ac559a700 1 -- 172.21.15.78:0/3788738967 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0012410 con 0x7f7ac812fb30 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.525+0000 7f7acca93700 1 -- 172.21.15.78:0/3788738967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac812fb30 msgr2=0x7f7ac8131f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.525+0000 7f7acca93700 1 --2- 172.21.15.78:0/3788738967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac812fb30 0x7f7ac8131f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f7ac0009e60 tx=0x7f7ac0009780).stop 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.525+0000 7f7acca93700 1 -- 172.21.15.78:0/3788738967 shutdown_connections 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.525+0000 7f7acca93700 1 --2- 172.21.15.78:0/3788738967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac812fb30 0x7f7ac8131f20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.525+0000 7f7acca93700 1 --2- 172.21.15.78:0/3788738967 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac8062860 0x7f7ac81271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.525+0000 7f7acca93700 1 -- 172.21.15.78:0/3788738967 >> 172.21.15.78:0/3788738967 conn(0x7f7ac8097450 msgr2=0x7f7ac8097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.525+0000 7f7acca93700 1 -- 172.21.15.78:0/3788738967 shutdown_connections 2024-04-25T02:11:57.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.525+0000 7f7acca93700 1 -- 172.21.15.78:0/3788738967 wait complete. 2024-04-25T02:11:57.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.526+0000 7f7acca93700 1 Processor -- start 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.526+0000 7f7acca93700 1 -- start start 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7acca93700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ac8062860 0x7f7ac81128f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7acca93700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac81277a0 0x7f7ac812d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7acca93700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac812fb30 0x7f7ac812dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7acca93700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8126c60 con 0x7f7ac81277a0 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7acca93700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac812f7c0 con 0x7f7ac8062860 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7acca93700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8111e50 con 0x7f7ac812fb30 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7ac5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac81277a0 0x7f7ac812d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7ac6d9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac812fb30 0x7f7ac812dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7ac5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac81277a0 0x7f7ac812d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60748/0 (socket says 172.21.15.78:60748) 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7ac6d9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac812fb30 0x7f7ac812dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42358/0 (socket says 172.21.15.78:42358) 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.527+0000 7f7ac5d9b700 1 -- 172.21.15.78:0/3352767054 learned_addr learned my addr 172.21.15.78:0/3352767054 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ac5d9b700 1 -- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac812fb30 msgr2=0x7f7ac812dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ac5d9b700 1 --2- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac812fb30 0x7f7ac812dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ac5d9b700 1 -- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ac8062860 msgr2=0x7f7ac81128f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ac5d9b700 1 --2- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ac8062860 0x7f7ac81128f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ac5d9b700 1 -- 172.21.15.78:0/3352767054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0009a20 con 0x7f7ac81277a0 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ac6d9d700 1 --2- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac812fb30 0x7f7ac812dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ac5d9b700 1 --2- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac81277a0 0x7f7ac812d6d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f7abc00c4c0 tx=0x7f7abc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ab6ffd700 1 -- 172.21.15.78:0/3352767054 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0072e0 con 0x7f7ac81277a0 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ab6ffd700 1 -- 172.21.15.78:0/3352767054 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc007440 con 0x7f7ac81277a0 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac8126990 con 0x7f7ac81277a0 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7ab6ffd700 1 -- 172.21.15.78:0/3352767054 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0057a0 con 0x7f7ac81277a0 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.528+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac812e0b0 con 0x7f7ac81277a0 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.529+0000 7f7ab6ffd700 1 -- 172.21.15.78:0/3352767054 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f7abc005bd0 con 0x7f7ac81277a0 2024-04-25T02:11:57.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.529+0000 7f7ab6ffd700 1 -- 172.21.15.78:0/3352767054 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f7abc03aba0 con 0x7f7ac81277a0 2024-04-25T02:11:57.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.530+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac8097f70 con 0x7f7ac81277a0 2024-04-25T02:11:57.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.534+0000 7f7ab6ffd700 1 -- 172.21.15.78:0/3352767054 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f7abc018030 con 0x7f7ac81277a0 2024-04-25T02:11:57.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.561+0000 7fb5651cb700 1 Processor -- start 2024-04-25T02:11:57.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.561+0000 7fb5651cb700 1 -- start start 2024-04-25T02:11:57.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb5651cb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb56005e960 0x7fb560098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb5651cb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012e130 0x7fb560130520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb5651cb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5600682e0 con 0x7fb560099330 2024-04-25T02:11:57.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb5651cb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56006ad80 con 0x7fb56005e960 2024-04-25T02:11:57.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb5651cb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56005ed40 con 0x7fb56012e130 2024-04-25T02:11:57.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55e59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb560099330 0x7fb560099730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39888/0 (socket says 172.21.15.78:39888) 2024-04-25T02:11:57.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55e59c700 1 -- 172.21.15.78:0/3685159283 learned_addr learned my addr 172.21.15.78:0/3685159283 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:11:57.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55f59e700 1 --2- 172.21.15.78:0/3685159283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012e130 0x7fb560130520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55ed9d700 1 --2- 172.21.15.78:0/3685159283 >> v2:172.21.15.78:3300/0 conn(0x7fb56005e960 0x7fb560098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55dd9b700 1 -- 172.21.15.78:0/3685159283 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468188977 0 0) 0x7fb5600682e0 con 0x7fb560099330 2024-04-25T02:11:57.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55dd9b700 1 -- 172.21.15.78:0/3685159283 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5480033f0 con 0x7fb560099330 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55f59e700 1 -- 172.21.15.78:0/3685159283 >> v2:172.21.15.78:3300/0 conn(0x7fb56005e960 msgr2=0x7fb560098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55f59e700 1 --2- 172.21.15.78:0/3685159283 >> v2:172.21.15.78:3300/0 conn(0x7fb56005e960 0x7fb560098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55f59e700 1 -- 172.21.15.78:0/3685159283 >> v1:172.21.15.78:6789/0 conn(0x7fb560099330 legacy=0x7fb560099730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55f59e700 1 -- 172.21.15.78:0/3685159283 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb560069060 con 0x7fb56012e130 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.562+0000 7fb55f59e700 1 --2- 172.21.15.78:0/3685159283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012e130 0x7fb560130520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb558009e60 tx=0x7fb558009780).ready entity=mon.1 client_cookie=f1edf60a33b4072f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb55dd9b700 1 -- 172.21.15.78:0/3685159283 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800e070 con 0x7fb56012e130 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb55dd9b700 1 -- 172.21.15.78:0/3685159283 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55800bb60 con 0x7fb56012e130 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb55dd9b700 1 -- 172.21.15.78:0/3685159283 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558012410 con 0x7fb56012e130 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb5651cb700 1 -- 172.21.15.78:0/3685159283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012e130 msgr2=0x7fb560130520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb5651cb700 1 --2- 172.21.15.78:0/3685159283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012e130 0x7fb560130520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb558009e60 tx=0x7fb558009780).stop 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb5651cb700 1 -- 172.21.15.78:0/3685159283 shutdown_connections 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb5651cb700 1 --2- 172.21.15.78:0/3685159283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012e130 0x7fb560130520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb5651cb700 1 --2- 172.21.15.78:0/3685159283 >> v2:172.21.15.78:3300/0 conn(0x7fb56005e960 0x7fb560098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb5651cb700 1 -- 172.21.15.78:0/3685159283 >> 172.21.15.78:0/3685159283 conn(0x7fb5600974d0 msgr2=0x7fb560099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb5651cb700 1 -- 172.21.15.78:0/3685159283 shutdown_connections 2024-04-25T02:11:57.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.563+0000 7fb5651cb700 1 -- 172.21.15.78:0/3685159283 wait complete. 2024-04-25T02:11:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb5651cb700 1 Processor -- start 2024-04-25T02:11:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb5651cb700 1 -- start start 2024-04-25T02:11:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb5651cb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56005e960 0x7fb560128cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb5651cb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb560099330 0x7fb5601291c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb5651cb700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb56012e130 0x7fb5601296b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb5651cb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56012a0a0 con 0x7fb56005e960 2024-04-25T02:11:57.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb5651cb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56012ad10 con 0x7fb560099330 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb5651cb700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb560065cc0 con 0x7fb56012e130 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb55e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb560099330 0x7fb5601291c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb55e59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb560099330 0x7fb5601291c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51656/0 (socket says 172.21.15.78:51656) 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb55e59c700 1 -- 172.21.15.78:0/127934396 learned_addr learned my addr 172.21.15.78:0/127934396 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.565+0000 7fb55ed9d700 1 --2- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56005e960 0x7fb560128cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb55e59c700 1 -- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb56012e130 msgr2=0x7fb5601296b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb55e59c700 1 --2- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb56012e130 0x7fb5601296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb55e59c700 1 -- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56005e960 msgr2=0x7fb560128cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb55e59c700 1 --2- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56005e960 0x7fb560128cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb55e59c700 1 -- 172.21.15.78:0/127934396 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558009a20 con 0x7fb560099330 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb55ed9d700 1 --2- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56005e960 0x7fb560128cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb55e59c700 1 --2- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb560099330 0x7fb5601291c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb55400c590 tx=0x7fb554007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb5477fe700 1 -- 172.21.15.78:0/127934396 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540072e0 con 0x7fb560099330 2024-04-25T02:11:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb5477fe700 1 -- 172.21.15.78:0/127934396 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554007440 con 0x7fb560099330 2024-04-25T02:11:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5600684a0 con 0x7fb560099330 2024-04-25T02:11:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56012c850 con 0x7fb560099330 2024-04-25T02:11:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.566+0000 7fb5477fe700 1 -- 172.21.15.78:0/127934396 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540057a0 con 0x7fb560099330 2024-04-25T02:11:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.567+0000 7fb5477fe700 1 -- 172.21.15.78:0/127934396 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fb554005bd0 con 0x7fb560099330 2024-04-25T02:11:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.567+0000 7fb5477fe700 1 -- 172.21.15.78:0/127934396 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fb55403a580 con 0x7fb560099330 2024-04-25T02:11:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.568+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56012bc10 con 0x7fb560099330 2024-04-25T02:11:57.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.573+0000 7fb5477fe700 1 -- 172.21.15.78:0/127934396 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fb56012bc10 con 0x7fb560099330 2024-04-25T02:11:57.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.599+0000 7f1f67a77700 1 Processor -- start 2024-04-25T02:11:57.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.600+0000 7f1f67a77700 1 -- start start 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.600+0000 7f1f67a77700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601289a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.600+0000 7f1f67a77700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f60128e90 0x7f1f60093c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f67a77700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f60063310 con 0x7f1f60094110 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f67a77700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f60062c40 con 0x7f1f60128e90 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f67a77700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600965c0 con 0x7f1f60062860 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f65813700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601289a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f65813700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601289a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42384/0 (socket says 172.21.15.78:42384) 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f65813700 1 -- 172.21.15.78:0/3341550305 learned_addr learned my addr 172.21.15.78:0/3341550305 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f65012700 1 --2- 172.21.15.78:0/3341550305 >> v2:172.21.15.78:3300/0 conn(0x7f1f60128e90 0x7f1f60093c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f64811700 1 -- 172.21.15.78:0/3341550305 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003157090 0 0) 0x7f1f60063310 con 0x7f1f60094110 2024-04-25T02:11:57.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f64811700 1 -- 172.21.15.78:0/3341550305 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f4c0033f0 con 0x7f1f60094110 2024-04-25T02:11:57.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f65012700 1 -- 172.21.15.78:0/3341550305 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 msgr2=0x7f1f601289a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f65012700 1 --2- 172.21.15.78:0/3341550305 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601289a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f65012700 1 -- 172.21.15.78:0/3341550305 >> v1:172.21.15.78:6789/0 conn(0x7f1f60094110 legacy=0x7f1f6012f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f65012700 1 -- 172.21.15.78:0/3341550305 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f60096e60 con 0x7f1f60128e90 2024-04-25T02:11:57.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f65012700 1 --2- 172.21.15.78:0/3341550305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 0x7f1f60093c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1f50009760 tx=0x7f1f50009060).ready entity=mon.0 client_cookie=1f9b170d7fa1fb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f64811700 1 -- 172.21.15.78:0/3341550305 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500090d0 con 0x7f1f60128e90 2024-04-25T02:11:57.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f64811700 1 -- 172.21.15.78:0/3341550305 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5000d4a0 con 0x7f1f60128e90 2024-04-25T02:11:57.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.601+0000 7f1f64811700 1 -- 172.21.15.78:0/3341550305 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000d820 con 0x7f1f60128e90 2024-04-25T02:11:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.602+0000 7f1f67a77700 1 -- 172.21.15.78:0/3341550305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 msgr2=0x7f1f60093c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.602+0000 7f1f67a77700 1 --2- 172.21.15.78:0/3341550305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 0x7f1f60093c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1f50009760 tx=0x7f1f50009060).stop 2024-04-25T02:11:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.602+0000 7f1f67a77700 1 -- 172.21.15.78:0/3341550305 shutdown_connections 2024-04-25T02:11:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.602+0000 7f1f67a77700 1 --2- 172.21.15.78:0/3341550305 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601289a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.602+0000 7f1f67a77700 1 --2- 172.21.15.78:0/3341550305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 0x7f1f60093c20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.602+0000 7f1f67a77700 1 -- 172.21.15.78:0/3341550305 >> 172.21.15.78:0/3341550305 conn(0x7f1f60097450 msgr2=0x7f1f60097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.602+0000 7f1f67a77700 1 -- 172.21.15.78:0/3341550305 shutdown_connections 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.602+0000 7f1f67a77700 1 -- 172.21.15.78:0/3341550305 wait complete. 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.603+0000 7f1f67a77700 1 Processor -- start 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.603+0000 7f1f67a77700 1 -- start start 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f67a77700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f67a77700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f60094110 0x7f1f60111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f67a77700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 0x7f1f60111a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f67a77700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f60113a80 con 0x7f1f60128e90 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f67a77700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f60095720 con 0x7f1f60094110 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f67a77700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f60115140 con 0x7f1f60062860 2024-04-25T02:11:57.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f65813700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f65813700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601226f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42386/0 (socket says 172.21.15.78:42386) 2024-04-25T02:11:57.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f65813700 1 -- 172.21.15.78:0/2298537133 learned_addr learned my addr 172.21.15.78:0/2298537133 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:57.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f65012700 1 --2- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f60094110 0x7f1f60111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f66014700 1 --2- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 0x7f1f60111a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f0ed3f25700 1 Processor -- start 2024-04-25T02:11:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f66014700 1 -- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 msgr2=0x7f1f601226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f66014700 1 --2- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f66014700 1 -- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f60094110 msgr2=0x7f1f60111590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f66014700 1 --2- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f60094110 0x7f1f60111590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f66014700 1 -- 172.21.15.78:0/2298537133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500092a0 con 0x7f1f60128e90 2024-04-25T02:11:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.604+0000 7f1f66014700 1 --2- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 0x7f1f60111a80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1f580031c0 tx=0x7f1f58007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f0ed3f25700 1 -- start start 2024-04-25T02:11:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f1f56777700 1 -- 172.21.15.78:0/2298537133 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58002240 con 0x7f1f60128e90 2024-04-25T02:11:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f1f56777700 1 -- 172.21.15.78:0/2298537133 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f58015070 con 0x7f1f60128e90 2024-04-25T02:11:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f60114b20 con 0x7f1f60128e90 2024-04-25T02:11:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f0ed3f25700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ecc062860 0x7f0ecc1271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f0ed3f25700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc127ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f0ed3f25700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc096490 con 0x7f0ecc095190 2024-04-25T02:11:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f0ed3f25700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc062c40 con 0x7f0ecc062860 2024-04-25T02:11:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f0ed3f25700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc091b90 con 0x7f0ecc1277a0 2024-04-25T02:11:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f0ed14c0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f0ed14c0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc127ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42396/0 (socket says 172.21.15.78:42396) 2024-04-25T02:11:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f0ed14c0700 1 -- 172.21.15.78:0/3907861446 learned_addr learned my addr 172.21.15.78:0/3907861446 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f1f56777700 1 -- 172.21.15.78:0/2298537133 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f580023a0 con 0x7f1f60128e90 2024-04-25T02:11:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.605+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f601131b0 con 0x7f1f60128e90 2024-04-25T02:11:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f0ed14c0700 1 -- 172.21.15.78:0/3907861446 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ecc062860 msgr2=0x7f0ecc1271f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:11:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f0ed14c0700 1 --2- 172.21.15.78:0/3907861446 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ecc062860 0x7f0ecc1271f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f0ed14c0700 1 -- 172.21.15.78:0/3907861446 >> v1:172.21.15.78:6789/0 conn(0x7f0ecc095190 legacy=0x7f0ecc095610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f0ed14c0700 1 -- 172.21.15.78:0/3907861446 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc091e50 con 0x7f0ecc1277a0 2024-04-25T02:11:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f0ed14c0700 1 --2- 172.21.15.78:0/3907861446 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc127ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0ec8009860 tx=0x7f0ec80090f0).ready entity=mon.2 client_cookie=856d9978a7395abd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f1f56777700 1 -- 172.21.15.78:0/2298537133 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f1f58001650 con 0x7f1f60128e90 2024-04-25T02:11:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f0ed0cbf700 1 -- 172.21.15.78:0/3907861446 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800b600 con 0x7f0ecc1277a0 2024-04-25T02:11:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f0ed0cbf700 1 -- 172.21.15.78:0/3907861446 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec800b760 con 0x7f0ecc1277a0 2024-04-25T02:11:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f1f56777700 1 -- 172.21.15.78:0/2298537133 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f1f5803e920 con 0x7f1f60128e90 2024-04-25T02:11:57.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f0ed0cbf700 1 -- 172.21.15.78:0/3907861446 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800bae0 con 0x7f0ecc1277a0 2024-04-25T02:11:57.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.606+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f60097f70 con 0x7f1f60128e90 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.607+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3907861446 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 msgr2=0x7f0ecc127ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.607+0000 7f0ed3f25700 1 --2- 172.21.15.78:0/3907861446 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc127ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0ec8009860 tx=0x7f0ec80090f0).stop 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.608+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3907861446 shutdown_connections 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.608+0000 7f0ed3f25700 1 --2- 172.21.15.78:0/3907861446 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ecc062860 0x7f0ecc1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.608+0000 7f0ed3f25700 1 --2- 172.21.15.78:0/3907861446 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc127ba0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.608+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3907861446 >> 172.21.15.78:0/3907861446 conn(0x7f0ecc097450 msgr2=0x7f0ecc097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.610+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3907861446 shutdown_connections 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.610+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3907861446 wait complete. 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.611+0000 7f0ed3f25700 1 Processor -- start 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.611+0000 7f0ed3f25700 1 -- start start 2024-04-25T02:11:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.611+0000 7f0ed3f25700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ecc062860 0x7f0ecc115dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.611+0000 7f0ed3f25700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ecc095190 0x7f0ecc1162b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.611+0000 7f0ed3f25700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc1167a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.611+0000 7f0ed3f25700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc116c90 con 0x7f0ecc062860 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.611+0000 7f0ed3f25700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc119090 con 0x7f0ecc095190 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.611+0000 7f0ed3f25700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc1179e0 con 0x7f0ecc1277a0 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed24c2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc1167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed24c2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc1167a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42412/0 (socket says 172.21.15.78:42412) 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed24c2700 1 -- 172.21.15.78:0/3622203407 learned_addr learned my addr 172.21.15.78:0/3622203407 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed14c0700 1 --2- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ecc095190 0x7f0ecc1162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed24c2700 1 -- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ecc095190 msgr2=0x7f0ecc1162b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed24c2700 1 --2- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ecc095190 0x7f0ecc1162b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed24c2700 1 -- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ecc062860 msgr2=0x7f0ecc115dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed24c2700 1 --2- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ecc062860 0x7f0ecc115dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed24c2700 1 -- 172.21.15.78:0/3622203407 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec8009370 con 0x7f0ecc1277a0 2024-04-25T02:11:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed24c2700 1 --2- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc1167a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0ec400b7e0 tx=0x7f0ec4009310).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ec27fc700 1 -- 172.21.15.78:0/3622203407 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400d5a0 con 0x7f0ecc1277a0 2024-04-25T02:11:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ec27fc700 1 -- 172.21.15.78:0/3622203407 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec400d740 con 0x7f0ecc1277a0 2024-04-25T02:11:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ec27fc700 1 -- 172.21.15.78:0/3622203407 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400db00 con 0x7f0ecc1277a0 2024-04-25T02:11:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc09a440 con 0x7f0ecc1277a0 2024-04-25T02:11:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.612+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc1198f0 con 0x7f0ecc1277a0 2024-04-25T02:11:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.613+0000 7f0ec27fc700 1 -- 172.21.15.78:0/3622203407 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f0ec4019460 con 0x7f0ecc1277a0 2024-04-25T02:11:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.613+0000 7f0ec27fc700 1 -- 172.21.15.78:0/3622203407 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f0ec403b3a0 con 0x7f0ecc1277a0 2024-04-25T02:11:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.613+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc097f70 con 0x7f0ecc1277a0 2024-04-25T02:11:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.615+0000 7f1f56777700 1 -- 172.21.15.78:0/2298537133 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f1f580218f0 con 0x7f1f60128e90 2024-04-25T02:11:57.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.622+0000 7f0ec27fc700 1 -- 172.21.15.78:0/3622203407 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f0ec4016900 con 0x7f0ecc1277a0 2024-04-25T02:11:57.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.714+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7ac8046ce0 con 0x7f7ac81277a0 2024-04-25T02:11:57.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.715+0000 7f7ab6ffd700 1 -- 172.21.15.78:0/3352767054 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7abc01b340 con 0x7f7ac81277a0 2024-04-25T02:11:57.722 INFO:teuthology.orchestra.run.smithi078.stdout:38654705690 2024-04-25T02:11:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 >> v1:172.21.15.78:6816/46507 conn(0x7f7aa802bd00 legacy=0x7f7aa802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac81277a0 msgr2=0x7f7ac812d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 --2- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac81277a0 0x7f7ac812d6d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f7abc00c4c0 tx=0x7f7abc007c50).stop 2024-04-25T02:11:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 shutdown_connections 2024-04-25T02:11:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 --2- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7ac812fb30 0x7f7ac812dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 --2- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ac8062860 0x7f7ac81128f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 --2- 172.21.15.78:0/3352767054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ac81277a0 0x7f7ac812d6d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 >> 172.21.15.78:0/3352767054 conn(0x7f7ac8097450 msgr2=0x7f7ac8092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 shutdown_connections 2024-04-25T02:11:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.717+0000 7f7acca93700 1 -- 172.21.15.78:0/3352767054 wait complete. 2024-04-25T02:11:57.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705690 for osd.0 2024-04-25T02:11:57.740 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:57.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.766+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb56012c850 con 0x7fb560099330 2024-04-25T02:11:57.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.766+0000 7fb5477fe700 1 -- 172.21.15.78:0/127934396 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb56012c850 con 0x7fb560099330 2024-04-25T02:11:57.774 INFO:teuthology.orchestra.run.smithi078.stdout:38654705691 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 >> v1:172.21.15.78:6816/46507 conn(0x7fb54c02bd00 legacy=0x7fb54c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb560099330 msgr2=0x7fb5601291c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 --2- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb560099330 0x7fb5601291c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb55400c590 tx=0x7fb554007c80).stop 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 shutdown_connections 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 --2- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb56012e130 0x7fb5601296b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 --2- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56005e960 0x7fb560128cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 --2- 172.21.15.78:0/127934396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb560099330 0x7fb5601291c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 >> 172.21.15.78:0/127934396 conn(0x7fb5600974d0 msgr2=0x7fb560094930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 shutdown_connections 2024-04-25T02:11:57.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.768+0000 7fb5651cb700 1 -- 172.21.15.78:0/127934396 wait complete. 2024-04-25T02:11:57.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705691 for osd.1 2024-04-25T02:11:57.787 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.782+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f60046ce0 con 0x7f1f60128e90 2024-04-25T02:11:57.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.782+0000 7f1f56777700 1 -- 172.21.15.78:0/2298537133 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f58021300 con 0x7f1f60128e90 2024-04-25T02:11:57.789 INFO:teuthology.orchestra.run.smithi078.stdout:38654705691 2024-04-25T02:11:57.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.783+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 >> v1:172.21.15.78:6816/46507 conn(0x7f1f4402bd30 legacy=0x7f1f4402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.783+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 msgr2=0x7f1f60111a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.783+0000 7f1f67a77700 1 --2- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 0x7f1f60111a80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1f580031c0 tx=0x7f1f58007ef0).stop 2024-04-25T02:11:57.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.784+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 shutdown_connections 2024-04-25T02:11:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.784+0000 7f1f67a77700 1 --2- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f60128e90 0x7f1f60111a80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.784+0000 7f1f67a77700 1 --2- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1f60062860 0x7f1f601226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.784+0000 7f1f67a77700 1 --2- 172.21.15.78:0/2298537133 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f60094110 0x7f1f60111590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.784+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 >> 172.21.15.78:0/2298537133 conn(0x7f1f60097450 msgr2=0x7f1f60098c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.784+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 shutdown_connections 2024-04-25T02:11:57.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.784+0000 7f1f67a77700 1 -- 172.21.15.78:0/2298537133 wait complete. 2024-04-25T02:11:57.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705691 for osd.2 2024-04-25T02:11:57.803 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:57.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.802+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ecc09a010 con 0x7f0ecc1277a0 2024-04-25T02:11:57.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.803+0000 7f0ec27fc700 1 -- 172.21.15.78:0/3622203407 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ec4016310 con 0x7f0ecc1277a0 2024-04-25T02:11:57.810 INFO:teuthology.orchestra.run.smithi078.stdout:38654705690 2024-04-25T02:11:57.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.804+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 >> v1:172.21.15.78:6816/46507 conn(0x7f0eb002bcd0 legacy=0x7f0eb002e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.804+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 msgr2=0x7f0ecc1167a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.804+0000 7f0ed3f25700 1 --2- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc1167a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0ec400b7e0 tx=0x7f0ec4009310).stop 2024-04-25T02:11:57.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.804+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 shutdown_connections 2024-04-25T02:11:57.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.804+0000 7f0ed3f25700 1 --2- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f0ecc1277a0 0x7f0ecc1167a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.804+0000 7f0ed3f25700 1 --2- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ecc062860 0x7f0ecc115dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:11:57.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.804+0000 7f0ed3f25700 1 --2- 172.21.15.78:0/3622203407 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ecc095190 0x7f0ecc1162b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.804+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 >> 172.21.15.78:0/3622203407 conn(0x7f0ecc097450 msgr2=0x7f0ecc12afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.805+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 shutdown_connections 2024-04-25T02:11:57.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.805+0000 7f0ed3f25700 1 -- 172.21.15.78:0/3622203407 wait complete. 2024-04-25T02:11:57.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705690 for osd.3 2024-04-25T02:11:57.824 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:57.824 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:11:57.824 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.972+0000 7f9916bb7700 1 Processor -- start 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.972+0000 7f9916bb7700 1 -- start start 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.972+0000 7f9916bb7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9910062860 0x7f99101271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.972+0000 7f9916bb7700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f99101277a0 0x7f9910127ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.972+0000 7f9916bb7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9910095190 0x7f9910095610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.972+0000 7f9916bb7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9910062c40 con 0x7f9910095190 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.972+0000 7f9916bb7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9910096490 con 0x7f9910062860 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.972+0000 7f9916bb7700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9910091e50 con 0x7f99101277a0 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f9914953700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9910062860 0x7f99101271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f9915154700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9910095190 0x7f9910095610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990ffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f99101277a0 0x7f9910127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f9915154700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9910095190 0x7f9910095610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60814/0 (socket says 172.21.15.78:60814) 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990ffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f99101277a0 0x7f9910127ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42418/0 (socket says 172.21.15.78:42418) 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f9914953700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9910062860 0x7f99101271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51692/0 (socket says 172.21.15.78:51692) 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990ffff700 1 -- 172.21.15.78:0/128418655 learned_addr learned my addr 172.21.15.78:0/128418655 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990ffff700 1 -- 172.21.15.78:0/128418655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9910062860 msgr2=0x7f99101271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990ffff700 1 --2- 172.21.15.78:0/128418655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9910062860 0x7f99101271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990ffff700 1 -- 172.21.15.78:0/128418655 >> v2:172.21.15.78:3300/0 conn(0x7f9910095190 msgr2=0x7f9910095610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990ffff700 1 --2- 172.21.15.78:0/128418655 >> v2:172.21.15.78:3300/0 conn(0x7f9910095190 0x7f9910095610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990ffff700 1 -- 172.21.15.78:0/128418655 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910091b90 con 0x7f99101277a0 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f9915154700 1 --2- 172.21.15.78:0/128418655 >> v2:172.21.15.78:3300/0 conn(0x7f9910095190 0x7f9910095610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f9914953700 1 --2- 172.21.15.78:0/128418655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9910062860 0x7f99101271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990ffff700 1 --2- 172.21.15.78:0/128418655 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f99101277a0 0x7f9910127ba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f98fc009830 tx=0x7f98fc0090f0).ready entity=mon.2 client_cookie=1ccfd5cb2e7b4e88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990f7fe700 1 -- 172.21.15.78:0/128418655 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00f510 con 0x7f99101277a0 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990f7fe700 1 -- 172.21.15.78:0/128418655 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc00f670 con 0x7f99101277a0 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.973+0000 7f990f7fe700 1 -- 172.21.15.78:0/128418655 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00f9f0 con 0x7f99101277a0 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.974+0000 7f9916bb7700 1 -- 172.21.15.78:0/128418655 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f99101277a0 msgr2=0x7f9910127ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.974+0000 7f9916bb7700 1 --2- 172.21.15.78:0/128418655 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f99101277a0 0x7f9910127ba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f98fc009830 tx=0x7f98fc0090f0).stop 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.974+0000 7f9916bb7700 1 -- 172.21.15.78:0/128418655 shutdown_connections 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.974+0000 7f9916bb7700 1 --2- 172.21.15.78:0/128418655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9910062860 0x7f99101271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.974+0000 7f9916bb7700 1 --2- 172.21.15.78:0/128418655 >> v2:172.21.15.78:3300/0 conn(0x7f9910095190 0x7f9910095610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.974+0000 7f9916bb7700 1 --2- 172.21.15.78:0/128418655 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f99101277a0 0x7f9910127ba0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.974+0000 7f9916bb7700 1 -- 172.21.15.78:0/128418655 >> 172.21.15.78:0/128418655 conn(0x7f9910097450 msgr2=0x7f9910097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.974+0000 7f9916bb7700 1 -- 172.21.15.78:0/128418655 shutdown_connections 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.974+0000 7f9916bb7700 1 -- 172.21.15.78:0/128418655 wait complete. 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9916bb7700 1 Processor -- start 2024-04-25T02:11:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9916bb7700 1 -- start start 2024-04-25T02:11:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9916bb7700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9910062860 0x7f9910119aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9916bb7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9910095190 0x7f9910115a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9916bb7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f99101277a0 0x7f9910115f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9916bb7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910126bd0 con 0x7f9910095190 2024-04-25T02:11:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9916bb7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9910127200 con 0x7f99101277a0 2024-04-25T02:11:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9916bb7700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9910096d20 con 0x7f9910062860 2024-04-25T02:11:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9914953700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9910062860 0x7f9910119aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f990ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9910095190 0x7f9910115a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9915154700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f99101277a0 0x7f9910115f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9914953700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9910062860 0x7f9910119aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42430/0 (socket says 172.21.15.78:42430) 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.975+0000 7f9914953700 1 -- 172.21.15.78:0/3502706031 learned_addr learned my addr 172.21.15.78:0/3502706031 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f9914953700 1 -- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f99101277a0 msgr2=0x7f9910115f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f9914953700 1 --2- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f99101277a0 0x7f9910115f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f9914953700 1 -- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9910095190 msgr2=0x7f9910115a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f9914953700 1 --2- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9910095190 0x7f9910115a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f9914953700 1 -- 172.21.15.78:0/3502706031 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040092a0 con 0x7f9910062860 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f9915154700 1 --2- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f99101277a0 0x7f9910115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f9914953700 1 --2- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9910062860 0x7f9910119aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f990400ea20 tx=0x7f9904009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f990d7fa700 1 -- 172.21.15.78:0/3502706031 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990400c850 con 0x7f9910062860 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f990d7fa700 1 -- 172.21.15.78:0/3502706031 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990400c9b0 con 0x7f9910062860 2024-04-25T02:11:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9908009a20 con 0x7f9910062860 2024-04-25T02:11:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f990d7fa700 1 -- 172.21.15.78:0/3502706031 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990400cd30 con 0x7f9910062860 2024-04-25T02:11:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.976+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc009370 con 0x7f9910062860 2024-04-25T02:11:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.977+0000 7f990d7fa700 1 -- 172.21.15.78:0/3502706031 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9904012600 con 0x7f9910062860 2024-04-25T02:11:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.977+0000 7f990d7fa700 1 -- 172.21.15.78:0/3502706031 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f990403b810 con 0x7f9910062860 2024-04-25T02:11:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.977+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9910119220 con 0x7f9910062860 2024-04-25T02:11:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:57.981+0000 7f990d7fa700 1 -- 172.21.15.78:0/3502706031 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f9910119220 con 0x7f9910062860 2024-04-25T02:11:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.136+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9910119220 con 0x7f98f402bd00 2024-04-25T02:11:58.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.143+0000 7f990d7fa700 1 -- 172.21.15.78:0/3502706031 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+255254 (unknown 2965378022 0 2402196640) 0x7f9910119220 con 0x7f98f402bd00 2024-04-25T02:11:58.154 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 >> v1:172.21.15.78:6816/46507 conn(0x7f98f402bd00 legacy=0x7f98f402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9910062860 msgr2=0x7f9910119aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 --2- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9910062860 0x7f9910119aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f990400ea20 tx=0x7f9904009060).stop 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 shutdown_connections 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 --2- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f99101277a0 0x7f9910115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 --2- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9910062860 0x7f9910119aa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 --2- 172.21.15.78:0/3502706031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9910095190 0x7f9910115a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 >> 172.21.15.78:0/3502706031 conn(0x7f9910097450 msgr2=0x7f991012ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 shutdown_connections 2024-04-25T02:11:58.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.146+0000 7f9916bb7700 1 -- 172.21.15.78:0/3502706031 wait complete. 2024-04-25T02:11:58.157 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:11:58.165 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-04-25T02:11:56.221525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189088,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298272,"statfs":{"total":386547056640,"available":385329430528,"internally_reserved":0,"allocated":720896,"data_stored":234188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002387"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834655+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:10:52.834655+0000","last_peered":"2024-04-25T02:10:52.834655+0000","last_clean":"2024-04-25T02:10:52.834655+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:10:52.834655+0000","last_undegraded":"2024-04-25T02:10:52.834655+0000","last_fullsized":"2024-04-25T02:10:52.834655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835477+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:10:52.835477+0000","last_peered":"2024-04-25T02:10:52.835477+0000","last_clean":"2024-04-25T02:10:52.835477+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:10:52.835477+0000","last_undegraded":"2024-04-25T02:10:52.835477+0000","last_fullsized":"2024-04-25T02:10:52.835477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836616+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:10:52.836616+0000","last_peered":"2024-04-25T02:10:52.836616+0000","last_clean":"2024-04-25T02:10:52.836616+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:10:52.836616+0000","last_undegraded":"2024-04-25T02:10:52.836616+0000","last_fullsized":"2024-04-25T02:10:52.836616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836126+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:10:52.836126+0000","last_peered":"2024-04-25T02:10:52.836126+0000","last_clean":"2024-04-25T02:10:52.836126+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:10:52.836126+0000","last_undegraded":"2024-04-25T02:10:52.836126+0000","last_fullsized":"2024-04-25T02:10:52.836126+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835782+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:10:52.835782+0000","last_peered":"2024-04-25T02:10:52.835782+0000","last_clean":"2024-04-25T02:10:52.835782+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:10:52.835782+0000","last_undegraded":"2024-04-25T02:10:52.835782+0000","last_fullsized":"2024-04-25T02:10:52.835782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840976+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:10:52.840976+0000","last_peered":"2024-04-25T02:10:52.840976+0000","last_clean":"2024-04-25T02:10:52.840976+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:10:52.840976+0000","last_undegraded":"2024-04-25T02:10:52.840976+0000","last_fullsized":"2024-04-25T02:10:52.840976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839052+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:10:52.839052+0000","last_peered":"2024-04-25T02:10:52.839052+0000","last_clean":"2024-04-25T02:10:52.839052+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:10:52.839052+0000","last_undegraded":"2024-04-25T02:10:52.839052+0000","last_fullsized":"2024-04-25T02:10:52.839052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837642+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:10:52.837642+0000","last_peered":"2024-04-25T02:10:52.837642+0000","last_clean":"2024-04-25T02:10:52.837642+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:10:52.837642+0000","last_undegraded":"2024-04-25T02:10:52.837642+0000","last_fullsized":"2024-04-25T02:10:52.837642+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837294+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:10:52.837294+0000","last_peered":"2024-04-25T02:10:52.837294+0000","last_clean":"2024-04-25T02:10:52.837294+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:10:52.837294+0000","last_undegraded":"2024-04-25T02:10:52.837294+0000","last_fullsized":"2024-04-25T02:10:52.837294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839101+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:10:52.839101+0000","last_peered":"2024-04-25T02:10:52.839101+0000","last_clean":"2024-04-25T02:10:52.839101+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:10:52.839101+0000","last_undegraded":"2024-04-25T02:10:52.839101+0000","last_fullsized":"2024-04-25T02:10:52.839101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839269+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:10:52.839269+0000","last_peered":"2024-04-25T02:10:52.839269+0000","last_clean":"2024-04-25T02:10:52.839269+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:10:52.839269+0000","last_undegraded":"2024-04-25T02:10:52.839269+0000","last_fullsized":"2024-04-25T02:10:52.839269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834921+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:10:52.834921+0000","last_peered":"2024-04-25T02:10:52.834921+0000","last_clean":"2024-04-25T02:10:52.834921+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:10:52.834921+0000","last_undegraded":"2024-04-25T02:10:52.834921+0000","last_fullsized":"2024-04-25T02:10:52.834921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834769+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:10:52.834769+0000","last_peered":"2024-04-25T02:10:52.834769+0000","last_clean":"2024-04-25T02:10:52.834769+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:10:52.834769+0000","last_undegraded":"2024-04-25T02:10:52.834769+0000","last_fullsized":"2024-04-25T02:10:52.834769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838193+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:10:52.838193+0000","last_peered":"2024-04-25T02:10:52.838193+0000","last_clean":"2024-04-25T02:10:52.838193+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:10:52.838193+0000","last_undegraded":"2024-04-25T02:10:52.838193+0000","last_fullsized":"2024-04-25T02:10:52.838193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835403+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:10:52.835403+0000","last_peered":"2024-04-25T02:10:52.835403+0000","last_clean":"2024-04-25T02:10:52.835403+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:10:52.835403+0000","last_undegraded":"2024-04-25T02:10:52.835403+0000","last_fullsized":"2024-04-25T02:10:52.835403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.852512+0000","last_change":"2024-04-25T02:10:53.852512+0000","last_active":"2024-04-25T02:10:53.852512+0000","last_peered":"2024-04-25T02:10:53.852512+0000","last_clean":"2024-04-25T02:10:53.852512+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:10:53.852512+0000","last_undegraded":"2024-04-25T02:10:53.852512+0000","last_fullsized":"2024-04-25T02:10:53.852512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837274+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:10:52.837274+0000","last_peered":"2024-04-25T02:10:52.837274+0000","last_clean":"2024-04-25T02:10:52.837274+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:10:52.837274+0000","last_undegraded":"2024-04-25T02:10:52.837274+0000","last_fullsized":"2024-04-25T02:10:52.837274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836854+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:10:52.836854+0000","last_peered":"2024-04-25T02:10:52.836854+0000","last_clean":"2024-04-25T02:10:52.836854+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:10:52.836854+0000","last_undegraded":"2024-04-25T02:10:52.836854+0000","last_fullsized":"2024-04-25T02:10:52.836854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835106+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:10:52.835106+0000","last_peered":"2024-04-25T02:10:52.835106+0000","last_clean":"2024-04-25T02:10:52.835106+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:10:52.835106+0000","last_undegraded":"2024-04-25T02:10:52.835106+0000","last_fullsized":"2024-04-25T02:10:52.835106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838282+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:10:52.838282+0000","last_peered":"2024-04-25T02:10:52.838282+0000","last_clean":"2024-04-25T02:10:52.838282+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:10:52.838282+0000","last_undegraded":"2024-04-25T02:10:52.838282+0000","last_fullsized":"2024-04-25T02:10:52.838282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.852792+0000","last_change":"2024-04-25T02:10:53.852792+0000","last_active":"2024-04-25T02:10:53.852792+0000","last_peered":"2024-04-25T02:10:53.852792+0000","last_clean":"2024-04-25T02:10:53.852792+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:10:53.852792+0000","last_undegraded":"2024-04-25T02:10:53.852792+0000","last_fullsized":"2024-04-25T02:10:53.852792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835465+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:10:52.835465+0000","last_peered":"2024-04-25T02:10:52.835465+0000","last_clean":"2024-04-25T02:10:52.835465+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:10:52.835465+0000","last_undegraded":"2024-04-25T02:10:52.835465+0000","last_fullsized":"2024-04-25T02:10:52.835465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838980+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:10:52.838980+0000","last_peered":"2024-04-25T02:10:52.838980+0000","last_clean":"2024-04-25T02:10:52.838980+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:10:52.838980+0000","last_undegraded":"2024-04-25T02:10:52.838980+0000","last_fullsized":"2024-04-25T02:10:52.838980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837643+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:10:52.837643+0000","last_peered":"2024-04-25T02:10:52.837643+0000","last_clean":"2024-04-25T02:10:52.837643+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:10:52.837643+0000","last_undegraded":"2024-04-25T02:10:52.837643+0000","last_fullsized":"2024-04-25T02:10:52.837643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840130+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:10:52.840130+0000","last_peered":"2024-04-25T02:10:52.840130+0000","last_clean":"2024-04-25T02:10:52.840130+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:10:52.840130+0000","last_undegraded":"2024-04-25T02:10:52.840130+0000","last_fullsized":"2024-04-25T02:10:52.840130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838926+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:10:52.838926+0000","last_peered":"2024-04-25T02:10:52.838926+0000","last_clean":"2024-04-25T02:10:52.838926+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:10:52.838926+0000","last_undegraded":"2024-04-25T02:10:52.838926+0000","last_fullsized":"2024-04-25T02:10:52.838926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841901+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:10:52.841901+0000","last_peered":"2024-04-25T02:10:52.841901+0000","last_clean":"2024-04-25T02:10:52.841901+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:10:52.841901+0000","last_undegraded":"2024-04-25T02:10:52.841901+0000","last_fullsized":"2024-04-25T02:10:52.841901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837739+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:10:52.837739+0000","last_peered":"2024-04-25T02:10:52.837739+0000","last_clean":"2024-04-25T02:10:52.837739+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:10:52.837739+0000","last_undegraded":"2024-04-25T02:10:52.837739+0000","last_fullsized":"2024-04-25T02:10:52.837739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841519+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:10:52.841519+0000","last_peered":"2024-04-25T02:10:52.841519+0000","last_clean":"2024-04-25T02:10:52.841519+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:10:52.841519+0000","last_undegraded":"2024-04-25T02:10:52.841519+0000","last_fullsized":"2024-04-25T02:10:52.841519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837641+0000","last_change":"2024-04-25T02:10:02.370405+0000","last_active":"2024-04-25T02:10:52.837641+0000","last_peered":"2024-04-25T02:10:52.837641+0000","last_clean":"2024-04-25T02:10:52.837641+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:10:52.837641+0000","last_undegraded":"2024-04-25T02:10:52.837641+0000","last_fullsized":"2024-04-25T02:10:52.837641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837015+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:10:52.837015+0000","last_peered":"2024-04-25T02:10:52.837015+0000","last_clean":"2024-04-25T02:10:52.837015+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:10:52.837015+0000","last_undegraded":"2024-04-25T02:10:52.837015+0000","last_fullsized":"2024-04-25T02:10:52.837015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839074+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:10:52.839074+0000","last_peered":"2024-04-25T02:10:52.839074+0000","last_clean":"2024-04-25T02:10:52.839074+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:10:52.839074+0000","last_undegraded":"2024-04-25T02:10:52.839074+0000","last_fullsized":"2024-04-25T02:10:52.839074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841781+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:10:52.841781+0000","last_peered":"2024-04-25T02:10:52.841781+0000","last_clean":"2024-04-25T02:10:52.841781+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:10:52.841781+0000","last_undegraded":"2024-04-25T02:10:52.841781+0000","last_fullsized":"2024-04-25T02:10:52.841781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837191+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:10:52.837191+0000","last_peered":"2024-04-25T02:10:52.837191+0000","last_clean":"2024-04-25T02:10:52.837191+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:10:52.837191+0000","last_undegraded":"2024-04-25T02:10:52.837191+0000","last_fullsized":"2024-04-25T02:10:52.837191+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839477+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:10:52.839477+0000","last_peered":"2024-04-25T02:10:52.839477+0000","last_clean":"2024-04-25T02:10:52.839477+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:10:52.839477+0000","last_undegraded":"2024-04-25T02:10:52.839477+0000","last_fullsized":"2024-04-25T02:10:52.839477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835186+0000","last_change":"2024-04-25T02:10:02.367526+0000","last_active":"2024-04-25T02:10:52.835186+0000","last_peered":"2024-04-25T02:10:52.835186+0000","last_clean":"2024-04-25T02:10:52.835186+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:10:52.835186+0000","last_undegraded":"2024-04-25T02:10:52.835186+0000","last_fullsized":"2024-04-25T02:10:52.835186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839424+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:10:52.839424+0000","last_peered":"2024-04-25T02:10:52.839424+0000","last_clean":"2024-04-25T02:10:52.839424+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:10:52.839424+0000","last_undegraded":"2024-04-25T02:10:52.839424+0000","last_fullsized":"2024-04-25T02:10:52.839424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836837+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:10:52.836837+0000","last_peered":"2024-04-25T02:10:52.836837+0000","last_clean":"2024-04-25T02:10:52.836837+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:10:52.836837+0000","last_undegraded":"2024-04-25T02:10:52.836837+0000","last_fullsized":"2024-04-25T02:10:52.836837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838087+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:10:52.838087+0000","last_peered":"2024-04-25T02:10:52.838087+0000","last_clean":"2024-04-25T02:10:52.838087+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:10:52.838087+0000","last_undegraded":"2024-04-25T02:10:52.838087+0000","last_fullsized":"2024-04-25T02:10:52.838087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'10","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840055+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:10:52.840055+0000","last_peered":"2024-04-25T02:10:52.840055+0000","last_clean":"2024-04-25T02:10:52.840055+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:10:52.840055+0000","last_undegraded":"2024-04-25T02:10:52.840055+0000","last_fullsized":"2024-04-25T02:10:52.840055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2896,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.855075+0000","last_change":"2024-04-25T02:10:53.855075+0000","last_active":"2024-04-25T02:10:53.855075+0000","last_peered":"2024-04-25T02:10:53.855075+0000","last_clean":"2024-04-25T02:10:53.855075+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:10:53.855075+0000","last_undegraded":"2024-04-25T02:10:53.855075+0000","last_fullsized":"2024-04-25T02:10:53.855075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842571+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:10:52.842571+0000","last_peered":"2024-04-25T02:10:52.842571+0000","last_clean":"2024-04-25T02:10:52.842571+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:10:52.842571+0000","last_undegraded":"2024-04-25T02:10:52.842571+0000","last_fullsized":"2024-04-25T02:10:52.842571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.850733+0000","last_change":"2024-04-25T02:10:53.850733+0000","last_active":"2024-04-25T02:10:53.850733+0000","last_peered":"2024-04-25T02:10:53.850733+0000","last_clean":"2024-04-25T02:10:53.850733+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:10:53.850733+0000","last_undegraded":"2024-04-25T02:10:53.850733+0000","last_fullsized":"2024-04-25T02:10:53.850733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835508+0000","last_change":"2024-04-25T02:10:02.370169+0000","last_active":"2024-04-25T02:10:52.835508+0000","last_peered":"2024-04-25T02:10:52.835508+0000","last_clean":"2024-04-25T02:10:52.835508+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:10:52.835508+0000","last_undegraded":"2024-04-25T02:10:52.835508+0000","last_fullsized":"2024-04-25T02:10:52.835508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842100+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:10:52.842100+0000","last_peered":"2024-04-25T02:10:52.842100+0000","last_clean":"2024-04-25T02:10:52.842100+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:10:52.842100+0000","last_undegraded":"2024-04-25T02:10:52.842100+0000","last_fullsized":"2024-04-25T02:10:52.842100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839346+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:10:52.839346+0000","last_peered":"2024-04-25T02:10:52.839346+0000","last_clean":"2024-04-25T02:10:52.839346+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:10:52.839346+0000","last_undegraded":"2024-04-25T02:10:52.839346+0000","last_fullsized":"2024-04-25T02:10:52.839346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837120+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:10:52.837120+0000","last_peered":"2024-04-25T02:10:52.837120+0000","last_clean":"2024-04-25T02:10:52.837120+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:10:52.837120+0000","last_undegraded":"2024-04-25T02:10:52.837120+0000","last_fullsized":"2024-04-25T02:10:52.837120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837919+0000","last_change":"2024-04-25T02:10:02.360557+0000","last_active":"2024-04-25T02:10:52.837919+0000","last_peered":"2024-04-25T02:10:52.837919+0000","last_clean":"2024-04-25T02:10:52.837919+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:10:52.837919+0000","last_undegraded":"2024-04-25T02:10:52.837919+0000","last_fullsized":"2024-04-25T02:10:52.837919+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.853097+0000","last_change":"2024-04-25T02:10:53.853097+0000","last_active":"2024-04-25T02:10:53.853097+0000","last_peered":"2024-04-25T02:10:53.853097+0000","last_clean":"2024-04-25T02:10:53.853097+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:10:53.853097+0000","last_undegraded":"2024-04-25T02:10:53.853097+0000","last_fullsized":"2024-04-25T02:10:53.853097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836949+0000","last_change":"2024-04-25T02:10:02.370637+0000","last_active":"2024-04-25T02:10:52.836949+0000","last_peered":"2024-04-25T02:10:52.836949+0000","last_clean":"2024-04-25T02:10:52.836949+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:10:52.836949+0000","last_undegraded":"2024-04-25T02:10:52.836949+0000","last_fullsized":"2024-04-25T02:10:52.836949+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839553+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:10:52.839553+0000","last_peered":"2024-04-25T02:10:52.839553+0000","last_clean":"2024-04-25T02:10:52.839553+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:10:52.839553+0000","last_undegraded":"2024-04-25T02:10:52.839553+0000","last_fullsized":"2024-04-25T02:10:52.839553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835283+0000","last_change":"2024-04-25T02:10:02.358829+0000","last_active":"2024-04-25T02:10:52.835283+0000","last_peered":"2024-04-25T02:10:52.835283+0000","last_clean":"2024-04-25T02:10:52.835283+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:10:52.835283+0000","last_undegraded":"2024-04-25T02:10:52.835283+0000","last_fullsized":"2024-04-25T02:10:52.835283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837740+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:10:52.837740+0000","last_peered":"2024-04-25T02:10:52.837740+0000","last_clean":"2024-04-25T02:10:52.837740+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:10:52.837740+0000","last_undegraded":"2024-04-25T02:10:52.837740+0000","last_fullsized":"2024-04-25T02:10:52.837740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841595+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:10:52.841595+0000","last_peered":"2024-04-25T02:10:52.841595+0000","last_clean":"2024-04-25T02:10:52.841595+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:10:52.841595+0000","last_undegraded":"2024-04-25T02:10:52.841595+0000","last_fullsized":"2024-04-25T02:10:52.841595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834988+0000","last_change":"2024-04-25T02:10:02.744548+0000","last_active":"2024-04-25T02:10:52.834988+0000","last_peered":"2024-04-25T02:10:52.834988+0000","last_clean":"2024-04-25T02:10:52.834988+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:10:52.834988+0000","last_undegraded":"2024-04-25T02:10:52.834988+0000","last_fullsized":"2024-04-25T02:10:52.834988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836348+0000","last_change":"2024-04-25T02:10:02.371223+0000","last_active":"2024-04-25T02:10:52.836348+0000","last_peered":"2024-04-25T02:10:52.836348+0000","last_clean":"2024-04-25T02:10:52.836348+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:10:52.836348+0000","last_undegraded":"2024-04-25T02:10:52.836348+0000","last_fullsized":"2024-04-25T02:10:52.836348+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836099+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:10:52.836099+0000","last_peered":"2024-04-25T02:10:52.836099+0000","last_clean":"2024-04-25T02:10:52.836099+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:10:52.836099+0000","last_undegraded":"2024-04-25T02:10:52.836099+0000","last_fullsized":"2024-04-25T02:10:52.836099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842417+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:10:52.842417+0000","last_peered":"2024-04-25T02:10:52.842417+0000","last_clean":"2024-04-25T02:10:52.842417+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:10:52.842417+0000","last_undegraded":"2024-04-25T02:10:52.842417+0000","last_fullsized":"2024-04-25T02:10:52.842417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836263+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:10:52.836263+0000","last_peered":"2024-04-25T02:10:52.836263+0000","last_clean":"2024-04-25T02:10:52.836263+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:10:52.836263+0000","last_undegraded":"2024-04-25T02:10:52.836263+0000","last_fullsized":"2024-04-25T02:10:52.836263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841434+0000","last_change":"2024-04-25T02:10:02.367348+0000","last_active":"2024-04-25T02:10:52.841434+0000","last_peered":"2024-04-25T02:10:52.841434+0000","last_clean":"2024-04-25T02:10:52.841434+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:10:52.841434+0000","last_undegraded":"2024-04-25T02:10:52.841434+0000","last_fullsized":"2024-04-25T02:10:52.841434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.851188+0000","last_change":"2024-04-25T02:10:53.851188+0000","last_active":"2024-04-25T02:10:53.851188+0000","last_peered":"2024-04-25T02:10:53.851188+0000","last_clean":"2024-04-25T02:10:53.851188+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:10:53.851188+0000","last_undegraded":"2024-04-25T02:10:53.851188+0000","last_fullsized":"2024-04-25T02:10:53.851188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839132+0000","last_change":"2024-04-25T02:10:02.360699+0000","last_active":"2024-04-25T02:10:52.839132+0000","last_peered":"2024-04-25T02:10:52.839132+0000","last_clean":"2024-04-25T02:10:52.839132+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:10:52.839132+0000","last_undegraded":"2024-04-25T02:10:52.839132+0000","last_fullsized":"2024-04-25T02:10:52.839132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835374+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:10:52.835374+0000","last_peered":"2024-04-25T02:10:52.835374+0000","last_clean":"2024-04-25T02:10:52.835374+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:10:52.835374+0000","last_undegraded":"2024-04-25T02:10:52.835374+0000","last_fullsized":"2024-04-25T02:10:52.835374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838818+0000","last_change":"2024-04-25T02:10:02.365974+0000","last_active":"2024-04-25T02:10:52.838818+0000","last_peered":"2024-04-25T02:10:52.838818+0000","last_clean":"2024-04-25T02:10:52.838818+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:10:52.838818+0000","last_undegraded":"2024-04-25T02:10:52.838818+0000","last_fullsized":"2024-04-25T02:10:52.838818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840045+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:10:52.840045+0000","last_peered":"2024-04-25T02:10:52.840045+0000","last_clean":"2024-04-25T02:10:52.840045+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:10:52.840045+0000","last_undegraded":"2024-04-25T02:10:52.840045+0000","last_fullsized":"2024-04-25T02:10:52.840045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838364+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:10:52.838364+0000","last_peered":"2024-04-25T02:10:52.838364+0000","last_clean":"2024-04-25T02:10:52.838364+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:10:52.838364+0000","last_undegraded":"2024-04-25T02:10:52.838364+0000","last_fullsized":"2024-04-25T02:10:52.838364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835144+0000","last_change":"2024-04-25T02:10:02.367538+0000","last_active":"2024-04-25T02:10:52.835144+0000","last_peered":"2024-04-25T02:10:52.835144+0000","last_clean":"2024-04-25T02:10:52.835144+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:10:52.835144+0000","last_undegraded":"2024-04-25T02:10:52.835144+0000","last_fullsized":"2024-04-25T02:10:52.835144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837991+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:10:52.837991+0000","last_peered":"2024-04-25T02:10:52.837991+0000","last_clean":"2024-04-25T02:10:52.837991+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:10:52.837991+0000","last_undegraded":"2024-04-25T02:10:52.837991+0000","last_fullsized":"2024-04-25T02:10:52.837991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839925+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:52.839925+0000","last_peered":"2024-04-25T02:10:52.839925+0000","last_clean":"2024-04-25T02:10:52.839925+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:52.839925+0000","last_undegraded":"2024-04-25T02:10:52.839925+0000","last_fullsized":"2024-04-25T02:10:52.839925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835852+0000","last_change":"2024-04-25T02:10:02.360464+0000","last_active":"2024-04-25T02:10:52.835852+0000","last_peered":"2024-04-25T02:10:52.835852+0000","last_clean":"2024-04-25T02:10:52.835852+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:10:52.835852+0000","last_undegraded":"2024-04-25T02:10:52.835852+0000","last_fullsized":"2024-04-25T02:10:52.835852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838199+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:10:52.838199+0000","last_peered":"2024-04-25T02:10:52.838199+0000","last_clean":"2024-04-25T02:10:52.838199+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:10:52.838199+0000","last_undegraded":"2024-04-25T02:10:52.838199+0000","last_fullsized":"2024-04-25T02:10:52.838199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834714+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:10:52.834714+0000","last_peered":"2024-04-25T02:10:52.834714+0000","last_clean":"2024-04-25T02:10:52.834714+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:10:52.834714+0000","last_undegraded":"2024-04-25T02:10:52.834714+0000","last_fullsized":"2024-04-25T02:10:52.834714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837802+0000","last_change":"2024-04-25T02:10:02.361010+0000","last_active":"2024-04-25T02:10:52.837802+0000","last_peered":"2024-04-25T02:10:52.837802+0000","last_clean":"2024-04-25T02:10:52.837802+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:10:52.837802+0000","last_undegraded":"2024-04-25T02:10:52.837802+0000","last_fullsized":"2024-04-25T02:10:52.837802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839897+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:10:52.839897+0000","last_peered":"2024-04-25T02:10:52.839897+0000","last_clean":"2024-04-25T02:10:52.839897+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:10:52.839897+0000","last_undegraded":"2024-04-25T02:10:52.839897+0000","last_fullsized":"2024-04-25T02:10:52.839897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842499+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:52.842499+0000","last_peered":"2024-04-25T02:10:52.842499+0000","last_clean":"2024-04-25T02:10:52.842499+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:52.842499+0000","last_undegraded":"2024-04-25T02:10:52.842499+0000","last_fullsized":"2024-04-25T02:10:52.842499+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837741+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:10:52.837741+0000","last_peered":"2024-04-25T02:10:52.837741+0000","last_clean":"2024-04-25T02:10:52.837741+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:10:52.837741+0000","last_undegraded":"2024-04-25T02:10:52.837741+0000","last_fullsized":"2024-04-25T02:10:52.837741+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839818+0000","last_change":"2024-04-25T02:10:02.364629+0000","last_active":"2024-04-25T02:10:52.839818+0000","last_peered":"2024-04-25T02:10:52.839818+0000","last_clean":"2024-04-25T02:10:52.839818+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:10:52.839818+0000","last_undegraded":"2024-04-25T02:10:52.839818+0000","last_fullsized":"2024-04-25T02:10:52.839818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842001+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:10:52.842001+0000","last_peered":"2024-04-25T02:10:52.842001+0000","last_clean":"2024-04-25T02:10:52.842001+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:10:52.842001+0000","last_undegraded":"2024-04-25T02:10:52.842001+0000","last_fullsized":"2024-04-25T02:10:52.842001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838954+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:52.838954+0000","last_peered":"2024-04-25T02:10:52.838954+0000","last_clean":"2024-04-25T02:10:52.838954+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:52.838954+0000","last_undegraded":"2024-04-25T02:10:52.838954+0000","last_fullsized":"2024-04-25T02:10:52.838954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835356+0000","last_change":"2024-04-25T02:10:02.356105+0000","last_active":"2024-04-25T02:10:52.835356+0000","last_peered":"2024-04-25T02:10:52.835356+0000","last_clean":"2024-04-25T02:10:52.835356+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:10:52.835356+0000","last_undegraded":"2024-04-25T02:10:52.835356+0000","last_fullsized":"2024-04-25T02:10:52.835356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837188+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:10:52.837188+0000","last_peered":"2024-04-25T02:10:52.837188+0000","last_clean":"2024-04-25T02:10:52.837188+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:10:52.837188+0000","last_undegraded":"2024-04-25T02:10:52.837188+0000","last_fullsized":"2024-04-25T02:10:52.837188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841699+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:52.841699+0000","last_peered":"2024-04-25T02:10:52.841699+0000","last_clean":"2024-04-25T02:10:52.841699+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:52.841699+0000","last_undegraded":"2024-04-25T02:10:52.841699+0000","last_fullsized":"2024-04-25T02:10:52.841699+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838085+0000","last_change":"2024-04-25T02:10:02.360478+0000","last_active":"2024-04-25T02:10:52.838085+0000","last_peered":"2024-04-25T02:10:52.838085+0000","last_clean":"2024-04-25T02:10:52.838085+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:10:52.838085+0000","last_undegraded":"2024-04-25T02:10:52.838085+0000","last_fullsized":"2024-04-25T02:10:52.838085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836070+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:10:52.836070+0000","last_peered":"2024-04-25T02:10:52.836070+0000","last_clean":"2024-04-25T02:10:52.836070+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:10:52.836070+0000","last_undegraded":"2024-04-25T02:10:52.836070+0000","last_fullsized":"2024-04-25T02:10:52.836070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841170+0000","last_change":"2024-04-25T02:10:02.370193+0000","last_active":"2024-04-25T02:10:52.841170+0000","last_peered":"2024-04-25T02:10:52.841170+0000","last_clean":"2024-04-25T02:10:52.841170+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:10:52.841170+0000","last_undegraded":"2024-04-25T02:10:52.841170+0000","last_fullsized":"2024-04-25T02:10:52.841170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839006+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:10:52.839006+0000","last_peered":"2024-04-25T02:10:52.839006+0000","last_clean":"2024-04-25T02:10:52.839006+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:10:52.839006+0000","last_undegraded":"2024-04-25T02:10:52.839006+0000","last_fullsized":"2024-04-25T02:10:52.839006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838885+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:10:52.838885+0000","last_peered":"2024-04-25T02:10:52.838885+0000","last_clean":"2024-04-25T02:10:52.838885+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:10:52.838885+0000","last_undegraded":"2024-04-25T02:10:52.838885+0000","last_fullsized":"2024-04-25T02:10:52.838885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841219+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:52.841219+0000","last_peered":"2024-04-25T02:10:52.841219+0000","last_clean":"2024-04-25T02:10:52.841219+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:52.841219+0000","last_undegraded":"2024-04-25T02:10:52.841219+0000","last_fullsized":"2024-04-25T02:10:52.841219+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836938+0000","last_change":"2024-04-25T02:10:02.370537+0000","last_active":"2024-04-25T02:10:52.836938+0000","last_peered":"2024-04-25T02:10:52.836938+0000","last_clean":"2024-04-25T02:10:52.836938+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:10:52.836938+0000","last_undegraded":"2024-04-25T02:10:52.836938+0000","last_fullsized":"2024-04-25T02:10:52.836938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834555+0000","last_change":"2024-04-25T02:10:02.748709+0000","last_active":"2024-04-25T02:10:52.834555+0000","last_peered":"2024-04-25T02:10:52.834555+0000","last_clean":"2024-04-25T02:10:52.834555+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:10:52.834555+0000","last_undegraded":"2024-04-25T02:10:52.834555+0000","last_fullsized":"2024-04-25T02:10:52.834555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836001+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:10:52.836001+0000","last_peered":"2024-04-25T02:10:52.836001+0000","last_clean":"2024-04-25T02:10:52.836001+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:10:52.836001+0000","last_undegraded":"2024-04-25T02:10:52.836001+0000","last_fullsized":"2024-04-25T02:10:52.836001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835021+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:10:52.835021+0000","last_peered":"2024-04-25T02:10:52.835021+0000","last_clean":"2024-04-25T02:10:52.835021+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:10:52.835021+0000","last_undegraded":"2024-04-25T02:10:52.835021+0000","last_fullsized":"2024-04-25T02:10:52.835021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838451+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:10:52.838451+0000","last_peered":"2024-04-25T02:10:52.838451+0000","last_clean":"2024-04-25T02:10:52.838451+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:10:52.838451+0000","last_undegraded":"2024-04-25T02:10:52.838451+0000","last_fullsized":"2024-04-25T02:10:52.838451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834861+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:10:52.834861+0000","last_peered":"2024-04-25T02:10:52.834861+0000","last_clean":"2024-04-25T02:10:52.834861+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:10:52.834861+0000","last_undegraded":"2024-04-25T02:10:52.834861+0000","last_fullsized":"2024-04-25T02:10:52.834861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841757+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:10:52.841757+0000","last_peered":"2024-04-25T02:10:52.841757+0000","last_clean":"2024-04-25T02:10:52.841757+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:10:52.841757+0000","last_undegraded":"2024-04-25T02:10:52.841757+0000","last_fullsized":"2024-04-25T02:10:52.841757+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834889+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:10:52.834889+0000","last_peered":"2024-04-25T02:10:52.834889+0000","last_clean":"2024-04-25T02:10:52.834889+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:10:52.834889+0000","last_undegraded":"2024-04-25T02:10:52.834889+0000","last_fullsized":"2024-04-25T02:10:52.834889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840065+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:10:52.840065+0000","last_peered":"2024-04-25T02:10:52.840065+0000","last_clean":"2024-04-25T02:10:52.840065+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:10:52.840065+0000","last_undegraded":"2024-04-25T02:10:52.840065+0000","last_fullsized":"2024-04-25T02:10:52.840065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839501+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:10:52.839501+0000","last_peered":"2024-04-25T02:10:52.839501+0000","last_clean":"2024-04-25T02:10:52.839501+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:10:52.839501+0000","last_undegraded":"2024-04-25T02:10:52.839501+0000","last_fullsized":"2024-04-25T02:10:52.839501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837222+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:10:52.837222+0000","last_peered":"2024-04-25T02:10:52.837222+0000","last_clean":"2024-04-25T02:10:52.837222+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:10:52.837222+0000","last_undegraded":"2024-04-25T02:10:52.837222+0000","last_fullsized":"2024-04-25T02:10:52.837222+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834152+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:10:52.834152+0000","last_peered":"2024-04-25T02:10:52.834152+0000","last_clean":"2024-04-25T02:10:52.834152+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:10:52.834152+0000","last_undegraded":"2024-04-25T02:10:52.834152+0000","last_fullsized":"2024-04-25T02:10:52.834152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837906+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:10:52.837906+0000","last_peered":"2024-04-25T02:10:52.837906+0000","last_clean":"2024-04-25T02:10:52.837906+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:10:52.837906+0000","last_undegraded":"2024-04-25T02:10:52.837906+0000","last_fullsized":"2024-04-25T02:10:52.837906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839211+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:10:52.839211+0000","last_peered":"2024-04-25T02:10:52.839211+0000","last_clean":"2024-04-25T02:10:52.839211+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:10:52.839211+0000","last_undegraded":"2024-04-25T02:10:52.839211+0000","last_fullsized":"2024-04-25T02:10:52.839211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835554+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:10:52.835554+0000","last_peered":"2024-04-25T02:10:52.835554+0000","last_clean":"2024-04-25T02:10:52.835554+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:10:52.835554+0000","last_undegraded":"2024-04-25T02:10:52.835554+0000","last_fullsized":"2024-04-25T02:10:52.835554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842334+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:10:52.842334+0000","last_peered":"2024-04-25T02:10:52.842334+0000","last_clean":"2024-04-25T02:10:52.842334+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:10:52.842334+0000","last_undegraded":"2024-04-25T02:10:52.842334+0000","last_fullsized":"2024-04-25T02:10:52.842334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838540+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:10:52.838540+0000","last_peered":"2024-04-25T02:10:52.838540+0000","last_clean":"2024-04-25T02:10:52.838540+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:10:52.838540+0000","last_undegraded":"2024-04-25T02:10:52.838540+0000","last_fullsized":"2024-04-25T02:10:52.838540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":59610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.35199999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705690,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":59804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.434},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.36599999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":57414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.14399999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.193}]},{"osd":2,"last update":"Thu Apr 25 02:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.248}]},{"osd":3,"last update":"Thu Apr 25 02:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25700000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":57360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.254},{"interface":"front","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.32900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:11:58.169 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:11:58.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e6a60e700 1 Processor -- start 2024-04-25T02:11:58.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e6a60e700 1 -- start start 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e6a60e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64127eb0 0x7f2e641271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e6a60e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e6412fb30 0x7f2e64131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e6a60e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e64096490 con 0x7f2e64062860 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e6a60e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e64062c40 con 0x7f2e6412fb30 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e6a60e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64091b90 con 0x7f2e64127eb0 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e637fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64127eb0 0x7f2e641271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e63fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2e64062860 0x7f2e641277a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39918/0 (socket says 172.21.15.78:39918) 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e63fff700 1 -- 172.21.15.78:0/3208595634 learned_addr learned my addr 172.21.15.78:0/3208595634 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.313+0000 7f2e68bab700 1 --2- 172.21.15.78:0/3208595634 >> v2:172.21.15.78:3300/0 conn(0x7f2e6412fb30 0x7f2e64131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e62ffd700 1 -- 172.21.15.78:0/3208595634 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645386409 0 0) 0x7f2e64096490 con 0x7f2e64062860 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e62ffd700 1 -- 172.21.15.78:0/3208595634 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e4c0033f0 con 0x7f2e64062860 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e637fe700 1 -- 172.21.15.78:0/3208595634 >> v2:172.21.15.78:3300/0 conn(0x7f2e6412fb30 msgr2=0x7f2e64131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e637fe700 1 --2- 172.21.15.78:0/3208595634 >> v2:172.21.15.78:3300/0 conn(0x7f2e6412fb30 0x7f2e64131f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e637fe700 1 -- 172.21.15.78:0/3208595634 >> v1:172.21.15.78:6789/0 conn(0x7f2e64062860 legacy=0x7f2e641277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e637fe700 1 -- 172.21.15.78:0/3208595634 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64091e50 con 0x7f2e64127eb0 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e68bab700 1 --2- 172.21.15.78:0/3208595634 >> v2:172.21.15.78:3300/0 conn(0x7f2e6412fb30 0x7f2e64131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e637fe700 1 --2- 172.21.15.78:0/3208595634 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64127eb0 0x7f2e641271f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f2e54009790 tx=0x7f2e54009060).ready entity=mon.2 client_cookie=bb048d6fe3b3ff66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e62ffd700 1 -- 172.21.15.78:0/3208595634 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400d4a0 con 0x7f2e64127eb0 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e62ffd700 1 -- 172.21.15.78:0/3208595634 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400d600 con 0x7f2e64127eb0 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e62ffd700 1 -- 172.21.15.78:0/3208595634 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400d980 con 0x7f2e64127eb0 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e6a60e700 1 -- 172.21.15.78:0/3208595634 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64127eb0 msgr2=0x7f2e641271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e6a60e700 1 --2- 172.21.15.78:0/3208595634 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64127eb0 0x7f2e641271f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f2e54009790 tx=0x7f2e54009060).stop 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e6a60e700 1 -- 172.21.15.78:0/3208595634 shutdown_connections 2024-04-25T02:11:58.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e6a60e700 1 --2- 172.21.15.78:0/3208595634 >> v2:172.21.15.78:3300/0 conn(0x7f2e6412fb30 0x7f2e64131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e6a60e700 1 --2- 172.21.15.78:0/3208595634 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64127eb0 0x7f2e641271f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e6a60e700 1 -- 172.21.15.78:0/3208595634 >> 172.21.15.78:0/3208595634 conn(0x7f2e64097450 msgr2=0x7f2e64097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e6a60e700 1 -- 172.21.15.78:0/3208595634 shutdown_connections 2024-04-25T02:11:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.314+0000 7f2e6a60e700 1 -- 172.21.15.78:0/3208595634 wait complete. 2024-04-25T02:11:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.315+0000 7f2e6a60e700 1 Processor -- start 2024-04-25T02:11:58.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e6a60e700 1 -- start start 2024-04-25T02:11:58.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e6a60e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64062860 0x7f2e64110ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e6a60e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e64127eb0 0x7f2e6412bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e6a60e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e6412fb30 0x7f2e6412c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e6a60e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64132060 con 0x7f2e64127eb0 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e6a60e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6412d220 con 0x7f2e6412fb30 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e6a60e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6412d860 con 0x7f2e64062860 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e63fff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64062860 0x7f2e64110ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e64127eb0 0x7f2e6412bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e64127eb0 0x7f2e6412bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60840/0 (socket says 172.21.15.78:60840) 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e63fff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64062860 0x7f2e64110ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42452/0 (socket says 172.21.15.78:42452) 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e637fe700 1 -- 172.21.15.78:0/1508229733 learned_addr learned my addr 172.21.15.78:0/1508229733 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e68bab700 1 --2- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e6412fb30 0x7f2e6412c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e637fe700 1 -- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64062860 msgr2=0x7f2e64110ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e637fe700 1 --2- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64062860 0x7f2e64110ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e637fe700 1 -- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e6412fb30 msgr2=0x7f2e6412c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e637fe700 1 --2- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e6412fb30 0x7f2e6412c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e637fe700 1 -- 172.21.15.78:0/1508229733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c009a20 con 0x7f2e64127eb0 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e63fff700 1 --2- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64062860 0x7f2e64110ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.316+0000 7f2e637fe700 1 --2- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e64127eb0 0x7f2e6412bd80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2e64091cd0 tx=0x7f2e54016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.317+0000 7f2e60ff9700 1 -- 172.21.15.78:0/1508229733 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54000c90 con 0x7f2e64127eb0 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.317+0000 7f2e60ff9700 1 -- 172.21.15.78:0/1508229733 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400d770 con 0x7f2e64127eb0 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.317+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e540092a0 con 0x7f2e64127eb0 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.317+0000 7f2e60ff9700 1 -- 172.21.15.78:0/1508229733 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5401d430 con 0x7f2e64127eb0 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.317+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6412df90 con 0x7f2e64127eb0 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.317+0000 7f2e60ff9700 1 -- 172.21.15.78:0/1508229733 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f2e5401d820 con 0x7f2e64127eb0 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.317+0000 7f2e60ff9700 1 -- 172.21.15.78:0/1508229733 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f2e5403c1d0 con 0x7f2e64127eb0 2024-04-25T02:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.318+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6412ee40 con 0x7f2e64127eb0 2024-04-25T02:11:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.322+0000 7f2e60ff9700 1 -- 172.21.15.78:0/1508229733 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f2e54022020 con 0x7f2e64127eb0 2024-04-25T02:11:58.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.476+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e64097f70 con 0x7f2e5002bd00 2024-04-25T02:11:58.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.483+0000 7f2e60ff9700 1 -- 172.21.15.78:0/1508229733 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+255268 (unknown 2965378022 0 4133866945) 0x7f2e64097f70 con 0x7f2e5002bd00 2024-04-25T02:11:58.493 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:11:58.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.485+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 >> v1:172.21.15.78:6816/46507 conn(0x7f2e5002bd00 legacy=0x7f2e5002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.485+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e64127eb0 msgr2=0x7f2e6412bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.485+0000 7f2e6a60e700 1 --2- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e64127eb0 0x7f2e6412bd80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2e64091cd0 tx=0x7f2e54016000).stop 2024-04-25T02:11:58.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.485+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 shutdown_connections 2024-04-25T02:11:58.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.485+0000 7f2e6a60e700 1 --2- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e6412fb30 0x7f2e6412c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.485+0000 7f2e6a60e700 1 --2- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2e64062860 0x7f2e64110ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.485+0000 7f2e6a60e700 1 --2- 172.21.15.78:0/1508229733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e64127eb0 0x7f2e6412bd80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.485+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 >> 172.21.15.78:0/1508229733 conn(0x7f2e64097450 msgr2=0x7f2e64092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:58.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.486+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 shutdown_connections 2024-04-25T02:11:58.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.486+0000 7f2e6a60e700 1 -- 172.21.15.78:0/1508229733 wait complete. 2024-04-25T02:11:58.496 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:11:58.504 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-25T02:11:58.221981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189088,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298272,"statfs":{"total":386547056640,"available":385329430528,"internally_reserved":0,"allocated":720896,"data_stored":234188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002509"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834655+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:10:52.834655+0000","last_peered":"2024-04-25T02:10:52.834655+0000","last_clean":"2024-04-25T02:10:52.834655+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:10:52.834655+0000","last_undegraded":"2024-04-25T02:10:52.834655+0000","last_fullsized":"2024-04-25T02:10:52.834655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835477+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:10:52.835477+0000","last_peered":"2024-04-25T02:10:52.835477+0000","last_clean":"2024-04-25T02:10:52.835477+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:10:52.835477+0000","last_undegraded":"2024-04-25T02:10:52.835477+0000","last_fullsized":"2024-04-25T02:10:52.835477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836616+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:10:52.836616+0000","last_peered":"2024-04-25T02:10:52.836616+0000","last_clean":"2024-04-25T02:10:52.836616+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:10:52.836616+0000","last_undegraded":"2024-04-25T02:10:52.836616+0000","last_fullsized":"2024-04-25T02:10:52.836616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836126+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:10:52.836126+0000","last_peered":"2024-04-25T02:10:52.836126+0000","last_clean":"2024-04-25T02:10:52.836126+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:10:52.836126+0000","last_undegraded":"2024-04-25T02:10:52.836126+0000","last_fullsized":"2024-04-25T02:10:52.836126+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835782+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:10:52.835782+0000","last_peered":"2024-04-25T02:10:52.835782+0000","last_clean":"2024-04-25T02:10:52.835782+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:10:52.835782+0000","last_undegraded":"2024-04-25T02:10:52.835782+0000","last_fullsized":"2024-04-25T02:10:52.835782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840976+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:10:52.840976+0000","last_peered":"2024-04-25T02:10:52.840976+0000","last_clean":"2024-04-25T02:10:52.840976+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:10:52.840976+0000","last_undegraded":"2024-04-25T02:10:52.840976+0000","last_fullsized":"2024-04-25T02:10:52.840976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839052+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:10:52.839052+0000","last_peered":"2024-04-25T02:10:52.839052+0000","last_clean":"2024-04-25T02:10:52.839052+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:10:52.839052+0000","last_undegraded":"2024-04-25T02:10:52.839052+0000","last_fullsized":"2024-04-25T02:10:52.839052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837642+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:10:52.837642+0000","last_peered":"2024-04-25T02:10:52.837642+0000","last_clean":"2024-04-25T02:10:52.837642+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:10:52.837642+0000","last_undegraded":"2024-04-25T02:10:52.837642+0000","last_fullsized":"2024-04-25T02:10:52.837642+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837294+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:10:52.837294+0000","last_peered":"2024-04-25T02:10:52.837294+0000","last_clean":"2024-04-25T02:10:52.837294+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:10:52.837294+0000","last_undegraded":"2024-04-25T02:10:52.837294+0000","last_fullsized":"2024-04-25T02:10:52.837294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839101+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:10:52.839101+0000","last_peered":"2024-04-25T02:10:52.839101+0000","last_clean":"2024-04-25T02:10:52.839101+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:10:52.839101+0000","last_undegraded":"2024-04-25T02:10:52.839101+0000","last_fullsized":"2024-04-25T02:10:52.839101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839269+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:10:52.839269+0000","last_peered":"2024-04-25T02:10:52.839269+0000","last_clean":"2024-04-25T02:10:52.839269+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:10:52.839269+0000","last_undegraded":"2024-04-25T02:10:52.839269+0000","last_fullsized":"2024-04-25T02:10:52.839269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834921+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:10:52.834921+0000","last_peered":"2024-04-25T02:10:52.834921+0000","last_clean":"2024-04-25T02:10:52.834921+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:10:52.834921+0000","last_undegraded":"2024-04-25T02:10:52.834921+0000","last_fullsized":"2024-04-25T02:10:52.834921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834769+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:10:52.834769+0000","last_peered":"2024-04-25T02:10:52.834769+0000","last_clean":"2024-04-25T02:10:52.834769+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:10:52.834769+0000","last_undegraded":"2024-04-25T02:10:52.834769+0000","last_fullsized":"2024-04-25T02:10:52.834769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838193+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:10:52.838193+0000","last_peered":"2024-04-25T02:10:52.838193+0000","last_clean":"2024-04-25T02:10:52.838193+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:10:52.838193+0000","last_undegraded":"2024-04-25T02:10:52.838193+0000","last_fullsized":"2024-04-25T02:10:52.838193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835403+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:10:52.835403+0000","last_peered":"2024-04-25T02:10:52.835403+0000","last_clean":"2024-04-25T02:10:52.835403+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:10:52.835403+0000","last_undegraded":"2024-04-25T02:10:52.835403+0000","last_fullsized":"2024-04-25T02:10:52.835403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.852512+0000","last_change":"2024-04-25T02:10:53.852512+0000","last_active":"2024-04-25T02:10:53.852512+0000","last_peered":"2024-04-25T02:10:53.852512+0000","last_clean":"2024-04-25T02:10:53.852512+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:10:53.852512+0000","last_undegraded":"2024-04-25T02:10:53.852512+0000","last_fullsized":"2024-04-25T02:10:53.852512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837274+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:10:52.837274+0000","last_peered":"2024-04-25T02:10:52.837274+0000","last_clean":"2024-04-25T02:10:52.837274+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:10:52.837274+0000","last_undegraded":"2024-04-25T02:10:52.837274+0000","last_fullsized":"2024-04-25T02:10:52.837274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836854+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:10:52.836854+0000","last_peered":"2024-04-25T02:10:52.836854+0000","last_clean":"2024-04-25T02:10:52.836854+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:10:52.836854+0000","last_undegraded":"2024-04-25T02:10:52.836854+0000","last_fullsized":"2024-04-25T02:10:52.836854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835106+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:10:52.835106+0000","last_peered":"2024-04-25T02:10:52.835106+0000","last_clean":"2024-04-25T02:10:52.835106+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:10:52.835106+0000","last_undegraded":"2024-04-25T02:10:52.835106+0000","last_fullsized":"2024-04-25T02:10:52.835106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838282+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:10:52.838282+0000","last_peered":"2024-04-25T02:10:52.838282+0000","last_clean":"2024-04-25T02:10:52.838282+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:10:52.838282+0000","last_undegraded":"2024-04-25T02:10:52.838282+0000","last_fullsized":"2024-04-25T02:10:52.838282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.852792+0000","last_change":"2024-04-25T02:10:53.852792+0000","last_active":"2024-04-25T02:10:53.852792+0000","last_peered":"2024-04-25T02:10:53.852792+0000","last_clean":"2024-04-25T02:10:53.852792+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:10:53.852792+0000","last_undegraded":"2024-04-25T02:10:53.852792+0000","last_fullsized":"2024-04-25T02:10:53.852792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835465+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:10:52.835465+0000","last_peered":"2024-04-25T02:10:52.835465+0000","last_clean":"2024-04-25T02:10:52.835465+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:10:52.835465+0000","last_undegraded":"2024-04-25T02:10:52.835465+0000","last_fullsized":"2024-04-25T02:10:52.835465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838980+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:10:52.838980+0000","last_peered":"2024-04-25T02:10:52.838980+0000","last_clean":"2024-04-25T02:10:52.838980+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:10:52.838980+0000","last_undegraded":"2024-04-25T02:10:52.838980+0000","last_fullsized":"2024-04-25T02:10:52.838980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837643+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:10:52.837643+0000","last_peered":"2024-04-25T02:10:52.837643+0000","last_clean":"2024-04-25T02:10:52.837643+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:10:52.837643+0000","last_undegraded":"2024-04-25T02:10:52.837643+0000","last_fullsized":"2024-04-25T02:10:52.837643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840130+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:10:52.840130+0000","last_peered":"2024-04-25T02:10:52.840130+0000","last_clean":"2024-04-25T02:10:52.840130+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:10:52.840130+0000","last_undegraded":"2024-04-25T02:10:52.840130+0000","last_fullsized":"2024-04-25T02:10:52.840130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838926+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:10:52.838926+0000","last_peered":"2024-04-25T02:10:52.838926+0000","last_clean":"2024-04-25T02:10:52.838926+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:10:52.838926+0000","last_undegraded":"2024-04-25T02:10:52.838926+0000","last_fullsized":"2024-04-25T02:10:52.838926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841901+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:10:52.841901+0000","last_peered":"2024-04-25T02:10:52.841901+0000","last_clean":"2024-04-25T02:10:52.841901+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:10:52.841901+0000","last_undegraded":"2024-04-25T02:10:52.841901+0000","last_fullsized":"2024-04-25T02:10:52.841901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837739+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:10:52.837739+0000","last_peered":"2024-04-25T02:10:52.837739+0000","last_clean":"2024-04-25T02:10:52.837739+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:10:52.837739+0000","last_undegraded":"2024-04-25T02:10:52.837739+0000","last_fullsized":"2024-04-25T02:10:52.837739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841519+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:10:52.841519+0000","last_peered":"2024-04-25T02:10:52.841519+0000","last_clean":"2024-04-25T02:10:52.841519+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:10:52.841519+0000","last_undegraded":"2024-04-25T02:10:52.841519+0000","last_fullsized":"2024-04-25T02:10:52.841519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837641+0000","last_change":"2024-04-25T02:10:02.370405+0000","last_active":"2024-04-25T02:10:52.837641+0000","last_peered":"2024-04-25T02:10:52.837641+0000","last_clean":"2024-04-25T02:10:52.837641+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:10:52.837641+0000","last_undegraded":"2024-04-25T02:10:52.837641+0000","last_fullsized":"2024-04-25T02:10:52.837641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837015+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:10:52.837015+0000","last_peered":"2024-04-25T02:10:52.837015+0000","last_clean":"2024-04-25T02:10:52.837015+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:10:52.837015+0000","last_undegraded":"2024-04-25T02:10:52.837015+0000","last_fullsized":"2024-04-25T02:10:52.837015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839074+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:10:52.839074+0000","last_peered":"2024-04-25T02:10:52.839074+0000","last_clean":"2024-04-25T02:10:52.839074+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:10:52.839074+0000","last_undegraded":"2024-04-25T02:10:52.839074+0000","last_fullsized":"2024-04-25T02:10:52.839074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841781+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:10:52.841781+0000","last_peered":"2024-04-25T02:10:52.841781+0000","last_clean":"2024-04-25T02:10:52.841781+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:10:52.841781+0000","last_undegraded":"2024-04-25T02:10:52.841781+0000","last_fullsized":"2024-04-25T02:10:52.841781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837191+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:10:52.837191+0000","last_peered":"2024-04-25T02:10:52.837191+0000","last_clean":"2024-04-25T02:10:52.837191+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:10:52.837191+0000","last_undegraded":"2024-04-25T02:10:52.837191+0000","last_fullsized":"2024-04-25T02:10:52.837191+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839477+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:10:52.839477+0000","last_peered":"2024-04-25T02:10:52.839477+0000","last_clean":"2024-04-25T02:10:52.839477+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:10:52.839477+0000","last_undegraded":"2024-04-25T02:10:52.839477+0000","last_fullsized":"2024-04-25T02:10:52.839477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835186+0000","last_change":"2024-04-25T02:10:02.367526+0000","last_active":"2024-04-25T02:10:52.835186+0000","last_peered":"2024-04-25T02:10:52.835186+0000","last_clean":"2024-04-25T02:10:52.835186+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:10:52.835186+0000","last_undegraded":"2024-04-25T02:10:52.835186+0000","last_fullsized":"2024-04-25T02:10:52.835186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839424+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:10:52.839424+0000","last_peered":"2024-04-25T02:10:52.839424+0000","last_clean":"2024-04-25T02:10:52.839424+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:10:52.839424+0000","last_undegraded":"2024-04-25T02:10:52.839424+0000","last_fullsized":"2024-04-25T02:10:52.839424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836837+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:10:52.836837+0000","last_peered":"2024-04-25T02:10:52.836837+0000","last_clean":"2024-04-25T02:10:52.836837+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:10:52.836837+0000","last_undegraded":"2024-04-25T02:10:52.836837+0000","last_fullsized":"2024-04-25T02:10:52.836837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838087+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:10:52.838087+0000","last_peered":"2024-04-25T02:10:52.838087+0000","last_clean":"2024-04-25T02:10:52.838087+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:10:52.838087+0000","last_undegraded":"2024-04-25T02:10:52.838087+0000","last_fullsized":"2024-04-25T02:10:52.838087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'10","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840055+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:10:52.840055+0000","last_peered":"2024-04-25T02:10:52.840055+0000","last_clean":"2024-04-25T02:10:52.840055+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:10:52.840055+0000","last_undegraded":"2024-04-25T02:10:52.840055+0000","last_fullsized":"2024-04-25T02:10:52.840055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2896,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.855075+0000","last_change":"2024-04-25T02:10:53.855075+0000","last_active":"2024-04-25T02:10:53.855075+0000","last_peered":"2024-04-25T02:10:53.855075+0000","last_clean":"2024-04-25T02:10:53.855075+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:10:53.855075+0000","last_undegraded":"2024-04-25T02:10:53.855075+0000","last_fullsized":"2024-04-25T02:10:53.855075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842571+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:10:52.842571+0000","last_peered":"2024-04-25T02:10:52.842571+0000","last_clean":"2024-04-25T02:10:52.842571+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:10:52.842571+0000","last_undegraded":"2024-04-25T02:10:52.842571+0000","last_fullsized":"2024-04-25T02:10:52.842571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.850733+0000","last_change":"2024-04-25T02:10:53.850733+0000","last_active":"2024-04-25T02:10:53.850733+0000","last_peered":"2024-04-25T02:10:53.850733+0000","last_clean":"2024-04-25T02:10:53.850733+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:10:53.850733+0000","last_undegraded":"2024-04-25T02:10:53.850733+0000","last_fullsized":"2024-04-25T02:10:53.850733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835508+0000","last_change":"2024-04-25T02:10:02.370169+0000","last_active":"2024-04-25T02:10:52.835508+0000","last_peered":"2024-04-25T02:10:52.835508+0000","last_clean":"2024-04-25T02:10:52.835508+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:10:52.835508+0000","last_undegraded":"2024-04-25T02:10:52.835508+0000","last_fullsized":"2024-04-25T02:10:52.835508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842100+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:10:52.842100+0000","last_peered":"2024-04-25T02:10:52.842100+0000","last_clean":"2024-04-25T02:10:52.842100+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:10:52.842100+0000","last_undegraded":"2024-04-25T02:10:52.842100+0000","last_fullsized":"2024-04-25T02:10:52.842100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839346+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:10:52.839346+0000","last_peered":"2024-04-25T02:10:52.839346+0000","last_clean":"2024-04-25T02:10:52.839346+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:10:52.839346+0000","last_undegraded":"2024-04-25T02:10:52.839346+0000","last_fullsized":"2024-04-25T02:10:52.839346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837120+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:10:52.837120+0000","last_peered":"2024-04-25T02:10:52.837120+0000","last_clean":"2024-04-25T02:10:52.837120+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:10:52.837120+0000","last_undegraded":"2024-04-25T02:10:52.837120+0000","last_fullsized":"2024-04-25T02:10:52.837120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837919+0000","last_change":"2024-04-25T02:10:02.360557+0000","last_active":"2024-04-25T02:10:52.837919+0000","last_peered":"2024-04-25T02:10:52.837919+0000","last_clean":"2024-04-25T02:10:52.837919+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:10:52.837919+0000","last_undegraded":"2024-04-25T02:10:52.837919+0000","last_fullsized":"2024-04-25T02:10:52.837919+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.853097+0000","last_change":"2024-04-25T02:10:53.853097+0000","last_active":"2024-04-25T02:10:53.853097+0000","last_peered":"2024-04-25T02:10:53.853097+0000","last_clean":"2024-04-25T02:10:53.853097+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:10:53.853097+0000","last_undegraded":"2024-04-25T02:10:53.853097+0000","last_fullsized":"2024-04-25T02:10:53.853097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836949+0000","last_change":"2024-04-25T02:10:02.370637+0000","last_active":"2024-04-25T02:10:52.836949+0000","last_peered":"2024-04-25T02:10:52.836949+0000","last_clean":"2024-04-25T02:10:52.836949+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:10:52.836949+0000","last_undegraded":"2024-04-25T02:10:52.836949+0000","last_fullsized":"2024-04-25T02:10:52.836949+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839553+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:10:52.839553+0000","last_peered":"2024-04-25T02:10:52.839553+0000","last_clean":"2024-04-25T02:10:52.839553+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:10:52.839553+0000","last_undegraded":"2024-04-25T02:10:52.839553+0000","last_fullsized":"2024-04-25T02:10:52.839553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835283+0000","last_change":"2024-04-25T02:10:02.358829+0000","last_active":"2024-04-25T02:10:52.835283+0000","last_peered":"2024-04-25T02:10:52.835283+0000","last_clean":"2024-04-25T02:10:52.835283+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:10:52.835283+0000","last_undegraded":"2024-04-25T02:10:52.835283+0000","last_fullsized":"2024-04-25T02:10:52.835283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837740+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:10:52.837740+0000","last_peered":"2024-04-25T02:10:52.837740+0000","last_clean":"2024-04-25T02:10:52.837740+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:10:52.837740+0000","last_undegraded":"2024-04-25T02:10:52.837740+0000","last_fullsized":"2024-04-25T02:10:52.837740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841595+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:10:52.841595+0000","last_peered":"2024-04-25T02:10:52.841595+0000","last_clean":"2024-04-25T02:10:52.841595+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:10:52.841595+0000","last_undegraded":"2024-04-25T02:10:52.841595+0000","last_fullsized":"2024-04-25T02:10:52.841595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834988+0000","last_change":"2024-04-25T02:10:02.744548+0000","last_active":"2024-04-25T02:10:52.834988+0000","last_peered":"2024-04-25T02:10:52.834988+0000","last_clean":"2024-04-25T02:10:52.834988+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:10:52.834988+0000","last_undegraded":"2024-04-25T02:10:52.834988+0000","last_fullsized":"2024-04-25T02:10:52.834988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836348+0000","last_change":"2024-04-25T02:10:02.371223+0000","last_active":"2024-04-25T02:10:52.836348+0000","last_peered":"2024-04-25T02:10:52.836348+0000","last_clean":"2024-04-25T02:10:52.836348+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:10:52.836348+0000","last_undegraded":"2024-04-25T02:10:52.836348+0000","last_fullsized":"2024-04-25T02:10:52.836348+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836099+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:10:52.836099+0000","last_peered":"2024-04-25T02:10:52.836099+0000","last_clean":"2024-04-25T02:10:52.836099+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:10:52.836099+0000","last_undegraded":"2024-04-25T02:10:52.836099+0000","last_fullsized":"2024-04-25T02:10:52.836099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842417+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:10:52.842417+0000","last_peered":"2024-04-25T02:10:52.842417+0000","last_clean":"2024-04-25T02:10:52.842417+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:10:52.842417+0000","last_undegraded":"2024-04-25T02:10:52.842417+0000","last_fullsized":"2024-04-25T02:10:52.842417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836263+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:10:52.836263+0000","last_peered":"2024-04-25T02:10:52.836263+0000","last_clean":"2024-04-25T02:10:52.836263+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:10:52.836263+0000","last_undegraded":"2024-04-25T02:10:52.836263+0000","last_fullsized":"2024-04-25T02:10:52.836263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841434+0000","last_change":"2024-04-25T02:10:02.367348+0000","last_active":"2024-04-25T02:10:52.841434+0000","last_peered":"2024-04-25T02:10:52.841434+0000","last_clean":"2024-04-25T02:10:52.841434+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:10:52.841434+0000","last_undegraded":"2024-04-25T02:10:52.841434+0000","last_fullsized":"2024-04-25T02:10:52.841434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:10:53.851188+0000","last_change":"2024-04-25T02:10:53.851188+0000","last_active":"2024-04-25T02:10:53.851188+0000","last_peered":"2024-04-25T02:10:53.851188+0000","last_clean":"2024-04-25T02:10:53.851188+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:10:53.851188+0000","last_undegraded":"2024-04-25T02:10:53.851188+0000","last_fullsized":"2024-04-25T02:10:53.851188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839132+0000","last_change":"2024-04-25T02:10:02.360699+0000","last_active":"2024-04-25T02:10:52.839132+0000","last_peered":"2024-04-25T02:10:52.839132+0000","last_clean":"2024-04-25T02:10:52.839132+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:10:52.839132+0000","last_undegraded":"2024-04-25T02:10:52.839132+0000","last_fullsized":"2024-04-25T02:10:52.839132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835374+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:10:52.835374+0000","last_peered":"2024-04-25T02:10:52.835374+0000","last_clean":"2024-04-25T02:10:52.835374+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:10:52.835374+0000","last_undegraded":"2024-04-25T02:10:52.835374+0000","last_fullsized":"2024-04-25T02:10:52.835374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838818+0000","last_change":"2024-04-25T02:10:02.365974+0000","last_active":"2024-04-25T02:10:52.838818+0000","last_peered":"2024-04-25T02:10:52.838818+0000","last_clean":"2024-04-25T02:10:52.838818+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:10:52.838818+0000","last_undegraded":"2024-04-25T02:10:52.838818+0000","last_fullsized":"2024-04-25T02:10:52.838818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840045+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:10:52.840045+0000","last_peered":"2024-04-25T02:10:52.840045+0000","last_clean":"2024-04-25T02:10:52.840045+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:10:52.840045+0000","last_undegraded":"2024-04-25T02:10:52.840045+0000","last_fullsized":"2024-04-25T02:10:52.840045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838364+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:10:52.838364+0000","last_peered":"2024-04-25T02:10:52.838364+0000","last_clean":"2024-04-25T02:10:52.838364+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:10:52.838364+0000","last_undegraded":"2024-04-25T02:10:52.838364+0000","last_fullsized":"2024-04-25T02:10:52.838364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835144+0000","last_change":"2024-04-25T02:10:02.367538+0000","last_active":"2024-04-25T02:10:52.835144+0000","last_peered":"2024-04-25T02:10:52.835144+0000","last_clean":"2024-04-25T02:10:52.835144+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:10:52.835144+0000","last_undegraded":"2024-04-25T02:10:52.835144+0000","last_fullsized":"2024-04-25T02:10:52.835144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837991+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:10:52.837991+0000","last_peered":"2024-04-25T02:10:52.837991+0000","last_clean":"2024-04-25T02:10:52.837991+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:10:52.837991+0000","last_undegraded":"2024-04-25T02:10:52.837991+0000","last_fullsized":"2024-04-25T02:10:52.837991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839925+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:52.839925+0000","last_peered":"2024-04-25T02:10:52.839925+0000","last_clean":"2024-04-25T02:10:52.839925+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:52.839925+0000","last_undegraded":"2024-04-25T02:10:52.839925+0000","last_fullsized":"2024-04-25T02:10:52.839925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835852+0000","last_change":"2024-04-25T02:10:02.360464+0000","last_active":"2024-04-25T02:10:52.835852+0000","last_peered":"2024-04-25T02:10:52.835852+0000","last_clean":"2024-04-25T02:10:52.835852+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:10:52.835852+0000","last_undegraded":"2024-04-25T02:10:52.835852+0000","last_fullsized":"2024-04-25T02:10:52.835852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838199+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:10:52.838199+0000","last_peered":"2024-04-25T02:10:52.838199+0000","last_clean":"2024-04-25T02:10:52.838199+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:10:52.838199+0000","last_undegraded":"2024-04-25T02:10:52.838199+0000","last_fullsized":"2024-04-25T02:10:52.838199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834714+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:10:52.834714+0000","last_peered":"2024-04-25T02:10:52.834714+0000","last_clean":"2024-04-25T02:10:52.834714+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:10:52.834714+0000","last_undegraded":"2024-04-25T02:10:52.834714+0000","last_fullsized":"2024-04-25T02:10:52.834714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837802+0000","last_change":"2024-04-25T02:10:02.361010+0000","last_active":"2024-04-25T02:10:52.837802+0000","last_peered":"2024-04-25T02:10:52.837802+0000","last_clean":"2024-04-25T02:10:52.837802+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:10:52.837802+0000","last_undegraded":"2024-04-25T02:10:52.837802+0000","last_fullsized":"2024-04-25T02:10:52.837802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839897+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:10:52.839897+0000","last_peered":"2024-04-25T02:10:52.839897+0000","last_clean":"2024-04-25T02:10:52.839897+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:10:52.839897+0000","last_undegraded":"2024-04-25T02:10:52.839897+0000","last_fullsized":"2024-04-25T02:10:52.839897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842499+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:52.842499+0000","last_peered":"2024-04-25T02:10:52.842499+0000","last_clean":"2024-04-25T02:10:52.842499+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:52.842499+0000","last_undegraded":"2024-04-25T02:10:52.842499+0000","last_fullsized":"2024-04-25T02:10:52.842499+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837741+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:10:52.837741+0000","last_peered":"2024-04-25T02:10:52.837741+0000","last_clean":"2024-04-25T02:10:52.837741+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:10:52.837741+0000","last_undegraded":"2024-04-25T02:10:52.837741+0000","last_fullsized":"2024-04-25T02:10:52.837741+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839818+0000","last_change":"2024-04-25T02:10:02.364629+0000","last_active":"2024-04-25T02:10:52.839818+0000","last_peered":"2024-04-25T02:10:52.839818+0000","last_clean":"2024-04-25T02:10:52.839818+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:10:52.839818+0000","last_undegraded":"2024-04-25T02:10:52.839818+0000","last_fullsized":"2024-04-25T02:10:52.839818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842001+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:10:52.842001+0000","last_peered":"2024-04-25T02:10:52.842001+0000","last_clean":"2024-04-25T02:10:52.842001+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:10:52.842001+0000","last_undegraded":"2024-04-25T02:10:52.842001+0000","last_fullsized":"2024-04-25T02:10:52.842001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838954+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:52.838954+0000","last_peered":"2024-04-25T02:10:52.838954+0000","last_clean":"2024-04-25T02:10:52.838954+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:52.838954+0000","last_undegraded":"2024-04-25T02:10:52.838954+0000","last_fullsized":"2024-04-25T02:10:52.838954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835356+0000","last_change":"2024-04-25T02:10:02.356105+0000","last_active":"2024-04-25T02:10:52.835356+0000","last_peered":"2024-04-25T02:10:52.835356+0000","last_clean":"2024-04-25T02:10:52.835356+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:10:52.835356+0000","last_undegraded":"2024-04-25T02:10:52.835356+0000","last_fullsized":"2024-04-25T02:10:52.835356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837188+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:10:52.837188+0000","last_peered":"2024-04-25T02:10:52.837188+0000","last_clean":"2024-04-25T02:10:52.837188+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:10:52.837188+0000","last_undegraded":"2024-04-25T02:10:52.837188+0000","last_fullsized":"2024-04-25T02:10:52.837188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841699+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:52.841699+0000","last_peered":"2024-04-25T02:10:52.841699+0000","last_clean":"2024-04-25T02:10:52.841699+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:52.841699+0000","last_undegraded":"2024-04-25T02:10:52.841699+0000","last_fullsized":"2024-04-25T02:10:52.841699+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838085+0000","last_change":"2024-04-25T02:10:02.360478+0000","last_active":"2024-04-25T02:10:52.838085+0000","last_peered":"2024-04-25T02:10:52.838085+0000","last_clean":"2024-04-25T02:10:52.838085+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:10:52.838085+0000","last_undegraded":"2024-04-25T02:10:52.838085+0000","last_fullsized":"2024-04-25T02:10:52.838085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836070+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:10:52.836070+0000","last_peered":"2024-04-25T02:10:52.836070+0000","last_clean":"2024-04-25T02:10:52.836070+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:10:52.836070+0000","last_undegraded":"2024-04-25T02:10:52.836070+0000","last_fullsized":"2024-04-25T02:10:52.836070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841170+0000","last_change":"2024-04-25T02:10:02.370193+0000","last_active":"2024-04-25T02:10:52.841170+0000","last_peered":"2024-04-25T02:10:52.841170+0000","last_clean":"2024-04-25T02:10:52.841170+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:10:52.841170+0000","last_undegraded":"2024-04-25T02:10:52.841170+0000","last_fullsized":"2024-04-25T02:10:52.841170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839006+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:10:52.839006+0000","last_peered":"2024-04-25T02:10:52.839006+0000","last_clean":"2024-04-25T02:10:52.839006+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:10:52.839006+0000","last_undegraded":"2024-04-25T02:10:52.839006+0000","last_fullsized":"2024-04-25T02:10:52.839006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838885+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:10:52.838885+0000","last_peered":"2024-04-25T02:10:52.838885+0000","last_clean":"2024-04-25T02:10:52.838885+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:10:52.838885+0000","last_undegraded":"2024-04-25T02:10:52.838885+0000","last_fullsized":"2024-04-25T02:10:52.838885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841219+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:52.841219+0000","last_peered":"2024-04-25T02:10:52.841219+0000","last_clean":"2024-04-25T02:10:52.841219+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:52.841219+0000","last_undegraded":"2024-04-25T02:10:52.841219+0000","last_fullsized":"2024-04-25T02:10:52.841219+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836938+0000","last_change":"2024-04-25T02:10:02.370537+0000","last_active":"2024-04-25T02:10:52.836938+0000","last_peered":"2024-04-25T02:10:52.836938+0000","last_clean":"2024-04-25T02:10:52.836938+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:10:52.836938+0000","last_undegraded":"2024-04-25T02:10:52.836938+0000","last_fullsized":"2024-04-25T02:10:52.836938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834555+0000","last_change":"2024-04-25T02:10:02.748709+0000","last_active":"2024-04-25T02:10:52.834555+0000","last_peered":"2024-04-25T02:10:52.834555+0000","last_clean":"2024-04-25T02:10:52.834555+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:10:52.834555+0000","last_undegraded":"2024-04-25T02:10:52.834555+0000","last_fullsized":"2024-04-25T02:10:52.834555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.836001+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:10:52.836001+0000","last_peered":"2024-04-25T02:10:52.836001+0000","last_clean":"2024-04-25T02:10:52.836001+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:10:52.836001+0000","last_undegraded":"2024-04-25T02:10:52.836001+0000","last_fullsized":"2024-04-25T02:10:52.836001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835021+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:10:52.835021+0000","last_peered":"2024-04-25T02:10:52.835021+0000","last_clean":"2024-04-25T02:10:52.835021+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:10:52.835021+0000","last_undegraded":"2024-04-25T02:10:52.835021+0000","last_fullsized":"2024-04-25T02:10:52.835021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838451+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:10:52.838451+0000","last_peered":"2024-04-25T02:10:52.838451+0000","last_clean":"2024-04-25T02:10:52.838451+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:10:52.838451+0000","last_undegraded":"2024-04-25T02:10:52.838451+0000","last_fullsized":"2024-04-25T02:10:52.838451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834861+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:10:52.834861+0000","last_peered":"2024-04-25T02:10:52.834861+0000","last_clean":"2024-04-25T02:10:52.834861+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:10:52.834861+0000","last_undegraded":"2024-04-25T02:10:52.834861+0000","last_fullsized":"2024-04-25T02:10:52.834861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841757+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:10:52.841757+0000","last_peered":"2024-04-25T02:10:52.841757+0000","last_clean":"2024-04-25T02:10:52.841757+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:10:52.841757+0000","last_undegraded":"2024-04-25T02:10:52.841757+0000","last_fullsized":"2024-04-25T02:10:52.841757+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834889+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:10:52.834889+0000","last_peered":"2024-04-25T02:10:52.834889+0000","last_clean":"2024-04-25T02:10:52.834889+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:10:52.834889+0000","last_undegraded":"2024-04-25T02:10:52.834889+0000","last_fullsized":"2024-04-25T02:10:52.834889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.840065+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:10:52.840065+0000","last_peered":"2024-04-25T02:10:52.840065+0000","last_clean":"2024-04-25T02:10:52.840065+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:10:52.840065+0000","last_undegraded":"2024-04-25T02:10:52.840065+0000","last_fullsized":"2024-04-25T02:10:52.840065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839501+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:10:52.839501+0000","last_peered":"2024-04-25T02:10:52.839501+0000","last_clean":"2024-04-25T02:10:52.839501+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:10:52.839501+0000","last_undegraded":"2024-04-25T02:10:52.839501+0000","last_fullsized":"2024-04-25T02:10:52.839501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837222+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:10:52.837222+0000","last_peered":"2024-04-25T02:10:52.837222+0000","last_clean":"2024-04-25T02:10:52.837222+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:10:52.837222+0000","last_undegraded":"2024-04-25T02:10:52.837222+0000","last_fullsized":"2024-04-25T02:10:52.837222+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834152+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:10:52.834152+0000","last_peered":"2024-04-25T02:10:52.834152+0000","last_clean":"2024-04-25T02:10:52.834152+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:10:52.834152+0000","last_undegraded":"2024-04-25T02:10:52.834152+0000","last_fullsized":"2024-04-25T02:10:52.834152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837906+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:10:52.837906+0000","last_peered":"2024-04-25T02:10:52.837906+0000","last_clean":"2024-04-25T02:10:52.837906+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:10:52.837906+0000","last_undegraded":"2024-04-25T02:10:52.837906+0000","last_fullsized":"2024-04-25T02:10:52.837906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839211+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:10:52.839211+0000","last_peered":"2024-04-25T02:10:52.839211+0000","last_clean":"2024-04-25T02:10:52.839211+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:10:52.839211+0000","last_undegraded":"2024-04-25T02:10:52.839211+0000","last_fullsized":"2024-04-25T02:10:52.839211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835554+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:10:52.835554+0000","last_peered":"2024-04-25T02:10:52.835554+0000","last_clean":"2024-04-25T02:10:52.835554+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:10:52.835554+0000","last_undegraded":"2024-04-25T02:10:52.835554+0000","last_fullsized":"2024-04-25T02:10:52.835554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842334+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:10:52.842334+0000","last_peered":"2024-04-25T02:10:52.842334+0000","last_clean":"2024-04-25T02:10:52.842334+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:10:52.842334+0000","last_undegraded":"2024-04-25T02:10:52.842334+0000","last_fullsized":"2024-04-25T02:10:52.842334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838540+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:10:52.838540+0000","last_peered":"2024-04-25T02:10:52.838540+0000","last_clean":"2024-04-25T02:10:52.838540+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:10:52.838540+0000","last_undegraded":"2024-04-25T02:10:52.838540+0000","last_fullsized":"2024-04-25T02:10:52.838540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705692,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":59610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.35199999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705691,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":59804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.434},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.36599999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":57414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.317}]},{"osd":2,"last update":"Thu Apr 25 02:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.32700000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705692,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":57360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.17399999999999999},{"interface":"front","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.246}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:11:58.508 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:11:58.508 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:11:58.508 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:11:58.509 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:11:58.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.650+0000 7f94b02c1700 1 Processor -- start 2024-04-25T02:11:58.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.650+0000 7f94b02c1700 1 -- start start 2024-04-25T02:11:58.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94b02c1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a8062860 0x7f94a81271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94b02c1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94a81277a0 0x7f94a8127ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94b02c1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a8096490 con 0x7f94a8095190 2024-04-25T02:11:58.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94b02c1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a8062c40 con 0x7f94a81277a0 2024-04-25T02:11:58.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94b02c1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8091b90 con 0x7f94a8062860 2024-04-25T02:11:58.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ae05d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a8062860 0x7f94a81271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ad85c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94a81277a0 0x7f94a8127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ae05d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a8062860 0x7f94a81271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51702/0 (socket says 172.21.15.78:51702) 2024-04-25T02:11:58.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ad85c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94a81277a0 0x7f94a8127ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60844/0 (socket says 172.21.15.78:60844) 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ae85e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f94a8095190 0x7f94a8095640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39922/0 (socket says 172.21.15.78:39922) 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ae05d700 1 -- 172.21.15.78:0/2180531390 learned_addr learned my addr 172.21.15.78:0/2180531390 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ae05d700 1 -- 172.21.15.78:0/2180531390 >> v2:172.21.15.78:3300/0 conn(0x7f94a81277a0 msgr2=0x7f94a8127ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ae05d700 1 --2- 172.21.15.78:0/2180531390 >> v2:172.21.15.78:3300/0 conn(0x7f94a81277a0 0x7f94a8127ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ae05d700 1 -- 172.21.15.78:0/2180531390 >> v1:172.21.15.78:6789/0 conn(0x7f94a8095190 legacy=0x7f94a8095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ad05b700 1 -- 172.21.15.78:0/2180531390 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348426554 0 0) 0x7f94a8096490 con 0x7f94a8095190 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ae05d700 1 -- 172.21.15.78:0/2180531390 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8091e50 con 0x7f94a8062860 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.651+0000 7f94ad85c700 1 --2- 172.21.15.78:0/2180531390 >> v2:172.21.15.78:3300/0 conn(0x7f94a81277a0 0x7f94a8127ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94ae05d700 1 --2- 172.21.15.78:0/2180531390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a8062860 0x7f94a81271f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9498006fd0 tx=0x7f94980090f0).ready entity=mon.1 client_cookie=33b2649ebb0f2b4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94ad05b700 1 -- 172.21.15.78:0/2180531390 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949800b580 con 0x7f94a8062860 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94ad05b700 1 -- 172.21.15.78:0/2180531390 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949800b6e0 con 0x7f94a8062860 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94ad05b700 1 -- 172.21.15.78:0/2180531390 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949800ba60 con 0x7f94a8062860 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94b02c1700 1 -- 172.21.15.78:0/2180531390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a8062860 msgr2=0x7f94a81271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94b02c1700 1 --2- 172.21.15.78:0/2180531390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a8062860 0x7f94a81271f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9498006fd0 tx=0x7f94980090f0).stop 2024-04-25T02:11:58.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94b02c1700 1 -- 172.21.15.78:0/2180531390 shutdown_connections 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94b02c1700 1 --2- 172.21.15.78:0/2180531390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a8062860 0x7f94a81271f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94b02c1700 1 --2- 172.21.15.78:0/2180531390 >> v2:172.21.15.78:3300/0 conn(0x7f94a81277a0 0x7f94a8127ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94b02c1700 1 -- 172.21.15.78:0/2180531390 >> 172.21.15.78:0/2180531390 conn(0x7f94a8097450 msgr2=0x7f94a8097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94b02c1700 1 -- 172.21.15.78:0/2180531390 shutdown_connections 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.652+0000 7f94b02c1700 1 -- 172.21.15.78:0/2180531390 wait complete. 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.653+0000 7f94b02c1700 1 Processor -- start 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.653+0000 7f94b02c1700 1 -- start start 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94b02c1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f94a8062860 0x7f94a8117890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94b02c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a8095190 0x7f94a8113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94b02c1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a81277a0 0x7f94a8113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94b02c1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8124e50 con 0x7f94a8095190 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94b02c1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8115d50 con 0x7f94a81277a0 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94b02c1700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94a81249c0 con 0x7f94a8062860 2024-04-25T02:11:58.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ad85c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a8095190 0x7f94a8113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae05d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f94a8062860 0x7f94a8117890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae85e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a81277a0 0x7f94a8113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ad85c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a8095190 0x7f94a8113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60854/0 (socket says 172.21.15.78:60854) 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae05d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f94a8062860 0x7f94a8117890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42464/0 (socket says 172.21.15.78:42464) 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae85e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a81277a0 0x7f94a8113e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51716/0 (socket says 172.21.15.78:51716) 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ad85c700 1 -- 172.21.15.78:0/2021384346 learned_addr learned my addr 172.21.15.78:0/2021384346 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae85e700 1 -- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f94a8062860 msgr2=0x7f94a8117890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae85e700 1 --2- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f94a8062860 0x7f94a8117890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae85e700 1 -- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a8095190 msgr2=0x7f94a8113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae85e700 1 --2- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a8095190 0x7f94a8113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae85e700 1 -- 172.21.15.78:0/2021384346 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40092a0 con 0x7f94a81277a0 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ad85c700 1 --2- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a8095190 0x7f94a8113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94ae85e700 1 --2- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a81277a0 0x7f94a8113e80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f94a000c7e0 tx=0x7f94a0007eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:58.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f949ef78700 1 -- 172.21.15.78:0/2021384346 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0005c70 con 0x7f94a81277a0 2024-04-25T02:11:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f949ef78700 1 -- 172.21.15.78:0/2021384346 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a0005df0 con 0x7f94a81277a0 2024-04-25T02:11:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9498009370 con 0x7f94a81277a0 2024-04-25T02:11:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f949ef78700 1 -- 172.21.15.78:0/2021384346 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0007360 con 0x7f94a81277a0 2024-04-25T02:11:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.654+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a8114d90 con 0x7f94a81277a0 2024-04-25T02:11:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.655+0000 7f949ef78700 1 -- 172.21.15.78:0/2021384346 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f94a0007710 con 0x7f94a81277a0 2024-04-25T02:11:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.655+0000 7f949ef78700 1 -- 172.21.15.78:0/2021384346 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f94a003b130 con 0x7f94a81277a0 2024-04-25T02:11:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.655+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a8097f70 con 0x7f94a81277a0 2024-04-25T02:11:58.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.660+0000 7f949ef78700 1 -- 172.21.15.78:0/2021384346 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f94a001a710 con 0x7f94a81277a0 2024-04-25T02:11:58.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.851+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f94a8114790 con 0x7f94a81277a0 2024-04-25T02:11:58.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.851+0000 7f949ef78700 1 -- 172.21.15.78:0/2021384346 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f94a0011360 con 0x7f94a81277a0 2024-04-25T02:11:58.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:11:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 >> v1:172.21.15.78:6816/46507 conn(0x7f948c02bd30 legacy=0x7f948c02e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a81277a0 msgr2=0x7f94a8113e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 --2- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a81277a0 0x7f94a8113e80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f94a000c7e0 tx=0x7f94a0007eb0).stop 2024-04-25T02:11:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 shutdown_connections 2024-04-25T02:11:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 --2- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94a81277a0 0x7f94a8113e80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 --2- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f94a8062860 0x7f94a8117890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 --2- 172.21.15.78:0/2021384346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a8095190 0x7f94a8113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 >> 172.21.15.78:0/2021384346 conn(0x7f94a8097450 msgr2=0x7f94a8099ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 shutdown_connections 2024-04-25T02:11:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.853+0000 7f94b02c1700 1 -- 172.21.15.78:0/2021384346 wait complete. 2024-04-25T02:11:58.871 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:11:58.872 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:11:58.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:11:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.982+0000 7fa69429f700 1 Processor -- start 2024-04-25T02:11:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.982+0000 7fa69429f700 1 -- start start 2024-04-25T02:11:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69429f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c062860 0x7fa68c1271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69429f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c1277a0 0x7fa68c127ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69429f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c096490 con 0x7fa68c095190 2024-04-25T02:11:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69429f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c062c40 con 0x7fa68c1277a0 2024-04-25T02:11:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69429f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c091b90 con 0x7fa68c062860 2024-04-25T02:11:58.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69183a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c1277a0 0x7fa68c127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69203b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c062860 0x7fa68c1271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69283c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa68c095190 0x7fa68c095610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39936/0 (socket says 172.21.15.78:39936) 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69283c700 1 -- 172.21.15.78:0/2966258536 learned_addr learned my addr 172.21.15.78:0/2966258536 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa691039700 1 -- 172.21.15.78:0/2966258536 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349663767 0 0) 0x7fa68c096490 con 0x7fa68c095190 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa691039700 1 -- 172.21.15.78:0/2966258536 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6780033f0 con 0x7fa68c095190 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69183a700 1 -- 172.21.15.78:0/2966258536 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c062860 msgr2=0x7fa68c1271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69183a700 1 --2- 172.21.15.78:0/2966258536 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c062860 0x7fa68c1271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69183a700 1 -- 172.21.15.78:0/2966258536 >> v1:172.21.15.78:6789/0 conn(0x7fa68c095190 legacy=0x7fa68c095610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69183a700 1 -- 172.21.15.78:0/2966258536 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c091e50 con 0x7fa68c1277a0 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69203b700 1 --2- 172.21.15.78:0/2966258536 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c062860 0x7fa68c1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.983+0000 7fa69183a700 1 --2- 172.21.15.78:0/2966258536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c1277a0 0x7fa68c127ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa688009790 tx=0x7fa688009060).ready entity=mon.1 client_cookie=5b5296eba91bc87e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa691039700 1 -- 172.21.15.78:0/2966258536 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800f510 con 0x7fa68c1277a0 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa691039700 1 -- 172.21.15.78:0/2966258536 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68800f670 con 0x7fa68c1277a0 2024-04-25T02:11:58.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa691039700 1 -- 172.21.15.78:0/2966258536 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800f9f0 con 0x7fa68c1277a0 2024-04-25T02:11:58.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa69429f700 1 -- 172.21.15.78:0/2966258536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c1277a0 msgr2=0x7fa68c127ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa69429f700 1 --2- 172.21.15.78:0/2966258536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c1277a0 0x7fa68c127ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa688009790 tx=0x7fa688009060).stop 2024-04-25T02:11:58.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa69429f700 1 -- 172.21.15.78:0/2966258536 shutdown_connections 2024-04-25T02:11:58.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa69429f700 1 --2- 172.21.15.78:0/2966258536 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c062860 0x7fa68c1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa69429f700 1 --2- 172.21.15.78:0/2966258536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c1277a0 0x7fa68c127ba0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa69429f700 1 -- 172.21.15.78:0/2966258536 >> 172.21.15.78:0/2966258536 conn(0x7fa68c097450 msgr2=0x7fa68c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:58.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa69429f700 1 -- 172.21.15.78:0/2966258536 shutdown_connections 2024-04-25T02:11:58.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.984+0000 7fa69429f700 1 -- 172.21.15.78:0/2966258536 wait complete. 2024-04-25T02:11:58.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.985+0000 7fa69429f700 1 Processor -- start 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.985+0000 7fa69429f700 1 -- start start 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.985+0000 7fa69429f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68c062860 0x7fa68c1198b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.985+0000 7fa69429f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c095190 0x7fa68c115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.985+0000 7fa69429f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c1277a0 0x7fa68c115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.985+0000 7fa69429f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c117d70 con 0x7fa68c062860 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.985+0000 7fa69429f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c1269e0 con 0x7fa68c095190 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.985+0000 7fa69429f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c096d20 con 0x7fa68c1277a0 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69203b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68c062860 0x7fa68c1198b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69183a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c095190 0x7fa68c115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69283c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c1277a0 0x7fa68c115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69203b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68c062860 0x7fa68c1198b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60860/0 (socket says 172.21.15.78:60860) 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69203b700 1 -- 172.21.15.78:0/2611864492 learned_addr learned my addr 172.21.15.78:0/2611864492 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69203b700 1 -- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c1277a0 msgr2=0x7fa68c115e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69203b700 1 --2- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c1277a0 0x7fa68c115e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69203b700 1 -- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c095190 msgr2=0x7fa68c115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69203b700 1 --2- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c095190 0x7fa68c115910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69203b700 1 -- 172.21.15.78:0/2611864492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0092a0 con 0x7fa68c062860 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69203b700 1 --2- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68c062860 0x7fa68c1198b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa67c00e980 tx=0x7fa67c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa682f78700 1 -- 172.21.15.78:0/2611864492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c009560 con 0x7fa68c062860 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa682f78700 1 -- 172.21.15.78:0/2611864492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c012600 con 0x7fa68c062860 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6880092a0 con 0x7fa68c062860 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa682f78700 1 -- 172.21.15.78:0/2611864492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c012980 con 0x7fa68c062860 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.986+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c118e10 con 0x7fa68c062860 2024-04-25T02:11:58.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.987+0000 7fa682f78700 1 -- 172.21.15.78:0/2611864492 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fa67c012cf0 con 0x7fa68c062860 2024-04-25T02:11:58.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.987+0000 7fa682f78700 1 -- 172.21.15.78:0/2611864492 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fa67c03b610 con 0x7fa68c062860 2024-04-25T02:11:58.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.987+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c097f70 con 0x7fa68c062860 2024-04-25T02:11:58.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:58.992+0000 7fa682f78700 1 -- 172.21.15.78:0/2611864492 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fa67c019310 con 0x7fa68c062860 2024-04-25T02:11:59.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.150+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa68c046ce0 con 0x7fa68c062860 2024-04-25T02:11:59.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.151+0000 7fa682f78700 1 -- 172.21.15.78:0/2611864492 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11609 (secure 0 0 0) 0x7fa67c011b40 con 0x7fa68c062860 2024-04-25T02:11:59.159 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:11:59.159 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:53.832053+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:11:59.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 >> v1:172.21.15.78:6816/46507 conn(0x7fa67002bd00 legacy=0x7fa67002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68c062860 msgr2=0x7fa68c1198b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 --2- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68c062860 0x7fa68c1198b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa67c00e980 tx=0x7fa67c009060).stop 2024-04-25T02:11:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 shutdown_connections 2024-04-25T02:11:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 --2- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa68c1277a0 0x7fa68c115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 --2- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68c062860 0x7fa68c1198b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 --2- 172.21.15.78:0/2611864492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68c095190 0x7fa68c115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 >> 172.21.15.78:0/2611864492 conn(0x7fa68c097450 msgr2=0x7fa68c12add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 shutdown_connections 2024-04-25T02:11:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.153+0000 7fa69429f700 1 -- 172.21.15.78:0/2611864492 wait complete. 2024-04-25T02:11:59.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:00.989685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:01.680090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:11:59.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:11:59.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.282+0000 7f24174ad700 1 Processor -- start 2024-04-25T02:11:59.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.282+0000 7f24174ad700 1 -- start start 2024-04-25T02:11:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f24174ad700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2410062860 0x7f241012af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f24174ad700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f241012ab00 0x7f241012b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f24174ad700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2410091a10 con 0x7f2410095190 2024-04-25T02:11:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f24174ad700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2410062c40 con 0x7f2410062860 2024-04-25T02:11:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f24174ad700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24100922e0 con 0x7f241012ab00 2024-04-25T02:11:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2414a48700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f241012ab00 0x7f241012b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2415249700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2410062860 0x7f241012af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2414a48700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f241012ab00 0x7f241012b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51746/0 (socket says 172.21.15.78:51746) 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2415249700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2410062860 0x7f241012af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60872/0 (socket says 172.21.15.78:60872) 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2414a48700 1 -- 172.21.15.78:0/2772934960 learned_addr learned my addr 172.21.15.78:0/2772934960 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2414a48700 1 -- 172.21.15.78:0/2772934960 >> v2:172.21.15.78:3300/0 conn(0x7f2410062860 msgr2=0x7f241012af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2414a48700 1 --2- 172.21.15.78:0/2772934960 >> v2:172.21.15.78:3300/0 conn(0x7f2410062860 0x7f241012af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2414a48700 1 -- 172.21.15.78:0/2772934960 >> v1:172.21.15.78:6789/0 conn(0x7f2410095190 legacy=0x7f2410095620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2414a48700 1 -- 172.21.15.78:0/2772934960 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241012b970 con 0x7f241012ab00 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2415249700 1 --2- 172.21.15.78:0/2772934960 >> v2:172.21.15.78:3300/0 conn(0x7f2410062860 0x7f241012af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.283+0000 7f2414a48700 1 --2- 172.21.15.78:0/2772934960 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f241012ab00 0x7f241012b480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f240c009830 tx=0x7f240c0090f0).ready entity=mon.1 client_cookie=975c189ee13ae1c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f2407fff700 1 -- 172.21.15.78:0/2772934960 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c00b580 con 0x7f241012ab00 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f2407fff700 1 -- 172.21.15.78:0/2772934960 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c00b6e0 con 0x7f241012ab00 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f2407fff700 1 -- 172.21.15.78:0/2772934960 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c00ba60 con 0x7f241012ab00 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f24174ad700 1 -- 172.21.15.78:0/2772934960 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f241012ab00 msgr2=0x7f241012b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f24174ad700 1 --2- 172.21.15.78:0/2772934960 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f241012ab00 0x7f241012b480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f240c009830 tx=0x7f240c0090f0).stop 2024-04-25T02:11:59.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f24174ad700 1 -- 172.21.15.78:0/2772934960 shutdown_connections 2024-04-25T02:11:59.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f24174ad700 1 --2- 172.21.15.78:0/2772934960 >> v2:172.21.15.78:3300/0 conn(0x7f2410062860 0x7f241012af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f24174ad700 1 --2- 172.21.15.78:0/2772934960 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f241012ab00 0x7f241012b480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f24174ad700 1 -- 172.21.15.78:0/2772934960 >> 172.21.15.78:0/2772934960 conn(0x7f241009a970 msgr2=0x7f241009ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f24174ad700 1 -- 172.21.15.78:0/2772934960 shutdown_connections 2024-04-25T02:11:59.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.284+0000 7f24174ad700 1 -- 172.21.15.78:0/2772934960 wait complete. 2024-04-25T02:11:59.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.285+0000 7f24174ad700 1 Processor -- start 2024-04-25T02:11:59.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.285+0000 7f24174ad700 1 -- start start 2024-04-25T02:11:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.285+0000 7f24174ad700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2410062860 0x7f2410116e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.285+0000 7f24174ad700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2410095190 0x7f2410115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.285+0000 7f24174ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2410115770 0x7f2410115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.285+0000 7f24174ad700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410069540 con 0x7f2410115770 2024-04-25T02:11:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.285+0000 7f24174ad700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241006a1b0 con 0x7f2410062860 2024-04-25T02:11:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.285+0000 7f24174ad700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24101160a0 con 0x7f2410095190 2024-04-25T02:11:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415249700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2410062860 0x7f2410116e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415a4a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2410115770 0x7f2410115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2414a48700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2410095190 0x7f2410115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415249700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2410062860 0x7f2410116e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51748/0 (socket says 172.21.15.78:51748) 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415249700 1 -- 172.21.15.78:0/1738189819 learned_addr learned my addr 172.21.15.78:0/1738189819 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415249700 1 -- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2410095190 msgr2=0x7f2410115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415249700 1 --2- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2410095190 0x7f2410115280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415249700 1 -- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2410115770 msgr2=0x7f2410115bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415249700 1 --2- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2410115770 0x7f2410115bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415249700 1 -- 172.21.15.78:0/1738189819 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24000092a0 con 0x7f2410062860 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2415249700 1 --2- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2410062860 0x7f2410116e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f240000ea20 tx=0x7f2400009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2405ffb700 1 -- 172.21.15.78:0/1738189819 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240000ee60 con 0x7f2410062860 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2405ffb700 1 -- 172.21.15.78:0/1738189819 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2400009600 con 0x7f2410062860 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c009370 con 0x7f2410062860 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f2405ffb700 1 -- 172.21.15.78:0/1738189819 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240000ca60 con 0x7f2410062860 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.286+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2410118200 con 0x7f2410062860 2024-04-25T02:11:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.287+0000 7f2405ffb700 1 -- 172.21.15.78:0/1738189819 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f240001b400 con 0x7f2410062860 2024-04-25T02:11:59.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.287+0000 7f2405ffb700 1 -- 172.21.15.78:0/1738189819 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f240003b690 con 0x7f2410062860 2024-04-25T02:11:59.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.287+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241009b490 con 0x7f2410062860 2024-04-25T02:11:59.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.292+0000 7f2405ffb700 1 -- 172.21.15.78:0/1738189819 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f2400016070 con 0x7f2410062860 2024-04-25T02:11:59.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.449+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2410046ce0 con 0x7f2410062860 2024-04-25T02:11:59.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.450+0000 7f2405ffb700 1 -- 172.21.15.78:0/1738189819 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2400016020 con 0x7f2410062860 2024-04-25T02:11:59.457 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:11:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.451+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 >> v1:172.21.15.78:6816/46507 conn(0x7f23f402bd30 legacy=0x7f23f402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.451+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2410062860 msgr2=0x7f2410116e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.451+0000 7f24174ad700 1 --2- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2410062860 0x7f2410116e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f240000ea20 tx=0x7f2400009060).stop 2024-04-25T02:11:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.451+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 shutdown_connections 2024-04-25T02:11:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.451+0000 7f24174ad700 1 --2- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2410115770 0x7f2410115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.452+0000 7f24174ad700 1 --2- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2410062860 0x7f2410116e10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.452+0000 7f24174ad700 1 --2- 172.21.15.78:0/1738189819 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2410095190 0x7f2410115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.452+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 >> 172.21.15.78:0/1738189819 conn(0x7f241009a970 msgr2=0x7f2410099650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.452+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 shutdown_connections 2024-04-25T02:11:59.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.452+0000 7f24174ad700 1 -- 172.21.15.78:0/1738189819 wait complete. 2024-04-25T02:11:59.470 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:11:59.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330d007700 1 Processor -- start 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330d007700 1 -- start start 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330d007700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3308062860 0x7f330812af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330d007700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f330812ab00 0x7f330812b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330d007700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308095190 0x7f3308095640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330d007700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3308062c40 con 0x7f3308062860 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330d007700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33080922e0 con 0x7f3308095190 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330d007700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3308091a10 con 0x7f330812ab00 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308095190 0x7f3308095640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f3306d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3308062860 0x7f330812af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308095190 0x7f3308095640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51762/0 (socket says 172.21.15.78:51762) 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330759e700 1 -- 172.21.15.78:0/2712627411 learned_addr learned my addr 172.21.15.78:0/2712627411 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330659c700 1 --2- 172.21.15.78:0/2712627411 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f330812ab00 0x7f330812b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330759e700 1 -- 172.21.15.78:0/2712627411 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f330812ab00 msgr2=0x7f330812b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330759e700 1 --2- 172.21.15.78:0/2712627411 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f330812ab00 0x7f330812b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330759e700 1 -- 172.21.15.78:0/2712627411 >> v2:172.21.15.78:3300/0 conn(0x7f3308062860 msgr2=0x7f330812af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330759e700 1 --2- 172.21.15.78:0/2712627411 >> v2:172.21.15.78:3300/0 conn(0x7f3308062860 0x7f330812af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.580+0000 7f330759e700 1 -- 172.21.15.78:0/2712627411 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330812b970 con 0x7f3308095190 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f3306d9d700 1 --2- 172.21.15.78:0/2712627411 >> v2:172.21.15.78:3300/0 conn(0x7f3308062860 0x7f330812af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330759e700 1 --2- 172.21.15.78:0/2712627411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308095190 0x7f3308095640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3300009f50 tx=0x7f3300009840).ready entity=mon.1 client_cookie=462328ffc425e6e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f3305d9b700 1 -- 172.21.15.78:0/2712627411 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330000e070 con 0x7f3308095190 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f3305d9b700 1 -- 172.21.15.78:0/2712627411 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330000b910 con 0x7f3308095190 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f3305d9b700 1 -- 172.21.15.78:0/2712627411 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330000bc90 con 0x7f3308095190 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330d007700 1 -- 172.21.15.78:0/2712627411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308095190 msgr2=0x7f3308095640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330d007700 1 --2- 172.21.15.78:0/2712627411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308095190 0x7f3308095640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3300009f50 tx=0x7f3300009840).stop 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330d007700 1 -- 172.21.15.78:0/2712627411 shutdown_connections 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330d007700 1 --2- 172.21.15.78:0/2712627411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308095190 0x7f3308095640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330d007700 1 --2- 172.21.15.78:0/2712627411 >> v2:172.21.15.78:3300/0 conn(0x7f3308062860 0x7f330812af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330d007700 1 --2- 172.21.15.78:0/2712627411 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f330812ab00 0x7f330812b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330d007700 1 -- 172.21.15.78:0/2712627411 >> 172.21.15.78:0/2712627411 conn(0x7f330809a970 msgr2=0x7f330809ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330d007700 1 -- 172.21.15.78:0/2712627411 shutdown_connections 2024-04-25T02:11:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.581+0000 7f330d007700 1 -- 172.21.15.78:0/2712627411 wait complete. 2024-04-25T02:11:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.582+0000 7f330d007700 1 Processor -- start 2024-04-25T02:11:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.582+0000 7f330d007700 1 -- start start 2024-04-25T02:11:59.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330d007700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3308062860 0x7f3308124e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330d007700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3308095190 0x7f3308115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330d007700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308115770 0x7f3308115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330d007700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3308096c60 con 0x7f3308062860 2024-04-25T02:11:59.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330d007700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3308117e80 con 0x7f3308115770 2024-04-25T02:11:59.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330d007700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33081160e0 con 0x7f3308095190 2024-04-25T02:11:59.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308115770 0x7f3308115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f3306d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3308062860 0x7f3308124e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330659c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3308095190 0x7f3308115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308115770 0x7f3308115bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51768/0 (socket says 172.21.15.78:51768) 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f3306d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3308062860 0x7f3308124e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60888/0 (socket says 172.21.15.78:60888) 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330759e700 1 -- 172.21.15.78:0/2204510779 learned_addr learned my addr 172.21.15.78:0/2204510779 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330659c700 1 -- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308115770 msgr2=0x7f3308115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330659c700 1 --2- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308115770 0x7f3308115bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330659c700 1 -- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3308062860 msgr2=0x7f3308124e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330659c700 1 --2- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3308062860 0x7f3308124e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330659c700 1 -- 172.21.15.78:0/2204510779 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80092a0 con 0x7f3308095190 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f3306d9d700 1 --2- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3308062860 0x7f3308124e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f330659c700 1 --2- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3308095190 0x7f3308115280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f33080963e0 tx=0x7f32fc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.583+0000 7f32ef7fe700 1 -- 172.21.15.78:0/2204510779 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc009470 con 0x7f3308095190 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.584+0000 7f32ef7fe700 1 -- 172.21.15.78:0/2204510779 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc012600 con 0x7f3308095190 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.584+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3300009ae0 con 0x7f3308095190 2024-04-25T02:11:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.584+0000 7f32ef7fe700 1 -- 172.21.15.78:0/2204510779 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc012980 con 0x7f3308095190 2024-04-25T02:11:59.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.584+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33080692e0 con 0x7f3308095190 2024-04-25T02:11:59.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.584+0000 7f32ef7fe700 1 -- 172.21.15.78:0/2204510779 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f32fc012cf0 con 0x7f3308095190 2024-04-25T02:11:59.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.584+0000 7f32ef7fe700 1 -- 172.21.15.78:0/2204510779 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f32fc03b690 con 0x7f3308095190 2024-04-25T02:11:59.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.585+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330809b490 con 0x7f3308095190 2024-04-25T02:11:59.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.589+0000 7f32ef7fe700 1 -- 172.21.15.78:0/2204510779 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f32fc011b00 con 0x7f3308095190 2024-04-25T02:11:59.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.746+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3308099a80 con 0x7f3308095190 2024-04-25T02:11:59.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.747+0000 7f32ef7fe700 1 -- 172.21.15.78:0/2204510779 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f32fc029030 con 0x7f3308095190 2024-04-25T02:11:59.754 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:11:59.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.748+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 >> v1:172.21.15.78:6816/46507 conn(0x7f32f402bd00 legacy=0x7f32f402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.748+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3308095190 msgr2=0x7f3308115280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.748+0000 7f330d007700 1 --2- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3308095190 0x7f3308115280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f33080963e0 tx=0x7f32fc009060).stop 2024-04-25T02:11:59.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.748+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 shutdown_connections 2024-04-25T02:11:59.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.748+0000 7f330d007700 1 --2- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3308115770 0x7f3308115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.748+0000 7f330d007700 1 --2- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3308062860 0x7f3308124e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.748+0000 7f330d007700 1 --2- 172.21.15.78:0/2204510779 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f3308095190 0x7f3308115280 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.748+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 >> 172.21.15.78:0/2204510779 conn(0x7f330809a970 msgr2=0x7f3308126290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.749+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 shutdown_connections 2024-04-25T02:11:59.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.749+0000 7f330d007700 1 -- 172.21.15.78:0/2204510779 wait complete. 2024-04-25T02:11:59.767 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:11:59.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20921f700 1 Processor -- start 2024-04-25T02:11:59.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20921f700 1 -- start start 2024-04-25T02:11:59.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20921f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff204095190 0x7ff204095570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20921f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095a60 0x7ff20412c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20921f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff204094c70 con 0x7ff20412c4f0 2024-04-25T02:11:59.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20921f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff204096570 con 0x7ff204095a60 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20921f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040923f0 con 0x7ff204095190 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff202d9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff204095190 0x7ff204095570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20359e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff20412c4f0 0x7ff20412e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39962/0 (socket says 172.21.15.78:39962) 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095a60 0x7ff20412c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.876+0000 7ff20359e700 1 -- 172.21.15.78:0/2807652172 learned_addr learned my addr 172.21.15.78:0/2807652172 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff20259c700 1 -- 172.21.15.78:0/2807652172 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff204095190 msgr2=0x7ff204095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff201d9b700 1 -- 172.21.15.78:0/2807652172 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108584733 0 0) 0x7ff204094c70 con 0x7ff20412c4f0 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff20259c700 1 --2- 172.21.15.78:0/2807652172 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff204095190 0x7ff204095570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff20259c700 1 -- 172.21.15.78:0/2807652172 >> v1:172.21.15.78:6789/0 conn(0x7ff20412c4f0 legacy=0x7ff20412e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff20259c700 1 -- 172.21.15.78:0/2807652172 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204096da0 con 0x7ff204095a60 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff202d9d700 1 --2- 172.21.15.78:0/2807652172 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff204095190 0x7ff204095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:59.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff20259c700 1 --2- 172.21.15.78:0/2807652172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095a60 0x7ff20412c000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff1f80097c0 tx=0x7ff1f8009060).ready entity=mon.1 client_cookie=343b80cd8c1d1cc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff201d9b700 1 -- 172.21.15.78:0/2807652172 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80090d0 con 0x7ff204095a60 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff201d9b700 1 -- 172.21.15.78:0/2807652172 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f800f510 con 0x7ff204095a60 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff201d9b700 1 -- 172.21.15.78:0/2807652172 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800f890 con 0x7ff204095a60 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff20921f700 1 -- 172.21.15.78:0/2807652172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095a60 msgr2=0x7ff20412c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.877+0000 7ff20921f700 1 --2- 172.21.15.78:0/2807652172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095a60 0x7ff20412c000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff1f80097c0 tx=0x7ff1f8009060).stop 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.878+0000 7ff20921f700 1 -- 172.21.15.78:0/2807652172 shutdown_connections 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.878+0000 7ff20921f700 1 --2- 172.21.15.78:0/2807652172 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff204095190 0x7ff204095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.878+0000 7ff20921f700 1 --2- 172.21.15.78:0/2807652172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095a60 0x7ff20412c000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.878+0000 7ff20921f700 1 -- 172.21.15.78:0/2807652172 >> 172.21.15.78:0/2807652172 conn(0x7ff20409a970 msgr2=0x7ff20409ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.878+0000 7ff20921f700 1 -- 172.21.15.78:0/2807652172 shutdown_connections 2024-04-25T02:11:59.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.878+0000 7ff20921f700 1 -- 172.21.15.78:0/2807652172 wait complete. 2024-04-25T02:11:59.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20921f700 1 Processor -- start 2024-04-25T02:11:59.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20921f700 1 -- start start 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20921f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095190 0x7ff204116180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20921f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204095a60 0x7ff204116670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20921f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff20412c4f0 0x7ff204116b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20921f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff204092540 con 0x7ff204095a60 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20921f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff204119240 con 0x7ff204095190 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20921f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff204118f80 con 0x7ff20412c4f0 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff202d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095190 0x7ff204116180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20359e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff20412c4f0 0x7ff204116b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff202d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095190 0x7ff204116180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51790/0 (socket says 172.21.15.78:51790) 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff202d9d700 1 -- 172.21.15.78:0/4227065972 learned_addr learned my addr 172.21.15.78:0/4227065972 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.879+0000 7ff20259c700 1 --2- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204095a60 0x7ff204116670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff20359e700 1 -- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095190 msgr2=0x7ff204116180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff20359e700 1 --2- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095190 0x7ff204116180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff20359e700 1 -- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204095a60 msgr2=0x7ff204116670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff20359e700 1 --2- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204095a60 0x7ff204116670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff20359e700 1 -- 172.21.15.78:0/4227065972 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40092a0 con 0x7ff20412c4f0 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff202d9d700 1 --2- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095190 0x7ff204116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff20359e700 1 --2- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff20412c4f0 0x7ff204116b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff1fc002230 tx=0x7ff1fc007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff1eb7fe700 1 -- 172.21.15.78:0/4227065972 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc005d30 con 0x7ff20412c4f0 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff1eb7fe700 1 -- 172.21.15.78:0/4227065972 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc007110 con 0x7ff20412c4f0 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f80092a0 con 0x7ff20412c4f0 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff1eb7fe700 1 -- 172.21.15.78:0/4227065972 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0074d0 con 0x7ff20412c4f0 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.880+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff204119dc0 con 0x7ff20412c4f0 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.881+0000 7ff1eb7fe700 1 -- 172.21.15.78:0/4227065972 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7ff1fc013410 con 0x7ff20412c4f0 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.881+0000 7ff1eb7fe700 1 -- 172.21.15.78:0/4227065972 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7ff1fc03b080 con 0x7ff20412c4f0 2024-04-25T02:11:59.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.881+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff204119dc0 con 0x7ff20412c4f0 2024-04-25T02:11:59.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:11:59.885+0000 7ff1eb7fe700 1 -- 172.21.15.78:0/4227065972 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7ff204119dc0 con 0x7ff20412c4f0 2024-04-25T02:12:00.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.044+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff204119dc0 con 0x7ff20412c4f0 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.044+0000 7ff1eb7fe700 1 -- 172.21.15.78:0/4227065972 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff204119dc0 con 0x7ff20412c4f0 2024-04-25T02:12:00.052 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 >> v1:172.21.15.78:6816/46507 conn(0x7ff1f002bd00 legacy=0x7ff1f002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff20412c4f0 msgr2=0x7ff204116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 --2- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff20412c4f0 0x7ff204116b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff1fc002230 tx=0x7ff1fc007eb0).stop 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 shutdown_connections 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 --2- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff20412c4f0 0x7ff204116b60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 --2- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff204095190 0x7ff204116180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 --2- 172.21.15.78:0/4227065972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff204095a60 0x7ff204116670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 >> 172.21.15.78:0/4227065972 conn(0x7ff20409a970 msgr2=0x7ff204069800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 shutdown_connections 2024-04-25T02:12:00.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.046+0000 7ff20921f700 1 -- 172.21.15.78:0/4227065972 wait complete. 2024-04-25T02:12:00.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:12:00.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.174+0000 7f7fbdce4700 1 Processor -- start 2024-04-25T02:12:00.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.174+0000 7f7fbdce4700 1 -- start start 2024-04-25T02:12:00.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fbdce4700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb80962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fbdce4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7fb812e120 0x7f7fb8130510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fbdce4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb80696c0 con 0x7f7fb80967d0 2024-04-25T02:12:00.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fbdce4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb8068e30 con 0x7f7fb812e120 2024-04-25T02:12:00.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fbdce4700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8097ec0 con 0x7f7fb80692e0 2024-04-25T02:12:00.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7fb812e120 0x7f7fb8130510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb6ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7fb80967d0 0x7f7fb8096bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39976/0 (socket says 172.21.15.78:39976) 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb77fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb80962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb6ffd700 1 -- 172.21.15.78:0/867866243 learned_addr learned my addr 172.21.15.78:0/867866243 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb7fff700 1 -- 172.21.15.78:0/867866243 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 msgr2=0x7f7fb80962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb7fff700 1 --2- 172.21.15.78:0/867866243 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb80962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb7fff700 1 -- 172.21.15.78:0/867866243 >> v1:172.21.15.78:6789/0 conn(0x7f7fb80967d0 legacy=0x7f7fb8096bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb7fff700 1 -- 172.21.15.78:0/867866243 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb80976e0 con 0x7f7fb812e120 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb67fc700 1 -- 172.21.15.78:0/867866243 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529648523 0 0) 0x7f7fb80696c0 con 0x7f7fb80967d0 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb77fe700 1 --2- 172.21.15.78:0/867866243 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb80962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb7fff700 1 --2- 172.21.15.78:0/867866243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 0x7f7fb8130510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f7fb0009e60 tx=0x7f7fb0009780).ready entity=mon.0 client_cookie=a93cf4f11cf8db73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.175+0000 7f7fb67fc700 1 -- 172.21.15.78:0/867866243 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000e070 con 0x7f7fb812e120 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fb67fc700 1 -- 172.21.15.78:0/867866243 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb000bb60 con 0x7f7fb812e120 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fb67fc700 1 -- 172.21.15.78:0/867866243 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0012410 con 0x7f7fb812e120 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fbdce4700 1 -- 172.21.15.78:0/867866243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 msgr2=0x7f7fb8130510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fbdce4700 1 --2- 172.21.15.78:0/867866243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 0x7f7fb8130510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f7fb0009e60 tx=0x7f7fb0009780).stop 2024-04-25T02:12:00.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fbdce4700 1 -- 172.21.15.78:0/867866243 shutdown_connections 2024-04-25T02:12:00.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fbdce4700 1 --2- 172.21.15.78:0/867866243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 0x7f7fb8130510 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fbdce4700 1 --2- 172.21.15.78:0/867866243 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb80962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fbdce4700 1 -- 172.21.15.78:0/867866243 >> 172.21.15.78:0/867866243 conn(0x7f7fb809ba80 msgr2=0x7f7fb809be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fbdce4700 1 -- 172.21.15.78:0/867866243 shutdown_connections 2024-04-25T02:12:00.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.176+0000 7f7fbdce4700 1 -- 172.21.15.78:0/867866243 wait complete. 2024-04-25T02:12:00.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.177+0000 7f7fbdce4700 1 Processor -- start 2024-04-25T02:12:00.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.177+0000 7f7fbdce4700 1 -- start start 2024-04-25T02:12:00.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.177+0000 7f7fbdce4700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb811de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.177+0000 7f7fbdce4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7fb80967d0 0x7f7fb8064200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fbdce4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 0x7f7fb80646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fbdce4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8067bb0 con 0x7f7fb812e120 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fbdce4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb811d020 con 0x7f7fb80967d0 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fbdce4700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb809bf00 con 0x7f7fb80692e0 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb6ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7fb80967d0 0x7f7fb8064200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 0x7f7fb80646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 0x7f7fb80646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60926/0 (socket says 172.21.15.78:60926) 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb6ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7fb80967d0 0x7f7fb8064200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51794/0 (socket says 172.21.15.78:51794) 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb7fff700 1 -- 172.21.15.78:0/1354151794 learned_addr learned my addr 172.21.15.78:0/1354151794 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb77fe700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb811de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb7fff700 1 -- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 msgr2=0x7f7fb811de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb7fff700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb811de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb7fff700 1 -- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7fb80967d0 msgr2=0x7f7fb8064200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb7fff700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7fb80967d0 0x7f7fb8064200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb7fff700 1 -- 172.21.15.78:0/1354151794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0092a0 con 0x7f7fb812e120 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb77fe700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb811de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb6ffd700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7fb80967d0 0x7f7fb8064200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fb7fff700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 0x7f7fb80646f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f7fb8068f70 tx=0x7f7fb0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7f9ffff700 1 -- 172.21.15.78:0/1354151794 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0012410 con 0x7f7fb812e120 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7f9ffff700 1 -- 172.21.15.78:0/1354151794 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb001d630 con 0x7f7fb812e120 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb0009a20 con 0x7f7fb812e120 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7f9ffff700 1 -- 172.21.15.78:0/1354151794 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb001d9f0 con 0x7f7fb812e120 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.178+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb8065c50 con 0x7f7fb812e120 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.179+0000 7f7f9ffff700 1 -- 172.21.15.78:0/1354151794 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f7fb0003040 con 0x7f7fb812e120 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.179+0000 7f7f9ffff700 1 -- 172.21.15.78:0/1354151794 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f7fb003cfc0 con 0x7f7fb812e120 2024-04-25T02:12:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.179+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb8063870 con 0x7f7fb812e120 2024-04-25T02:12:00.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.184+0000 7f7f9ffff700 1 -- 172.21.15.78:0/1354151794 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f7fb001bb50 con 0x7f7fb812e120 2024-04-25T02:12:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.341+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7fb8065000 con 0x7f7fb812e120 2024-04-25T02:12:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.341+0000 7f7f9ffff700 1 -- 172.21.15.78:0/1354151794 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7fb00350a0 con 0x7f7fb812e120 2024-04-25T02:12:00.349 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-25T02:12:00.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 >> v1:172.21.15.78:6816/46507 conn(0x7f7fa402bd00 legacy=0x7f7fa402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 msgr2=0x7f7fb80646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 0x7f7fb80646f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f7fb8068f70 tx=0x7f7fb0009780).stop 2024-04-25T02:12:00.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 shutdown_connections 2024-04-25T02:12:00.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fb812e120 0x7f7fb80646f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f7fb80692e0 0x7f7fb811de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 --2- 172.21.15.78:0/1354151794 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7fb80967d0 0x7f7fb8064200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 >> 172.21.15.78:0/1354151794 conn(0x7f7fb809ba80 msgr2=0x7f7fb809a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 shutdown_connections 2024-04-25T02:12:00.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.343+0000 7f7fbdce4700 1 -- 172.21.15.78:0/1354151794 wait complete. 2024-04-25T02:12:00.362 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.468+0000 7f97c0b1d700 1 Processor -- start 2024-04-25T02:12:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.468+0000 7f97c0b1d700 1 -- start start 2024-04-25T02:12:00.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.468+0000 7f97c0b1d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97bc069030 0x7f97bc0962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.468+0000 7f97c0b1d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc12e0c0 0x7f97bc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.468+0000 7f97c0b1d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97bc069f80 con 0x7f97bc0967d0 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.468+0000 7f97c0b1d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97bc069410 con 0x7f97bc069030 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.468+0000 7f97c0b1d700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0688a0 con 0x7f97bc12e0c0 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97bad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc12e0c0 0x7f97bc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97ba59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97bc069030 0x7f97bc0962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97bad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc12e0c0 0x7f97bc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42550/0 (socket says 172.21.15.78:42550) 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97bad9d700 1 -- 172.21.15.78:0/3356044127 learned_addr learned my addr 172.21.15.78:0/3356044127 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97b9d9b700 1 --1- 172.21.15.78:0/3356044127 >> v1:172.21.15.78:6789/0 conn(0x7f97bc0967d0 0x7f97bc096bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39988/0 (socket says 172.21.15.78:39988) 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97ba59c700 1 -- 172.21.15.78:0/3356044127 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc12e0c0 msgr2=0x7f97bc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:00.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97ba59c700 1 --2- 172.21.15.78:0/3356044127 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc12e0c0 0x7f97bc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97ba59c700 1 -- 172.21.15.78:0/3356044127 >> v1:172.21.15.78:6789/0 conn(0x7f97bc0967d0 legacy=0x7f97bc096bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97b959a700 1 -- 172.21.15.78:0/3356044127 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763093367 0 0) 0x7f97bc069f80 con 0x7f97bc0967d0 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97ba59c700 1 -- 172.21.15.78:0/3356044127 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc068b10 con 0x7f97bc069030 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97ba59c700 1 --2- 172.21.15.78:0/3356044127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc069030 0x7f97bc0962e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f97b0009760 tx=0x7f97b0009060).ready entity=mon.0 client_cookie=98ca81254aa1ed9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97b959a700 1 -- 172.21.15.78:0/3356044127 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b000f510 con 0x7f97bc069030 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97b959a700 1 -- 172.21.15.78:0/3356044127 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b000f670 con 0x7f97bc069030 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.469+0000 7f97b959a700 1 -- 172.21.15.78:0/3356044127 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b000f9f0 con 0x7f97bc069030 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.470+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3356044127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc069030 msgr2=0x7f97bc0962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.470+0000 7f97c0b1d700 1 --2- 172.21.15.78:0/3356044127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc069030 0x7f97bc0962e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f97b0009760 tx=0x7f97b0009060).stop 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.470+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3356044127 shutdown_connections 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.470+0000 7f97c0b1d700 1 --2- 172.21.15.78:0/3356044127 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc12e0c0 0x7f97bc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.470+0000 7f97c0b1d700 1 --2- 172.21.15.78:0/3356044127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc069030 0x7f97bc0962e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.470+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3356044127 >> 172.21.15.78:0/3356044127 conn(0x7f97bc09c550 msgr2=0x7f97bc0983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.470+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3356044127 shutdown_connections 2024-04-25T02:12:00.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.470+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3356044127 wait complete. 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97c0b1d700 1 Processor -- start 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97c0b1d700 1 -- start start 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97c0b1d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97bc0967d0 0x7f97bc11a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97c0b1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc12e0c0 0x7f97bc11a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97c0b1d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc11aa40 0x7f97bc13a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97c0b1d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc11c690 con 0x7f97bc12e0c0 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97c0b1d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0678e0 con 0x7f97bc0967d0 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97c0b1d700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc11d560 con 0x7f97bc11aa40 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97ba59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97bc0967d0 0x7f97bc11a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97bad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc11aa40 0x7f97bc13a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97ba59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97bc0967d0 0x7f97bc11a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51806/0 (socket says 172.21.15.78:51806) 2024-04-25T02:12:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97bad9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc11aa40 0x7f97bc13a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42560/0 (socket says 172.21.15.78:42560) 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.471+0000 7f97ba59c700 1 -- 172.21.15.78:0/3373536765 learned_addr learned my addr 172.21.15.78:0/3373536765 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97b9d9b700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc12e0c0 0x7f97bc11a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97ba59c700 1 -- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc11aa40 msgr2=0x7f97bc13a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97ba59c700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc11aa40 0x7f97bc13a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97ba59c700 1 -- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc12e0c0 msgr2=0x7f97bc11a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97ba59c700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc12e0c0 0x7f97bc11a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97ba59c700 1 -- 172.21.15.78:0/3373536765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00092a0 con 0x7f97bc0967d0 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97bad9d700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc11aa40 0x7f97bc13a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97b9d9b700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc12e0c0 0x7f97bc11a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97ba59c700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97bc0967d0 0x7f97bc11a060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f97b0000e50 tx=0x7f97b0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97aaffd700 1 -- 172.21.15.78:0/3373536765 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b001a6e0 con 0x7f97bc0967d0 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97aaffd700 1 -- 172.21.15.78:0/3373536765 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b001a840 con 0x7f97bc0967d0 2024-04-25T02:12:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc11aea0 con 0x7f97bc0967d0 2024-04-25T02:12:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97aaffd700 1 -- 172.21.15.78:0/3373536765 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b001ac00 con 0x7f97bc0967d0 2024-04-25T02:12:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.472+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc11bc90 con 0x7f97bc0967d0 2024-04-25T02:12:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.473+0000 7f97aaffd700 1 -- 172.21.15.78:0/3373536765 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f97b0020070 con 0x7f97bc0967d0 2024-04-25T02:12:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.473+0000 7f97aaffd700 1 -- 172.21.15.78:0/3373536765 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f97b003c1a0 con 0x7f97bc0967d0 2024-04-25T02:12:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.473+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97bc098af0 con 0x7f97bc0967d0 2024-04-25T02:12:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.478+0000 7f97aaffd700 1 -- 172.21.15.78:0/3373536765 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f97b0027070 con 0x7f97bc0967d0 2024-04-25T02:12:00.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.673+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97bc094ed0 con 0x7f97bc0967d0 2024-04-25T02:12:00.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.674+0000 7f97aaffd700 1 -- 172.21.15.78:0/3373536765 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7f97b0027020 con 0x7f97bc0967d0 2024-04-25T02:12:00.681 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:12:00.681 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:02.698771+0000","modified":"2024-04-25T02:10:04.706190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:12:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.675+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 >> v1:172.21.15.78:6816/46507 conn(0x7f979c02bd00 legacy=0x7f979c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.675+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97bc0967d0 msgr2=0x7f97bc11a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.675+0000 7f97c0b1d700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97bc0967d0 0x7f97bc11a060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f97b0000e50 tx=0x7f97b0017000).stop 2024-04-25T02:12:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.675+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 shutdown_connections 2024-04-25T02:12:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.675+0000 7f97c0b1d700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f97bc11aa40 0x7f97bc13a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.675+0000 7f97c0b1d700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97bc0967d0 0x7f97bc11a060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.675+0000 7f97c0b1d700 1 --2- 172.21.15.78:0/3373536765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97bc12e0c0 0x7f97bc11a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.675+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 >> 172.21.15.78:0/3373536765 conn(0x7f97bc069030 msgr2=0x7f97bc09a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.676+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 shutdown_connections 2024-04-25T02:12:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.676+0000 7f97c0b1d700 1 -- 172.21.15.78:0/3373536765 wait complete. 2024-04-25T02:12:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-25T02:12:00.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:12:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff951785700 1 Processor -- start 2024-04-25T02:12:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff951785700 1 -- start start 2024-04-25T02:12:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff951785700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff94c12a750 0x7ff94c12b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff951785700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c12fac0 0x7ff94c131eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff951785700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c065750 con 0x7ff94c064ad0 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff951785700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c064eb0 con 0x7ff94c12a750 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff951785700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c099930 con 0x7ff94c12fac0 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff94b7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c12fac0 0x7ff94c131eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff94a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff94c12a750 0x7ff94c12b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff94b7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c12fac0 0x7ff94c131eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42566/0 (socket says 172.21.15.78:42566) 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff94b7fe700 1 -- 172.21.15.78:0/3461196664 learned_addr learned my addr 172.21.15.78:0/3461196664 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.802+0000 7ff94affd700 1 --1- 172.21.15.78:0/3461196664 >> v1:172.21.15.78:6789/0 conn(0x7ff94c064ad0 0x7ff94c12abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39994/0 (socket says 172.21.15.78:39994) 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff949ffb700 1 -- 172.21.15.78:0/3461196664 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511287005 0 0) 0x7ff94c065750 con 0x7ff94c064ad0 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff94b7fe700 1 -- 172.21.15.78:0/3461196664 >> v2:172.21.15.78:3300/0 conn(0x7ff94c12a750 msgr2=0x7ff94c12b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff94b7fe700 1 --2- 172.21.15.78:0/3461196664 >> v2:172.21.15.78:3300/0 conn(0x7ff94c12a750 0x7ff94c12b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff94b7fe700 1 -- 172.21.15.78:0/3461196664 >> v1:172.21.15.78:6789/0 conn(0x7ff94c064ad0 legacy=0x7ff94c12abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff94b7fe700 1 -- 172.21.15.78:0/3461196664 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c065b40 con 0x7ff94c12fac0 2024-04-25T02:12:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff94b7fe700 1 --2- 172.21.15.78:0/3461196664 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c12fac0 0x7ff94c131eb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff944009f20 tx=0x7ff944009840).ready entity=mon.2 client_cookie=eb8b5b91e627f1f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff949ffb700 1 -- 172.21.15.78:0/3461196664 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400e070 con 0x7ff94c12fac0 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff949ffb700 1 -- 172.21.15.78:0/3461196664 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400b9d0 con 0x7ff94c12fac0 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff949ffb700 1 -- 172.21.15.78:0/3461196664 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400bd50 con 0x7ff94c12fac0 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff951785700 1 -- 172.21.15.78:0/3461196664 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c12fac0 msgr2=0x7ff94c131eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff951785700 1 --2- 172.21.15.78:0/3461196664 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c12fac0 0x7ff94c131eb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff944009f20 tx=0x7ff944009840).stop 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff951785700 1 -- 172.21.15.78:0/3461196664 shutdown_connections 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff951785700 1 --2- 172.21.15.78:0/3461196664 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c12fac0 0x7ff94c131eb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff951785700 1 --2- 172.21.15.78:0/3461196664 >> v2:172.21.15.78:3300/0 conn(0x7ff94c12a750 0x7ff94c12b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff951785700 1 -- 172.21.15.78:0/3461196664 >> 172.21.15.78:0/3461196664 conn(0x7ff94c09a630 msgr2=0x7ff94c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.803+0000 7ff951785700 1 -- 172.21.15.78:0/3461196664 shutdown_connections 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.804+0000 7ff951785700 1 -- 172.21.15.78:0/3461196664 wait complete. 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.804+0000 7ff951785700 1 Processor -- start 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.804+0000 7ff951785700 1 -- start start 2024-04-25T02:12:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff951785700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff94c064ad0 0x7ff94c093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff951785700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff94c12fac0 0x7ff94c093a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff951785700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c093f50 0x7ff94c0943d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff951785700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c095b20 con 0x7ff94c12fac0 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff951785700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c12a020 con 0x7ff94c064ad0 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff951785700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c099ab0 con 0x7ff94c093f50 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff94c064ad0 0x7ff94c093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff94c12fac0 0x7ff94c093a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff94c064ad0 0x7ff94c093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51814/0 (socket says 172.21.15.78:51814) 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94affd700 1 -- 172.21.15.78:0/2561640709 learned_addr learned my addr 172.21.15.78:0/2561640709 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94b7fe700 1 --2- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c093f50 0x7ff94c0943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94a7fc700 1 -- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c093f50 msgr2=0x7ff94c0943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94a7fc700 1 --2- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c093f50 0x7ff94c0943d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94a7fc700 1 -- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff94c064ad0 msgr2=0x7ff94c093570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94a7fc700 1 --2- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff94c064ad0 0x7ff94c093570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94a7fc700 1 -- 172.21.15.78:0/2561640709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944009ae0 con 0x7ff94c12fac0 2024-04-25T02:12:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.805+0000 7ff94a7fc700 1 --2- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff94c12fac0 0x7ff94c093a60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff94000e900 tx=0x7ff940009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.806+0000 7ff9337fe700 1 -- 172.21.15.78:0/2561640709 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940009450 con 0x7ff94c12fac0 2024-04-25T02:12:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.806+0000 7ff9337fe700 1 -- 172.21.15.78:0/2561640709 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff940012600 con 0x7ff94c12fac0 2024-04-25T02:12:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.806+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c127bd0 con 0x7ff94c12fac0 2024-04-25T02:12:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.806+0000 7ff9337fe700 1 -- 172.21.15.78:0/2561640709 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940012980 con 0x7ff94c12fac0 2024-04-25T02:12:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.806+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c094940 con 0x7ff94c12fac0 2024-04-25T02:12:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.806+0000 7ff9337fe700 1 -- 172.21.15.78:0/2561640709 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7ff940012cf0 con 0x7ff94c12fac0 2024-04-25T02:12:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.807+0000 7ff9337fe700 1 -- 172.21.15.78:0/2561640709 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7ff94003b600 con 0x7ff94c12fac0 2024-04-25T02:12:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.807+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c09b150 con 0x7ff94c12fac0 2024-04-25T02:12:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.811+0000 7ff9337fe700 1 -- 172.21.15.78:0/2561640709 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7ff940019310 con 0x7ff94c12fac0 2024-04-25T02:12:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.972+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff94c097050 con 0x7ff94c12fac0 2024-04-25T02:12:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.972+0000 7ff9337fe700 1 -- 172.21.15.78:0/2561640709 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11609 (secure 0 0 0) 0x7ff940011b00 con 0x7ff94c12fac0 2024-04-25T02:12:00.980 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:12:00.980 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:53.832053+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 >> v1:172.21.15.78:6816/46507 conn(0x7ff93802bd00 legacy=0x7ff93802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff94c12fac0 msgr2=0x7ff94c093a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 --2- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff94c12fac0 0x7ff94c093a60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff94000e900 tx=0x7ff940009060).stop 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 shutdown_connections 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 --2- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ff94c093f50 0x7ff94c0943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 --2- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff94c064ad0 0x7ff94c093570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 --2- 172.21.15.78:0/2561640709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff94c12fac0 0x7ff94c093a60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 >> 172.21.15.78:0/2561640709 conn(0x7ff94c09a630 msgr2=0x7ff94c1295f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 shutdown_connections 2024-04-25T02:12:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:00.974+0000 7ff951785700 1 -- 172.21.15.78:0/2561640709 wait complete. 2024-04-25T02:12:00.993 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:00.989685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:01.680090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:12:00.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.103+0000 7fa7671e3700 1 Processor -- start 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.103+0000 7fa7671e3700 1 -- start start 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa7671e3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa760127950 0x7fa760127d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa7671e3700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760128220 0x7fa760095b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa7671e3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76005f7b0 con 0x7fa760096000 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa7671e3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76005ed80 con 0x7fa760127950 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa7671e3700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa760093140 con 0x7fa760128220 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa764f7f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa760127950 0x7fa760127d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa765780700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa760096000 0x7fa76012eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40002/0 (socket says 172.21.15.78:40002) 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa765780700 1 -- 172.21.15.78:0/3215944930 learned_addr learned my addr 172.21.15.78:0/3215944930 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:12:01.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa75ffff700 1 --2- 172.21.15.78:0/3215944930 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760128220 0x7fa760095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa764f7f700 1 -- 172.21.15.78:0/3215944930 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760128220 msgr2=0x7fa760095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa764f7f700 1 --2- 172.21.15.78:0/3215944930 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760128220 0x7fa760095b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa764f7f700 1 -- 172.21.15.78:0/3215944930 >> v1:172.21.15.78:6789/0 conn(0x7fa760096000 legacy=0x7fa76012eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa75f7fe700 1 -- 172.21.15.78:0/3215944930 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155914273 0 0) 0x7fa76005f7b0 con 0x7fa760096000 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa764f7f700 1 -- 172.21.15.78:0/3215944930 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760128620 con 0x7fa760127950 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa75ffff700 1 --2- 172.21.15.78:0/3215944930 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760128220 0x7fa760095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.104+0000 7fa764f7f700 1 --2- 172.21.15.78:0/3215944930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760127950 0x7fa760127d30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa754009760 tx=0x7fa754009060).ready entity=mon.0 client_cookie=13c8d2697bb924f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa75f7fe700 1 -- 172.21.15.78:0/3215944930 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7540090d0 con 0x7fa760127950 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa75f7fe700 1 -- 172.21.15.78:0/3215944930 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75400f510 con 0x7fa760127950 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa75f7fe700 1 -- 172.21.15.78:0/3215944930 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400f890 con 0x7fa760127950 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa7671e3700 1 -- 172.21.15.78:0/3215944930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760127950 msgr2=0x7fa760127d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa7671e3700 1 --2- 172.21.15.78:0/3215944930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760127950 0x7fa760127d30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa754009760 tx=0x7fa754009060).stop 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa7671e3700 1 -- 172.21.15.78:0/3215944930 shutdown_connections 2024-04-25T02:12:01.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa7671e3700 1 --2- 172.21.15.78:0/3215944930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760127950 0x7fa760127d30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa7671e3700 1 --2- 172.21.15.78:0/3215944930 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760128220 0x7fa760095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa7671e3700 1 -- 172.21.15.78:0/3215944930 >> 172.21.15.78:0/3215944930 conn(0x7fa76009abf0 msgr2=0x7fa760096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa7671e3700 1 -- 172.21.15.78:0/3215944930 shutdown_connections 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.105+0000 7fa7671e3700 1 -- 172.21.15.78:0/3215944930 wait complete. 2024-04-25T02:12:01.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.106+0000 7fa7671e3700 1 Processor -- start 2024-04-25T02:12:01.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.106+0000 7fa7671e3700 1 -- start start 2024-04-25T02:12:01.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa7671e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760096000 0x7fa760124270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa7671e3700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760127950 0x7fa7600915a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa7671e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa760128220 0x7fa760091a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa7671e3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa760093f30 con 0x7fa760096000 2024-04-25T02:12:01.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa7671e3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7600843a0 con 0x7fa760128220 2024-04-25T02:12:01.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa7671e3700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa760084b80 con 0x7fa760127950 2024-04-25T02:12:01.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa764f7f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760096000 0x7fa760124270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa764f7f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760096000 0x7fa760124270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60960/0 (socket says 172.21.15.78:60960) 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa764f7f700 1 -- 172.21.15.78:0/1465603977 learned_addr learned my addr 172.21.15.78:0/1465603977 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa75ffff700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760127950 0x7fa7600915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.107+0000 7fa765780700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa760128220 0x7fa760091a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75ffff700 1 -- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa760128220 msgr2=0x7fa760091a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75ffff700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa760128220 0x7fa760091a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75ffff700 1 -- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760096000 msgr2=0x7fa760124270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75ffff700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760096000 0x7fa760124270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75ffff700 1 -- 172.21.15.78:0/1465603977 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0092a0 con 0x7fa760127950 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa764f7f700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760096000 0x7fa760124270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75ffff700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760127950 0x7fa7600915a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa74c00e950 tx=0x7fa74c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75d7fa700 1 -- 172.21.15.78:0/1465603977 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c009580 con 0x7fa760127950 2024-04-25T02:12:01.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75d7fa700 1 -- 172.21.15.78:0/1465603977 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c012600 con 0x7fa760127950 2024-04-25T02:12:01.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7540092a0 con 0x7fa760127950 2024-04-25T02:12:01.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75d7fa700 1 -- 172.21.15.78:0/1465603977 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0129a0 con 0x7fa760127950 2024-04-25T02:12:01.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa760124a70 con 0x7fa760127950 2024-04-25T02:12:01.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.108+0000 7fa75d7fa700 1 -- 172.21.15.78:0/1465603977 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fa74c012d10 con 0x7fa760127950 2024-04-25T02:12:01.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.109+0000 7fa75d7fa700 1 -- 172.21.15.78:0/1465603977 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fa74c03b660 con 0x7fa760127950 2024-04-25T02:12:01.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.109+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76006c550 con 0x7fa760127950 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.113+0000 7fa75d7fa700 1 -- 172.21.15.78:0/1465603977 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fa74c019310 con 0x7fa760127950 2024-04-25T02:12:01.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.271+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa760046ce0 con 0x7fa760127950 2024-04-25T02:12:01.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.271+0000 7fa75d7fa700 1 -- 172.21.15.78:0/1465603977 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa74c011b40 con 0x7fa760127950 2024-04-25T02:12:01.279 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 >> v1:172.21.15.78:6816/46507 conn(0x7fa74402bd30 legacy=0x7fa74402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760127950 msgr2=0x7fa7600915a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760127950 0x7fa7600915a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa74c00e950 tx=0x7fa74c009060).stop 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 shutdown_connections 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa760128220 0x7fa760091a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa760096000 0x7fa760124270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 --2- 172.21.15.78:0/1465603977 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa760127950 0x7fa7600915a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 >> 172.21.15.78:0/1465603977 conn(0x7fa76009abf0 msgr2=0x7fa76006a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 shutdown_connections 2024-04-25T02:12:01.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.273+0000 7fa7671e3700 1 -- 172.21.15.78:0/1465603977 wait complete. 2024-04-25T02:12:01.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:12:01.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.401+0000 7fa9f0290700 1 Processor -- start 2024-04-25T02:12:01.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.401+0000 7fa9f0290700 1 -- start start 2024-04-25T02:12:01.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9f0290700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e80962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9f0290700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e80967d0 0x7fa9e8096bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9f0290700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa9e812d110 0x7fa9e812f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9f0290700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e8068890 con 0x7fa9e812d110 2024-04-25T02:12:01.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9f0290700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e8068e30 con 0x7fa9e80967d0 2024-04-25T02:12:01.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9f0290700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80696c0 con 0x7fa9e80692e0 2024-04-25T02:12:01.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee82d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa9e812d110 0x7fa9e812f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee02c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e80962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ed82b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e80967d0 0x7fa9e8096bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee82d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa9e812d110 0x7fa9e812f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60968/0 (socket says 172.21.15.78:60968) 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ed82b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e80967d0 0x7fa9e8096bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51830/0 (socket says 172.21.15.78:51830) 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee82d700 1 -- 172.21.15.78:0/1497780035 learned_addr learned my addr 172.21.15.78:0/1497780035 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee02c700 1 -- 172.21.15.78:0/1497780035 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e80967d0 msgr2=0x7fa9e8096bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee02c700 1 --2- 172.21.15.78:0/1497780035 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e80967d0 0x7fa9e8096bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee02c700 1 -- 172.21.15.78:0/1497780035 >> v2:172.21.15.78:3300/0 conn(0x7fa9e812d110 msgr2=0x7fa9e812f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee02c700 1 --2- 172.21.15.78:0/1497780035 >> v2:172.21.15.78:3300/0 conn(0x7fa9e812d110 0x7fa9e812f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee02c700 1 -- 172.21.15.78:0/1497780035 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e8097ec0 con 0x7fa9e80692e0 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee82d700 1 --2- 172.21.15.78:0/1497780035 >> v2:172.21.15.78:3300/0 conn(0x7fa9e812d110 0x7fa9e812f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ee02c700 1 --2- 172.21.15.78:0/1497780035 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e80962e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa9d8009760 tx=0x7fa9d8009060).ready entity=mon.2 client_cookie=1f9349517f184819 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ed02a700 1 -- 172.21.15.78:0/1497780035 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800d4a0 con 0x7fa9e80692e0 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ed02a700 1 -- 172.21.15.78:0/1497780035 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d800d600 con 0x7fa9e80692e0 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.402+0000 7fa9ed02a700 1 -- 172.21.15.78:0/1497780035 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800d980 con 0x7fa9e80692e0 2024-04-25T02:12:01.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.403+0000 7fa9f0290700 1 -- 172.21.15.78:0/1497780035 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 msgr2=0x7fa9e80962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.403+0000 7fa9f0290700 1 --2- 172.21.15.78:0/1497780035 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e80962e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa9d8009760 tx=0x7fa9d8009060).stop 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.403+0000 7fa9f0290700 1 -- 172.21.15.78:0/1497780035 shutdown_connections 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.403+0000 7fa9f0290700 1 --2- 172.21.15.78:0/1497780035 >> v2:172.21.15.78:3300/0 conn(0x7fa9e812d110 0x7fa9e812f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.403+0000 7fa9f0290700 1 --2- 172.21.15.78:0/1497780035 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e80962e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.403+0000 7fa9f0290700 1 --2- 172.21.15.78:0/1497780035 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e80967d0 0x7fa9e8096bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.403+0000 7fa9f0290700 1 -- 172.21.15.78:0/1497780035 >> 172.21.15.78:0/1497780035 conn(0x7fa9e809ba80 msgr2=0x7fa9e809be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.403+0000 7fa9f0290700 1 -- 172.21.15.78:0/1497780035 shutdown_connections 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.403+0000 7fa9f0290700 1 -- 172.21.15.78:0/1497780035 wait complete. 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9f0290700 1 Processor -- start 2024-04-25T02:12:01.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9f0290700 1 -- start start 2024-04-25T02:12:01.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9f0290700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e811bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9f0290700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9e80967d0 0x7fa9e8117c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9f0290700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e812d110 0x7fa9e8118170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9f0290700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e811b210 con 0x7fa9e80967d0 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9f0290700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e811add0 con 0x7fa9e812d110 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9f0290700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80632f0 con 0x7fa9e80692e0 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9ee02c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e811bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9ee82d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e812d110 0x7fa9e8118170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9ee02c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e811bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42600/0 (socket says 172.21.15.78:42600) 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9ee02c700 1 -- 172.21.15.78:0/2984639800 learned_addr learned my addr 172.21.15.78:0/2984639800 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.404+0000 7fa9ed82b700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9e80967d0 0x7fa9e8117c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9ee82d700 1 -- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 msgr2=0x7fa9e811bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9ee82d700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e811bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9ee82d700 1 -- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9e80967d0 msgr2=0x7fa9e8117c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9ee82d700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9e80967d0 0x7fa9e8117c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9ee82d700 1 -- 172.21.15.78:0/2984639800 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009ae0 con 0x7fa9e812d110 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9ee02c700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e811bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9ed82b700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9e80967d0 0x7fa9e8117c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9ee82d700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e812d110 0x7fa9e8118170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa9e0009f10 tx=0x7fa9e000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9def78700 1 -- 172.21.15.78:0/2984639800 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00092e0 con 0x7fa9e812d110 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9def78700 1 -- 172.21.15.78:0/2984639800 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e000f040 con 0x7fa9e812d110 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d80092a0 con 0x7fa9e812d110 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9def78700 1 -- 172.21.15.78:0/2984639800 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000cb70 con 0x7fa9e812d110 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.405+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e81198a0 con 0x7fa9e812d110 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.406+0000 7fa9def78700 1 -- 172.21.15.78:0/2984639800 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fa9e0014460 con 0x7fa9e812d110 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.406+0000 7fa9def78700 1 -- 172.21.15.78:0/2984639800 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fa9e003b200 con 0x7fa9e812d110 2024-04-25T02:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.406+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e8063870 con 0x7fa9e812d110 2024-04-25T02:12:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.410+0000 7fa9def78700 1 -- 172.21.15.78:0/2984639800 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fa9e0012360 con 0x7fa9e812d110 2024-04-25T02:12:01.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.566+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9e8046ce0 con 0x7fa9e812d110 2024-04-25T02:12:01.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.567+0000 7fa9def78700 1 -- 172.21.15.78:0/2984639800 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9e001cb10 con 0x7fa9e812d110 2024-04-25T02:12:01.575 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:12:01.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.568+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 >> v1:172.21.15.78:6816/46507 conn(0x7fa9cc02bd30 legacy=0x7fa9cc02e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.569+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e812d110 msgr2=0x7fa9e8118170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.569+0000 7fa9f0290700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e812d110 0x7fa9e8118170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa9e0009f10 tx=0x7fa9e000b040).stop 2024-04-25T02:12:01.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.569+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 shutdown_connections 2024-04-25T02:12:01.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.569+0000 7fa9f0290700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa9e812d110 0x7fa9e8118170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.569+0000 7fa9f0290700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa9e80692e0 0x7fa9e811bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.569+0000 7fa9f0290700 1 --2- 172.21.15.78:0/2984639800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9e80967d0 0x7fa9e8117c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.569+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 >> 172.21.15.78:0/2984639800 conn(0x7fa9e809ba80 msgr2=0x7fa9e8111f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.569+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 shutdown_connections 2024-04-25T02:12:01.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.569+0000 7fa9f0290700 1 -- 172.21.15.78:0/2984639800 wait complete. 2024-04-25T02:12:01.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:12:01.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.707+0000 7f16c62f3700 1 Processor -- start 2024-04-25T02:12:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.707+0000 7f16c62f3700 1 -- start start 2024-04-25T02:12:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16c62f3700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c0095b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16c62f3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16c0096000 0x7f16c0096400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16c62f3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c012f370 0x7f16c0131760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16c62f3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c0092ed0 con 0x7f16c0096000 2024-04-25T02:12:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16c62f3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c00931b0 con 0x7f16c012f370 2024-04-25T02:12:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16c62f3700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0091e20 con 0x7f16c0092af0 2024-04-25T02:12:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bf7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16c0096000 0x7f16c0096400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c0095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16c4890700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c012f370 0x7f16c0131760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bf7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16c0096000 0x7f16c0096400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60990/0 (socket says 172.21.15.78:60990) 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c0095b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42602/0 (socket says 172.21.15.78:42602) 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bf7fe700 1 -- 172.21.15.78:0/3584543189 learned_addr learned my addr 172.21.15.78:0/3584543189 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bf7fe700 1 -- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 msgr2=0x7f16c0095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bf7fe700 1 --2- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c0095b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bf7fe700 1 -- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c012f370 msgr2=0x7f16c0131760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bf7fe700 1 --2- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c012f370 0x7f16c0131760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bf7fe700 1 -- 172.21.15.78:0/3584543189 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c005ed80 con 0x7f16c0096000 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16c4890700 1 --2- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c012f370 0x7f16c0131760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16bf7fe700 1 --2- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c0096000 0x7f16c0096400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f16b0009830 tx=0x7f16b00090f0).ready entity=mon.0 client_cookie=5de3668e8137b60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16beffd700 1 -- 172.21.15.78:0/3584543189 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b000f510 con 0x7f16c0096000 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16beffd700 1 -- 172.21.15.78:0/3584543189 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b000f670 con 0x7f16c0096000 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.708+0000 7f16beffd700 1 -- 172.21.15.78:0/3584543189 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b000f9f0 con 0x7f16c0096000 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.709+0000 7f16c62f3700 1 -- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c0096000 msgr2=0x7f16c0096400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.709+0000 7f16c62f3700 1 --2- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c0096000 0x7f16c0096400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f16b0009830 tx=0x7f16b00090f0).stop 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.709+0000 7f16c62f3700 1 -- 172.21.15.78:0/3584543189 shutdown_connections 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.709+0000 7f16c62f3700 1 --2- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c012f370 0x7f16c0131760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.709+0000 7f16c62f3700 1 --2- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c0095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.709+0000 7f16c62f3700 1 --2- 172.21.15.78:0/3584543189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c0096000 0x7f16c0096400 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.709+0000 7f16c62f3700 1 -- 172.21.15.78:0/3584543189 >> 172.21.15.78:0/3584543189 conn(0x7f16c009abf0 msgr2=0x7f16c0096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.709+0000 7f16c62f3700 1 -- 172.21.15.78:0/3584543189 shutdown_connections 2024-04-25T02:12:01.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.709+0000 7f16c62f3700 1 -- 172.21.15.78:0/3584543189 wait complete. 2024-04-25T02:12:01.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.710+0000 7f16c62f3700 1 Processor -- start 2024-04-25T02:12:01.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.710+0000 7f16c62f3700 1 -- start start 2024-04-25T02:12:01.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.710+0000 7f16c62f3700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c012e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.710+0000 7f16c62f3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c0096000 0x7f16c012e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.710+0000 7f16c62f3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c012f370 0x7f16c012ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:01.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.710+0000 7f16c62f3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c008c740 con 0x7f16c012f370 2024-04-25T02:12:01.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.710+0000 7f16c62f3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c008e800 con 0x7f16c0096000 2024-04-25T02:12:01.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.710+0000 7f16c62f3700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16c008ce90 con 0x7f16c0092af0 2024-04-25T02:12:01.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c012e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c012e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42608/0 (socket says 172.21.15.78:42608) 2024-04-25T02:12:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bf7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c0096000 0x7f16c012e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16c4890700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c012f370 0x7f16c012ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bffff700 1 -- 172.21.15.78:0/2055398761 learned_addr learned my addr 172.21.15.78:0/2055398761 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bffff700 1 -- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c0096000 msgr2=0x7f16c012e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bffff700 1 --2- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c0096000 0x7f16c012e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bffff700 1 -- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c012f370 msgr2=0x7f16c012ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bffff700 1 --2- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c012f370 0x7f16c012ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bffff700 1 -- 172.21.15.78:0/2055398761 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b8009a20 con 0x7f16c0092af0 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16c4890700 1 --2- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c012f370 0x7f16c012ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bf7fe700 1 --2- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c0096000 0x7f16c012e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bffff700 1 --2- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c012e380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f16b400e930 tx=0x7f16b4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bcff9700 1 -- 172.21.15.78:0/2055398761 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4009510 con 0x7f16c0092af0 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bcff9700 1 -- 172.21.15.78:0/2055398761 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b4012600 con 0x7f16c0092af0 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b0009370 con 0x7f16c0092af0 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16bcff9700 1 -- 172.21.15.78:0/2055398761 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4012980 con 0x7f16c0092af0 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.711+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c00976f0 con 0x7f16c0092af0 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.712+0000 7f16bcff9700 1 -- 172.21.15.78:0/2055398761 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f16b401b400 con 0x7f16c0092af0 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.712+0000 7f16bcff9700 1 -- 172.21.15.78:0/2055398761 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f16b403b750 con 0x7f16c0092af0 2024-04-25T02:12:01.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.712+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c0096850 con 0x7f16c0092af0 2024-04-25T02:12:01.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.717+0000 7f16bcff9700 1 -- 172.21.15.78:0/2055398761 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f16b4019310 con 0x7f16c0092af0 2024-04-25T02:12:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.873+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16c008f980 con 0x7f16c0092af0 2024-04-25T02:12:01.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.874+0000 7f16bcff9700 1 -- 172.21.15.78:0/2055398761 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16b402a0a0 con 0x7f16c0092af0 2024-04-25T02:12:01.882 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-25T02:12:01.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.875+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 >> v1:172.21.15.78:6816/46507 conn(0x7f16ac02bd00 legacy=0x7f16ac02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.875+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 msgr2=0x7f16c012e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.875+0000 7f16c62f3700 1 --2- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c012e380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f16b400e930 tx=0x7f16b4009060).stop 2024-04-25T02:12:01.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.876+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 shutdown_connections 2024-04-25T02:12:01.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.876+0000 7f16c62f3700 1 --2- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c012f370 0x7f16c012ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.876+0000 7f16c62f3700 1 --2- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f16c0092af0 0x7f16c012e380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.876+0000 7f16c62f3700 1 --2- 172.21.15.78:0/2055398761 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16c0096000 0x7f16c012e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:01.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.876+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 >> 172.21.15.78:0/2055398761 conn(0x7f16c009abf0 msgr2=0x7f16c0094a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.876+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 shutdown_connections 2024-04-25T02:12:01.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:01.876+0000 7f16c62f3700 1 -- 172.21.15.78:0/2055398761 wait complete. 2024-04-25T02:12:01.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:12:02.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.005+0000 7f904f7dc700 1 Processor -- start 2024-04-25T02:12:02.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.005+0000 7f904f7dc700 1 -- start start 2024-04-25T02:12:02.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904f7dc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048062860 0x7f904812af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904f7dc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f904812ab00 0x7f904812b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904f7dc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9048095190 0x7f9048095640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904f7dc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9048062c40 con 0x7f9048095190 2024-04-25T02:12:02.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904f7dc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480922e0 con 0x7f904812ab00 2024-04-25T02:12:02.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904f7dc700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9048091a10 con 0x7f9048062860 2024-04-25T02:12:02.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904cd77700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f904812ab00 0x7f904812b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904dd79700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9048095190 0x7f9048095640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904cd77700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f904812ab00 0x7f904812b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51850/0 (socket says 172.21.15.78:51850) 2024-04-25T02:12:02.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904dd79700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9048095190 0x7f9048095640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32778/0 (socket says 172.21.15.78:32778) 2024-04-25T02:12:02.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904cd77700 1 -- 172.21.15.78:0/3315194802 learned_addr learned my addr 172.21.15.78:0/3315194802 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:02.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904d578700 1 --2- 172.21.15.78:0/3315194802 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048062860 0x7f904812af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904cd77700 1 -- 172.21.15.78:0/3315194802 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048062860 msgr2=0x7f904812af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904cd77700 1 --2- 172.21.15.78:0/3315194802 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048062860 0x7f904812af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904cd77700 1 -- 172.21.15.78:0/3315194802 >> v2:172.21.15.78:3300/0 conn(0x7f9048095190 msgr2=0x7f9048095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904cd77700 1 --2- 172.21.15.78:0/3315194802 >> v2:172.21.15.78:3300/0 conn(0x7f9048095190 0x7f9048095640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904cd77700 1 -- 172.21.15.78:0/3315194802 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904812b970 con 0x7f904812ab00 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904dd79700 1 --2- 172.21.15.78:0/3315194802 >> v2:172.21.15.78:3300/0 conn(0x7f9048095190 0x7f9048095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f904cd77700 1 --2- 172.21.15.78:0/3315194802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f904812ab00 0x7f904812b480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f9044009830 tx=0x7f90440090f0).ready entity=mon.1 client_cookie=f30ef008e729c90e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f903ffff700 1 -- 172.21.15.78:0/3315194802 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904400f510 con 0x7f904812ab00 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f903ffff700 1 -- 172.21.15.78:0/3315194802 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904400f670 con 0x7f904812ab00 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.006+0000 7f903ffff700 1 -- 172.21.15.78:0/3315194802 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904400f9f0 con 0x7f904812ab00 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.007+0000 7f904f7dc700 1 -- 172.21.15.78:0/3315194802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f904812ab00 msgr2=0x7f904812b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.007+0000 7f904f7dc700 1 --2- 172.21.15.78:0/3315194802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f904812ab00 0x7f904812b480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f9044009830 tx=0x7f90440090f0).stop 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.007+0000 7f904f7dc700 1 -- 172.21.15.78:0/3315194802 shutdown_connections 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.007+0000 7f904f7dc700 1 --2- 172.21.15.78:0/3315194802 >> v2:172.21.15.78:3300/0 conn(0x7f9048095190 0x7f9048095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.007+0000 7f904f7dc700 1 --2- 172.21.15.78:0/3315194802 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048062860 0x7f904812af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.007+0000 7f904f7dc700 1 --2- 172.21.15.78:0/3315194802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f904812ab00 0x7f904812b480 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.007+0000 7f904f7dc700 1 -- 172.21.15.78:0/3315194802 >> 172.21.15.78:0/3315194802 conn(0x7f904809a970 msgr2=0x7f904809ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.007+0000 7f904f7dc700 1 -- 172.21.15.78:0/3315194802 shutdown_connections 2024-04-25T02:12:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.007+0000 7f904f7dc700 1 -- 172.21.15.78:0/3315194802 wait complete. 2024-04-25T02:12:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904f7dc700 1 Processor -- start 2024-04-25T02:12:02.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904f7dc700 1 -- start start 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904f7dc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9048062860 0x7f9048124e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904f7dc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048095190 0x7f9048115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904f7dc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9048115770 0x7f9048115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904f7dc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904809a130 con 0x7f9048062860 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904f7dc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90481160c0 con 0x7f9048115770 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904f7dc700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9048117f30 con 0x7f9048095190 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904d578700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9048062860 0x7f9048124e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904cd77700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048095190 0x7f9048115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904d578700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9048062860 0x7f9048124e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32784/0 (socket says 172.21.15.78:32784) 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904cd77700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048095190 0x7f9048115280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42622/0 (socket says 172.21.15.78:42622) 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904d578700 1 -- 172.21.15.78:0/510442731 learned_addr learned my addr 172.21.15.78:0/510442731 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.008+0000 7f904dd79700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9048115770 0x7f9048115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904d578700 1 -- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048095190 msgr2=0x7f9048115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904d578700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048095190 0x7f9048115280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904d578700 1 -- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9048115770 msgr2=0x7f9048115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904d578700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9048115770 0x7f9048115bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904d578700 1 -- 172.21.15.78:0/510442731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040009a20 con 0x7f9048062860 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904cd77700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048095190 0x7f9048115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904dd79700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9048115770 0x7f9048115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904d578700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9048062860 0x7f9048124e90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f903800e980 tx=0x7f9038009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f903dffb700 1 -- 172.21.15.78:0/510442731 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903800ee70 con 0x7f9048062860 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f903dffb700 1 -- 172.21.15.78:0/510442731 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9038009530 con 0x7f9048062860 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9044009370 con 0x7f9048062860 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f903dffb700 1 -- 172.21.15.78:0/510442731 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903800ca60 con 0x7f9048062860 2024-04-25T02:12:02.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.009+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9048117360 con 0x7f9048062860 2024-04-25T02:12:02.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.010+0000 7f903dffb700 1 -- 172.21.15.78:0/510442731 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f903801b400 con 0x7f9048062860 2024-04-25T02:12:02.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.010+0000 7f903dffb700 1 -- 172.21.15.78:0/510442731 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f903803b7f0 con 0x7f9048062860 2024-04-25T02:12:02.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.010+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904809b490 con 0x7f9048062860 2024-04-25T02:12:02.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.015+0000 7f903dffb700 1 -- 172.21.15.78:0/510442731 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f9038011b40 con 0x7f9048062860 2024-04-25T02:12:02.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.172+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9048046ce0 con 0x7f9048062860 2024-04-25T02:12:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.172+0000 7f903dffb700 1 -- 172.21.15.78:0/510442731 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9038023350 con 0x7f9048062860 2024-04-25T02:12:02.180 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 >> v1:172.21.15.78:6816/46507 conn(0x7f902c02bd00 legacy=0x7f902c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9048062860 msgr2=0x7f9048124e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9048062860 0x7f9048124e90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f903800e980 tx=0x7f9038009060).stop 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 shutdown_connections 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9048115770 0x7f9048115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9048062860 0x7f9048124e90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 --2- 172.21.15.78:0/510442731 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9048095190 0x7f9048115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 >> 172.21.15.78:0/510442731 conn(0x7f904809a970 msgr2=0x7f9048099540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 shutdown_connections 2024-04-25T02:12:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.174+0000 7f904f7dc700 1 -- 172.21.15.78:0/510442731 wait complete. 2024-04-25T02:12:02.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb51824f700 1 Processor -- start 2024-04-25T02:12:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb51824f700 1 -- start start 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb51824f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb510069030 0x7fb5100962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb51824f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5100967d0 0x7fb510096bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb51824f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb51012d0b0 0x7fb51012f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb51824f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb510069410 con 0x7fb51012d0b0 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb51824f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb510069f80 con 0x7fb510069030 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb51824f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100688a0 con 0x7fb5100967d0 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb515feb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb510069030 0x7fb5100962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb5157ea700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5100967d0 0x7fb510096bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb5167ec700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb51012d0b0 0x7fb51012f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb5167ec700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb51012d0b0 0x7fb51012f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32790/0 (socket says 172.21.15.78:32790) 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb515feb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb510069030 0x7fb5100962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51872/0 (socket says 172.21.15.78:51872) 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb5167ec700 1 -- 172.21.15.78:0/3393728167 learned_addr learned my addr 172.21.15.78:0/3393728167 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.301+0000 7fb5157ea700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5100967d0 0x7fb510096bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42628/0 (socket says 172.21.15.78:42628) 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb5157ea700 1 -- 172.21.15.78:0/3393728167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb510069030 msgr2=0x7fb5100962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb5157ea700 1 --2- 172.21.15.78:0/3393728167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb510069030 0x7fb5100962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb5157ea700 1 -- 172.21.15.78:0/3393728167 >> v2:172.21.15.78:3300/0 conn(0x7fb51012d0b0 msgr2=0x7fb51012f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb5157ea700 1 --2- 172.21.15.78:0/3393728167 >> v2:172.21.15.78:3300/0 conn(0x7fb51012d0b0 0x7fb51012f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb5157ea700 1 -- 172.21.15.78:0/3393728167 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb510068b10 con 0x7fb5100967d0 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb5167ec700 1 --2- 172.21.15.78:0/3393728167 >> v2:172.21.15.78:3300/0 conn(0x7fb51012d0b0 0x7fb51012f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb5157ea700 1 --2- 172.21.15.78:0/3393728167 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5100967d0 0x7fb510096bb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb504009790 tx=0x7fb504009060).ready entity=mon.2 client_cookie=124fdb40284774ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb514fe9700 1 -- 172.21.15.78:0/3393728167 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400d4a0 con 0x7fb5100967d0 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb514fe9700 1 -- 172.21.15.78:0/3393728167 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400d600 con 0x7fb5100967d0 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb514fe9700 1 -- 172.21.15.78:0/3393728167 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400d980 con 0x7fb5100967d0 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb51824f700 1 -- 172.21.15.78:0/3393728167 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5100967d0 msgr2=0x7fb510096bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.302+0000 7fb51824f700 1 --2- 172.21.15.78:0/3393728167 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5100967d0 0x7fb510096bb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb504009790 tx=0x7fb504009060).stop 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.303+0000 7fb51824f700 1 -- 172.21.15.78:0/3393728167 shutdown_connections 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.303+0000 7fb51824f700 1 --2- 172.21.15.78:0/3393728167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb510069030 0x7fb5100962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.303+0000 7fb51824f700 1 --2- 172.21.15.78:0/3393728167 >> v2:172.21.15.78:3300/0 conn(0x7fb51012d0b0 0x7fb51012f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.303+0000 7fb51824f700 1 --2- 172.21.15.78:0/3393728167 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb5100967d0 0x7fb510096bb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.303+0000 7fb51824f700 1 -- 172.21.15.78:0/3393728167 >> 172.21.15.78:0/3393728167 conn(0x7fb51009c550 msgr2=0x7fb5100983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.303+0000 7fb51824f700 1 -- 172.21.15.78:0/3393728167 shutdown_connections 2024-04-25T02:12:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.303+0000 7fb51824f700 1 -- 172.21.15.78:0/3393728167 wait complete. 2024-04-25T02:12:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.303+0000 7fb51824f700 1 Processor -- start 2024-04-25T02:12:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb51824f700 1 -- start start 2024-04-25T02:12:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb51824f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5100967d0 0x7fb510064200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb51824f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb51012d0b0 0x7fb5100646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb51824f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb510064be0 0x7fb510140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb51824f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51011e620 con 0x7fb5100967d0 2024-04-25T02:12:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb51824f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51009b310 con 0x7fb51012d0b0 2024-04-25T02:12:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb51824f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100678e0 con 0x7fb510064be0 2024-04-25T02:12:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb515feb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5100967d0 0x7fb510064200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb515feb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5100967d0 0x7fb510064200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32804/0 (socket says 172.21.15.78:32804) 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb515feb700 1 -- 172.21.15.78:0/2198061092 learned_addr learned my addr 172.21.15.78:0/2198061092 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb5157ea700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb51012d0b0 0x7fb5100646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb5167ec700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb510064be0 0x7fb510140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb5157ea700 1 -- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb510064be0 msgr2=0x7fb510140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb5157ea700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb510064be0 0x7fb510140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb5157ea700 1 -- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5100967d0 msgr2=0x7fb510064200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb5157ea700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5100967d0 0x7fb510064200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb5157ea700 1 -- 172.21.15.78:0/2198061092 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb508009ae0 con 0x7fb51012d0b0 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb515feb700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5100967d0 0x7fb510064200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.304+0000 7fb5157ea700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb51012d0b0 0x7fb5100646f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fb504013000 tx=0x7fb504016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.305+0000 7fb5027fc700 1 -- 172.21.15.78:0/2198061092 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400dcf0 con 0x7fb51012d0b0 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.305+0000 7fb5027fc700 1 -- 172.21.15.78:0/2198061092 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400de50 con 0x7fb51012d0b0 2024-04-25T02:12:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.305+0000 7fb5027fc700 1 -- 172.21.15.78:0/2198061092 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50401d430 con 0x7fb51012d0b0 2024-04-25T02:12:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.305+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5040092a0 con 0x7fb51012d0b0 2024-04-25T02:12:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.305+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51011d0e0 con 0x7fb51012d0b0 2024-04-25T02:12:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.306+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb510098af0 con 0x7fb51012d0b0 2024-04-25T02:12:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.306+0000 7fb5027fc700 1 -- 172.21.15.78:0/2198061092 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fb50401c390 con 0x7fb51012d0b0 2024-04-25T02:12:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.306+0000 7fb5027fc700 1 -- 172.21.15.78:0/2198061092 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fb50403bca0 con 0x7fb51012d0b0 2024-04-25T02:12:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.311+0000 7fb5027fc700 1 -- 172.21.15.78:0/2198061092 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fb504040070 con 0x7fb51012d0b0 2024-04-25T02:12:02.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.511+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb510046ce0 con 0x7fb51012d0b0 2024-04-25T02:12:02.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.511+0000 7fb5027fc700 1 -- 172.21.15.78:0/2198061092 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fb504022030 con 0x7fb51012d0b0 2024-04-25T02:12:02.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:12:02.519 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:02.698771+0000","modified":"2024-04-25T02:10:04.706190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:12:02.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 >> v1:172.21.15.78:6816/46507 conn(0x7fb4f402bd30 legacy=0x7fb4f402e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb51012d0b0 msgr2=0x7fb5100646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb51012d0b0 0x7fb5100646f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fb504013000 tx=0x7fb504016000).stop 2024-04-25T02:12:02.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 shutdown_connections 2024-04-25T02:12:02.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb510064be0 0x7fb510140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5100967d0 0x7fb510064200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 --2- 172.21.15.78:0/2198061092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb51012d0b0 0x7fb5100646f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 >> 172.21.15.78:0/2198061092 conn(0x7fb510069030 msgr2=0x7fb510094b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 shutdown_connections 2024-04-25T02:12:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.513+0000 7fb51824f700 1 -- 172.21.15.78:0/2198061092 wait complete. 2024-04-25T02:12:02.522 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-25T02:12:02.532 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:12:02.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.638+0000 7fcb9c536700 1 Processor -- start 2024-04-25T02:12:02.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.638+0000 7fcb9c536700 1 -- start start 2024-04-25T02:12:02.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9c536700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94069030 0x7fcb940962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9c536700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb940967d0 0x7fcb94096bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9c536700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb9412d0b0 0x7fcb9412f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9c536700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb94069410 con 0x7fcb940967d0 2024-04-25T02:12:02.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9c536700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94069f80 con 0x7fcb9412d0b0 2024-04-25T02:12:02.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9c536700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940688a0 con 0x7fcb94069030 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9a2d2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94069030 0x7fcb940962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb99ad1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb940967d0 0x7fcb94096bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9aad3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb9412d0b0 0x7fcb9412f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9aad3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb9412d0b0 0x7fcb9412f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51896/0 (socket says 172.21.15.78:51896) 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb99ad1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb940967d0 0x7fcb94096bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32814/0 (socket says 172.21.15.78:32814) 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9a2d2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94069030 0x7fcb940962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42642/0 (socket says 172.21.15.78:42642) 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.639+0000 7fcb9aad3700 1 -- 172.21.15.78:0/3086089156 learned_addr learned my addr 172.21.15.78:0/3086089156 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb99ad1700 1 -- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94069030 msgr2=0x7fcb940962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb99ad1700 1 --2- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94069030 0x7fcb940962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb99ad1700 1 -- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb9412d0b0 msgr2=0x7fcb9412f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb99ad1700 1 --2- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb9412d0b0 0x7fcb9412f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb99ad1700 1 -- 172.21.15.78:0/3086089156 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb94068b10 con 0x7fcb940967d0 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb9aad3700 1 --2- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb9412d0b0 0x7fcb9412f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb99ad1700 1 --2- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb940967d0 0x7fcb94096bb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fcb90009790 tx=0x7fcb90009060).ready entity=mon.0 client_cookie=cf584ed71fe23452 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb992d0700 1 -- 172.21.15.78:0/3086089156 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000d4a0 con 0x7fcb940967d0 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb992d0700 1 -- 172.21.15.78:0/3086089156 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9000d600 con 0x7fcb940967d0 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb992d0700 1 -- 172.21.15.78:0/3086089156 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000d980 con 0x7fcb940967d0 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb9c536700 1 -- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb940967d0 msgr2=0x7fcb94096bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb9c536700 1 --2- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb940967d0 0x7fcb94096bb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fcb90009790 tx=0x7fcb90009060).stop 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb9c536700 1 -- 172.21.15.78:0/3086089156 shutdown_connections 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.640+0000 7fcb9c536700 1 --2- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb9412d0b0 0x7fcb9412f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.641+0000 7fcb9c536700 1 --2- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94069030 0x7fcb940962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.641+0000 7fcb9c536700 1 --2- 172.21.15.78:0/3086089156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb940967d0 0x7fcb94096bb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.641+0000 7fcb9c536700 1 -- 172.21.15.78:0/3086089156 >> 172.21.15.78:0/3086089156 conn(0x7fcb9409c550 msgr2=0x7fcb940983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.641+0000 7fcb9c536700 1 -- 172.21.15.78:0/3086089156 shutdown_connections 2024-04-25T02:12:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.641+0000 7fcb9c536700 1 -- 172.21.15.78:0/3086089156 wait complete. 2024-04-25T02:12:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9c536700 1 Processor -- start 2024-04-25T02:12:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9c536700 1 -- start start 2024-04-25T02:12:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9c536700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb940967d0 0x7fcb940641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9c536700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb9412d0b0 0x7fcb940646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9c536700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94064bb0 0x7fcb94140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9c536700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940678e0 con 0x7fcb9412d0b0 2024-04-25T02:12:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9c536700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9411d390 con 0x7fcb940967d0 2024-04-25T02:12:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9c536700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9409b300 con 0x7fcb94064bb0 2024-04-25T02:12:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9a2d2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb940967d0 0x7fcb940641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9a2d2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb940967d0 0x7fcb940641d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51898/0 (socket says 172.21.15.78:51898) 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.642+0000 7fcb9a2d2700 1 -- 172.21.15.78:0/3698182803 learned_addr learned my addr 172.21.15.78:0/3698182803 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb9aad3700 1 --2- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94064bb0 0x7fcb94140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb99ad1700 1 --2- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb9412d0b0 0x7fcb940646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb9a2d2700 1 -- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94064bb0 msgr2=0x7fcb94140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb9a2d2700 1 --2- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94064bb0 0x7fcb94140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb9a2d2700 1 -- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb9412d0b0 msgr2=0x7fcb940646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb9a2d2700 1 --2- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb9412d0b0 0x7fcb940646c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb9a2d2700 1 -- 172.21.15.78:0/3698182803 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c009ae0 con 0x7fcb940967d0 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb9a2d2700 1 --2- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb940967d0 0x7fcb940641d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fcb8400e960 tx=0x7fcb84009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb8affd700 1 -- 172.21.15.78:0/3698182803 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84009510 con 0x7fcb940967d0 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb8affd700 1 -- 172.21.15.78:0/3698182803 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb84012600 con 0x7fcb940967d0 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb8affd700 1 -- 172.21.15.78:0/3698182803 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84012980 con 0x7fcb940967d0 2024-04-25T02:12:02.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb900092a0 con 0x7fcb940967d0 2024-04-25T02:12:02.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.643+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb94065d80 con 0x7fcb940967d0 2024-04-25T02:12:02.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.644+0000 7fcb8affd700 1 -- 172.21.15.78:0/3698182803 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fcb84012cf0 con 0x7fcb940967d0 2024-04-25T02:12:02.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.644+0000 7fcb8affd700 1 -- 172.21.15.78:0/3698182803 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fcb8403b610 con 0x7fcb940967d0 2024-04-25T02:12:02.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.644+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9411d520 con 0x7fcb940967d0 2024-04-25T02:12:02.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.648+0000 7fcb8affd700 1 -- 172.21.15.78:0/3698182803 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fcb9411d520 con 0x7fcb940967d0 2024-04-25T02:12:02.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.813+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb9411d520 con 0x7fcb940967d0 2024-04-25T02:12:02.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.813+0000 7fcb8affd700 1 -- 172.21.15.78:0/3698182803 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11609 (secure 0 0 0) 0x7fcb9411d520 con 0x7fcb940967d0 2024-04-25T02:12:02.821 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:12:02.821 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:53.832053+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 >> v1:172.21.15.78:6816/46507 conn(0x7fcb7802bd00 legacy=0x7fcb7802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb940967d0 msgr2=0x7fcb940641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 --2- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb940967d0 0x7fcb940641d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fcb8400e960 tx=0x7fcb84009060).stop 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 shutdown_connections 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 --2- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb94064bb0 0x7fcb94140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 --2- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb940967d0 0x7fcb940641d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 --2- 172.21.15.78:0/3698182803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb9412d0b0 0x7fcb940646c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 >> 172.21.15.78:0/3698182803 conn(0x7fcb94069030 msgr2=0x7fcb94111f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 shutdown_connections 2024-04-25T02:12:02.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.815+0000 7fcb9c536700 1 -- 172.21.15.78:0/3698182803 wait complete. 2024-04-25T02:12:02.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.941+0000 7f51f9c3d700 1 Processor -- start 2024-04-25T02:12:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.941+0000 7f51f9c3d700 1 -- start start 2024-04-25T02:12:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f9c3d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51f4062860 0x7f51f4128930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f9c3d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4128e20 0x7f51f4093c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f9c3d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4094110 0x7f51f40945c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f9c3d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f4062c40 con 0x7f51f4062860 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f9c3d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40965c0 con 0x7f51f4094110 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f9c3d700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4094ab0 con 0x7f51f4128e20 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51f4062860 0x7f51f4128930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f2ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4128e20 0x7f51f4093c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4094110 0x7f51f40945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51f4062860 0x7f51f4128930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32842/0 (socket says 172.21.15.78:32842) 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4094110 0x7f51f40945c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51914/0 (socket says 172.21.15.78:51914) 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f2ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4128e20 0x7f51f4093c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42652/0 (socket says 172.21.15.78:42652) 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f37fe700 1 -- 172.21.15.78:0/2985022680 learned_addr learned my addr 172.21.15.78:0/2985022680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f37fe700 1 -- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4128e20 msgr2=0x7f51f4093c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f37fe700 1 --2- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4128e20 0x7f51f4093c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f37fe700 1 -- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4094110 msgr2=0x7f51f40945c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f37fe700 1 --2- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4094110 0x7f51f40945c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f37fe700 1 -- 172.21.15.78:0/2985022680 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4063310 con 0x7f51f4062860 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f3fff700 1 --2- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4094110 0x7f51f40945c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f37fe700 1 --2- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4062860 0x7f51f4128930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f51e8006fd0 tx=0x7f51e80090f0).ready entity=mon.0 client_cookie=748f7338996ef7a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f27fc700 1 -- 172.21.15.78:0/2985022680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800f510 con 0x7f51f4062860 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f27fc700 1 -- 172.21.15.78:0/2985022680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e800f670 con 0x7f51f4062860 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.942+0000 7f51f27fc700 1 -- 172.21.15.78:0/2985022680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800f9f0 con 0x7f51f4062860 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.943+0000 7f51f9c3d700 1 -- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4062860 msgr2=0x7f51f4128930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.943+0000 7f51f9c3d700 1 --2- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4062860 0x7f51f4128930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f51e8006fd0 tx=0x7f51e80090f0).stop 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.943+0000 7f51f9c3d700 1 -- 172.21.15.78:0/2985022680 shutdown_connections 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.943+0000 7f51f9c3d700 1 --2- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4094110 0x7f51f40945c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.943+0000 7f51f9c3d700 1 --2- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4062860 0x7f51f4128930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.943+0000 7f51f9c3d700 1 --2- 172.21.15.78:0/2985022680 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4128e20 0x7f51f4093c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.943+0000 7f51f9c3d700 1 -- 172.21.15.78:0/2985022680 >> 172.21.15.78:0/2985022680 conn(0x7f51f4097450 msgr2=0x7f51f4097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.943+0000 7f51f9c3d700 1 -- 172.21.15.78:0/2985022680 shutdown_connections 2024-04-25T02:12:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.943+0000 7f51f9c3d700 1 -- 172.21.15.78:0/2985022680 wait complete. 2024-04-25T02:12:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.944+0000 7f51f9c3d700 1 Processor -- start 2024-04-25T02:12:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.944+0000 7f51f9c3d700 1 -- start start 2024-04-25T02:12:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.944+0000 7f51f9c3d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4062860 0x7f51f41137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.944+0000 7f51f9c3d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4094110 0x7f51f4110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.944+0000 7f51f9c3d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4128e20 0x7f51f41112e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.944+0000 7f51f9c3d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4113cc0 con 0x7f51f4128e20 2024-04-25T02:12:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.944+0000 7f51f9c3d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4111ee0 con 0x7f51f4062860 2024-04-25T02:12:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.944+0000 7f51f9c3d700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4112d30 con 0x7f51f4094110 2024-04-25T02:12:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f2ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4094110 0x7f51f4110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4128e20 0x7f51f41112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f37fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4062860 0x7f51f41137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4128e20 0x7f51f41112e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32856/0 (socket says 172.21.15.78:32856) 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f2ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4094110 0x7f51f4110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:42664/0 (socket says 172.21.15.78:42664) 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f3fff700 1 -- 172.21.15.78:0/1318695840 learned_addr learned my addr 172.21.15.78:0/1318695840 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f2ffd700 1 -- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4062860 msgr2=0x7f51f41137d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f2ffd700 1 --2- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4062860 0x7f51f41137d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f2ffd700 1 -- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4128e20 msgr2=0x7f51f41112e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f2ffd700 1 --2- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4128e20 0x7f51f41112e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f2ffd700 1 -- 172.21.15.78:0/1318695840 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec009a20 con 0x7f51f4094110 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.945+0000 7f51f2ffd700 1 --2- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4094110 0x7f51f4110df0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f51e400e900 tx=0x7f51e4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.946+0000 7f51dbfff700 1 -- 172.21.15.78:0/1318695840 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4009470 con 0x7f51f4094110 2024-04-25T02:12:02.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.946+0000 7f51dbfff700 1 -- 172.21.15.78:0/1318695840 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e4012600 con 0x7f51f4094110 2024-04-25T02:12:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.946+0000 7f51dbfff700 1 -- 172.21.15.78:0/1318695840 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4012980 con 0x7f51f4094110 2024-04-25T02:12:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.946+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e8009370 con 0x7f51f4094110 2024-04-25T02:12:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.947+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f4069070 con 0x7f51f4094110 2024-04-25T02:12:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.948+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f41131b0 con 0x7f51f4094110 2024-04-25T02:12:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.948+0000 7f51dbfff700 1 -- 172.21.15.78:0/1318695840 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f51e4012cf0 con 0x7f51f4094110 2024-04-25T02:12:02.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.948+0000 7f51dbfff700 1 -- 172.21.15.78:0/1318695840 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f51e403b680 con 0x7f51f4094110 2024-04-25T02:12:02.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:02.952+0000 7f51dbfff700 1 -- 172.21.15.78:0/1318695840 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f51e4019310 con 0x7f51f4094110 2024-04-25T02:12:03.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.149+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51f4097f70 con 0x7f51f4094110 2024-04-25T02:12:03.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.150+0000 7f51dbfff700 1 -- 172.21.15.78:0/1318695840 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7f51e4011b00 con 0x7f51f4094110 2024-04-25T02:12:03.157 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:12:03.157 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:02.698771+0000","modified":"2024-04-25T02:10:04.706190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:12:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 >> v1:172.21.15.78:6816/46507 conn(0x7f51e002bd00 legacy=0x7f51e002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4094110 msgr2=0x7f51f4110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 --2- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4094110 0x7f51f4110df0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f51e400e900 tx=0x7f51e4009060).stop 2024-04-25T02:12:03.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 shutdown_connections 2024-04-25T02:12:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 --2- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51f4128e20 0x7f51f41112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 --2- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51f4062860 0x7f51f41137d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 --2- 172.21.15.78:0/1318695840 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f51f4094110 0x7f51f4110df0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 >> 172.21.15.78:0/1318695840 conn(0x7f51f4097450 msgr2=0x7f51f4093600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 shutdown_connections 2024-04-25T02:12:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.151+0000 7f51f9c3d700 1 -- 172.21.15.78:0/1318695840 wait complete. 2024-04-25T02:12:03.160 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-25T02:12:03.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:10:02.698771+0000', 'modified': '2024-04-25T02:10:04.706190+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4187}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4187': {'gid': 4187, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6817/281509915', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.78:6817', 'nonce': 281509915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:12:03.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:12:03.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:12:03.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.379+0000 7f9911fa5700 1 Processor -- start 2024-04-25T02:12:03.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f9911fa5700 1 -- start start 2024-04-25T02:12:03.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f9911fa5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f990c064ad0 0x7f990c12abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f9911fa5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c12a750 0x7f990c12b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f9911fa5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c065750 con 0x7f990c098530 2024-04-25T02:12:03.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f9911fa5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c064eb0 con 0x7f990c064ad0 2024-04-25T02:12:03.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f9911fa5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c099930 con 0x7f990c12a750 2024-04-25T02:12:03.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c12a750 0x7f990c12b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f990c064ad0 0x7f990c12abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f990c098530 0x7f990c0989e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54302/0 (socket says 172.21.15.78:54302) 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f990c064ad0 0x7f990c12abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53222/0 (socket says 172.21.15.78:53222) 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c12a750 0x7f990c12b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:49924/0 (socket says 172.21.15.78:49924) 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990bfff700 1 -- 172.21.15.78:0/190762874 learned_addr learned my addr 172.21.15.78:0/190762874 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990affd700 1 -- 172.21.15.78:0/190762874 >> v2:172.21.15.78:3300/0 conn(0x7f990c064ad0 msgr2=0x7f990c12abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990affd700 1 --2- 172.21.15.78:0/190762874 >> v2:172.21.15.78:3300/0 conn(0x7f990c064ad0 0x7f990c12abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990affd700 1 -- 172.21.15.78:0/190762874 >> v1:172.21.15.78:6789/0 conn(0x7f990c098530 legacy=0x7f990c0989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990a7fc700 1 -- 172.21.15.78:0/190762874 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789194962 0 0) 0x7f990c065750 con 0x7f990c098530 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990affd700 1 -- 172.21.15.78:0/190762874 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c065b40 con 0x7f990c12a750 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.380+0000 7f990b7fe700 1 --2- 172.21.15.78:0/190762874 >> v2:172.21.15.78:3300/0 conn(0x7f990c064ad0 0x7f990c12abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f990affd700 1 --2- 172.21.15.78:0/190762874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c12a750 0x7f990c12b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f98fc009760 tx=0x7f98fc009060).ready entity=mon.1 client_cookie=4a12d4418c103203 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f990a7fc700 1 -- 172.21.15.78:0/190762874 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0090d0 con 0x7f990c12a750 2024-04-25T02:12:03.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f990a7fc700 1 -- 172.21.15.78:0/190762874 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc00f510 con 0x7f990c12a750 2024-04-25T02:12:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f990a7fc700 1 -- 172.21.15.78:0/190762874 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00f890 con 0x7f990c12a750 2024-04-25T02:12:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f9911fa5700 1 -- 172.21.15.78:0/190762874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c12a750 msgr2=0x7f990c12b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f9911fa5700 1 --2- 172.21.15.78:0/190762874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c12a750 0x7f990c12b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f98fc009760 tx=0x7f98fc009060).stop 2024-04-25T02:12:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f9911fa5700 1 -- 172.21.15.78:0/190762874 shutdown_connections 2024-04-25T02:12:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f9911fa5700 1 --2- 172.21.15.78:0/190762874 >> v2:172.21.15.78:3300/0 conn(0x7f990c064ad0 0x7f990c12abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f9911fa5700 1 --2- 172.21.15.78:0/190762874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c12a750 0x7f990c12b0d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f9911fa5700 1 -- 172.21.15.78:0/190762874 >> 172.21.15.78:0/190762874 conn(0x7f990c09a630 msgr2=0x7f990c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f9911fa5700 1 -- 172.21.15.78:0/190762874 shutdown_connections 2024-04-25T02:12:03.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.381+0000 7f9911fa5700 1 -- 172.21.15.78:0/190762874 wait complete. 2024-04-25T02:12:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.382+0000 7f9911fa5700 1 Processor -- start 2024-04-25T02:12:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.382+0000 7f9911fa5700 1 -- start start 2024-04-25T02:12:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9911fa5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c064ad0 0x7f990c127a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9911fa5700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f990c098530 0x7f990c116970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9911fa5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c127f30 0x7f990c116e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9911fa5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c117e20 con 0x7f990c127f30 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9911fa5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c099ab0 con 0x7f990c064ad0 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9911fa5700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f990c119e70 con 0x7f990c098530 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c064ad0 0x7f990c127a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c127f30 0x7f990c116e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c064ad0 0x7f990c127a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:49940/0 (socket says 172.21.15.78:49940) 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990b7fe700 1 -- 172.21.15.78:0/629526281 learned_addr learned my addr 172.21.15.78:0/629526281 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990affd700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f990c098530 0x7f990c116970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990bfff700 1 -- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f990c098530 msgr2=0x7f990c116970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990bfff700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f990c098530 0x7f990c116970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990bfff700 1 -- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c064ad0 msgr2=0x7f990c127a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990bfff700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c064ad0 0x7f990c127a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990bfff700 1 -- 172.21.15.78:0/629526281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f40092a0 con 0x7f990c127f30 2024-04-25T02:12:03.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990b7fe700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c064ad0 0x7f990c127a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990affd700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f990c098530 0x7f990c116970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f990bfff700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c127f30 0x7f990c116e60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f990400c7e0 tx=0x7f9904007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9903fff700 1 -- 172.21.15.78:0/629526281 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904005d30 con 0x7f990c127f30 2024-04-25T02:12:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9903fff700 1 -- 172.21.15.78:0/629526281 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904007110 con 0x7f990c127f30 2024-04-25T02:12:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9911fa5700 1 -- 172.21.15.78:0/629526281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc0092a0 con 0x7f990c127f30 2024-04-25T02:12:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.383+0000 7f9903fff700 1 -- 172.21.15.78:0/629526281 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040074d0 con 0x7f990c127f30 2024-04-25T02:12:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.384+0000 7f9911fa5700 1 -- 172.21.15.78:0/629526281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c11aaf0 con 0x7f990c127f30 2024-04-25T02:12:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.385+0000 7f9903fff700 1 -- 172.21.15.78:0/629526281 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9904007880 con 0x7f990c127f30 2024-04-25T02:12:03.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.385+0000 7f9903fff700 1 -- 172.21.15.78:0/629526281 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f990403b270 con 0x7f990c127f30 2024-04-25T02:12:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.387+0000 7f992395ab80 1 Processor -- start 2024-04-25T02:12:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.387+0000 7f992395ab80 1 -- start start 2024-04-25T02:12:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.387+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56841580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.387+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5686b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 0x55fd5686d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd5680b740 con 0x55fd568411a0 2024-04-25T02:12:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd56782150 con 0x55fd56841a70 2024-04-25T02:12:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x55fd56797640 con 0x55fd5686b5b0 2024-04-25T02:12:03.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5686b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56841580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 0x55fd5686d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5686b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:49952/0 (socket says 172.21.15.78:49952) 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990affd700 1 -- 172.21.15.78:0/3102185469 learned_addr learned my addr 172.21.15.78:0/3102185469 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990affd700 1 -- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 msgr2=0x55fd5686d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990affd700 1 --2- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 0x55fd5686d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990affd700 1 -- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 msgr2=0x55fd56841580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990affd700 1 --2- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56841580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990affd700 1 -- 172.21.15.78:0/3102185469 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd56632710 con 0x55fd56841a70 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990b7fe700 1 --2- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56841580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f990affd700 1 --2- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5686b0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f990c099db0 tx=0x7f98fc017000).ready entity=mon.1 client_cookie=f349d3d99ac3550f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f99017fa700 1 -- 172.21.15.78:0/3102185469 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00f680 con 0x55fd56841a70 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f99017fa700 1 -- 172.21.15.78:0/3102185469 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc00f7e0 con 0x55fd56841a70 2024-04-25T02:12:03.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.388+0000 7f99017fa700 1 -- 172.21.15.78:0/3102185469 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00fe60 con 0x55fd56841a70 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 -- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 msgr2=0x55fd5686b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 --2- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5686b0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f990c099db0 tx=0x7f98fc017000).stop 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 -- 172.21.15.78:0/3102185469 shutdown_connections 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 --2- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 0x55fd5686d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 --2- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56841580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 --2- 172.21.15.78:0/3102185469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5686b0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 -- 172.21.15.78:0/3102185469 >> 172.21.15.78:0/3102185469 conn(0x55fd566af940 msgr2=0x55fd56861cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 -- 172.21.15.78:0/3102185469 shutdown_connections 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 -- 172.21.15.78:0/3102185469 wait complete. 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 -- start start 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.389+0000 7f992395ab80 1 Processor -- start 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56867610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56867b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 0x55fd56867ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd56797780 con 0x55fd5686b5b0 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd56797a00 con 0x55fd568411a0 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x55fd56762d40 con 0x55fd56841a70 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f992395ab80 10 client.0 ll_register_callbacks cb 0x55fd56805b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56867610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990affd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56867b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56867610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:49956/0 (socket says 172.21.15.78:49956) 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990affd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56867b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:48324/0 (socket says 172.21.15.78:48324) 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990b7fe700 1 -- 172.21.15.78:0/550705091 learned_addr learned my addr 172.21.15.78:0/550705091 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990affd700 1 -- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 msgr2=0x55fd56867610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990affd700 1 --2- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56867610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990affd700 1 -- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 msgr2=0x55fd56867ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990affd700 1 --2- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 0x55fd56867ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990affd700 1 -- 172.21.15.78:0/550705091 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f40114b0 con 0x55fd56841a70 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f990affd700 1 --2- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56867b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f98fc023000 tx=0x7f98fc01f040).ready entity=mon.2 client_cookie=809899d8c2d89188 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f98ea7fc700 10 client.0 ms_handle_connect on v2:172.21.15.78:3302/0 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f98ea7fc700 1 -- 172.21.15.78:0/550705091 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc011be0 con 0x55fd56841a70 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f98ea7fc700 1 -- 172.21.15.78:0/550705091 <== mon.2 v2:172.21.15.78:3302/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f98fc011d40 con 0x55fd56841a70 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.390+0000 7f992395ab80 1 -- 172.21.15.78:0/550705091 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd56839e00 con 0x55fd56841a70 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f98ea7fc700 1 -- 172.21.15.78:0/550705091 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98fc026640 con 0x55fd56841a70 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f992395ab80 10 client.4769 fetch_fsmap learned FSMap version 5 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f992395ab80 1 -- 172.21.15.78:0/550705091 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x7f990c065b40 con 0x55fd56841a70 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f98ea7fc700 1 -- 172.21.15.78:0/550705091 <== mon.2 v2:172.21.15.78:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fd56839e00 con 0x55fd56841a70 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f98ea7fc700 1 -- 172.21.15.78:0/550705091 <== mon.2 v2:172.21.15.78:3302/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f98fc018030 con 0x55fd56841a70 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f992395ab80 10 client.4769 fetch_fsmap finished waiting for FSMap version 5 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f992395ab80 10 client.4769 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f992395ab80 20 client.4769 populate_metadata read hostname 'smithi078' 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f992395ab80 4 client.4769 mds_command: new command op to 4187 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f992395ab80 1 -- 172.21.15.78:0/550705091 --> v1:172.21.15.78:6817/281509915 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd5680f380 con 0x55fd56871620 2024-04-25T02:12:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.391+0000 7f98ea7fc700 10 client.4769 ms_handle_connect on v1:172.21.15.78:6817/281509915 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f98ea7fc700 1 -- 172.21.15.78:0/550705091 <== mds.0 v1:172.21.15.78:6817/281509915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55fd5680f380 con 0x55fd56871620 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f98ea7fc700 10 client.4769 handle_command_reply: tid=0 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 client.4769 shutdown 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 -- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 msgr2=0x55fd56867b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 --2- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56867b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f98fc023000 tx=0x7f98fc01f040).stop 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 -- 172.21.15.78:0/550705091 shutdown_connections 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 --2- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 0x55fd56867ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 --2- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56867610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f98ea7fc700 0 client.4769 ms_handle_reset on v1:172.21.15.78:6817/281509915 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 --2- 172.21.15.78:0/550705091 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56867b00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 -- 172.21.15.78:0/550705091 >> 172.21.15.78:0/550705091 conn(0x55fd566af940 msgr2=0x55fd5685cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 -- 172.21.15.78:0/550705091 shutdown_connections 2024-04-25T02:12:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 1 -- 172.21.15.78:0/550705091 wait complete. 2024-04-25T02:12:03.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.392+0000 7f992395ab80 20 client.4769 trim_cache size 0 max 16384 2024-04-25T02:12:03.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.408+0000 7f992395ab80 1 Processor -- start 2024-04-25T02:12:03.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.408+0000 7f992395ab80 1 -- start start 2024-04-25T02:12:03.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56866e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5685f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 0x55fd5687d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd56868db0 con 0x55fd568411a0 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd5680b5a0 con 0x55fd56841a70 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x55fd5687d6b0 con 0x55fd5686b5b0 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56866e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56866e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53262/0 (socket says 172.21.15.78:53262) 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990bfff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 0x55fd5687d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990b7fe700 1 -- 172.21.15.78:0/2021798914 learned_addr learned my addr 172.21.15.78:0/2021798914 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990affd700 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5685f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990b7fe700 1 -- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 msgr2=0x55fd5687d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990b7fe700 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 0x55fd5687d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990b7fe700 1 -- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 msgr2=0x55fd5685f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990b7fe700 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5685f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990b7fe700 1 -- 172.21.15.78:0/2021798914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd56790580 con 0x55fd568411a0 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990affd700 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5685f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990bfff700 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 0x55fd5687d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f990b7fe700 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56866e00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f98f4009520 tx=0x7f98f4008040).ready entity=mon.0 client_cookie=b65f245fe7206c02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f9901ffb700 1 -- 172.21.15.78:0/2021798914 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f401b070 con 0x55fd568411a0 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f9901ffb700 1 -- 172.21.15.78:0/2021798914 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f4011ed0 con 0x55fd568411a0 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.409+0000 7f9901ffb700 1 -- 172.21.15.78:0/2021798914 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4016e40 con 0x55fd568411a0 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 -- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 msgr2=0x55fd56866e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56866e00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f98f4009520 tx=0x7f98f4008040).stop 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 -- 172.21.15.78:0/2021798914 shutdown_connections 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd5686b5b0 0x55fd5687d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd568411a0 0x55fd56866e00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 --2- 172.21.15.78:0/2021798914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd56841a70 0x55fd5685f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 -- 172.21.15.78:0/2021798914 >> 172.21.15.78:0/2021798914 conn(0x55fd566af940 msgr2=0x55fd5683fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 -- 172.21.15.78:0/2021798914 shutdown_connections 2024-04-25T02:12:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 -- 172.21.15.78:0/2021798914 wait complete. 2024-04-25T02:12:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 -- start start 2024-04-25T02:12:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.410+0000 7f992395ab80 1 Processor -- start 2024-04-25T02:12:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56874050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56874540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f992395ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 0x55fd568c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd5686ad10 con 0x55fd5686b5b0 2024-04-25T02:12:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd568756c0 con 0x55fd568411a0 2024-04-25T02:12:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f992395ab80 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x55fd568770d0 con 0x55fd56841a70 2024-04-25T02:12:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f992395ab80 10 client.0 ll_register_callbacks cb 0x55fd56805b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56874050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56874050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:49974/0 (socket says 172.21.15.78:49974) 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f990b7fe700 1 -- 172.21.15.78:0/612748478 learned_addr learned my addr 172.21.15.78:0/612748478 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f990bfff700 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 0x55fd568c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f990affd700 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56874540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f990bfff700 1 -- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 msgr2=0x55fd56874540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f990bfff700 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56874540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f990bfff700 1 -- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 msgr2=0x55fd56874050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.411+0000 7f990bfff700 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56874050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f990bfff700 1 -- 172.21.15.78:0/612748478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c065b40 con 0x55fd5686b5b0 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f990b7fe700 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56874050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f990bfff700 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 0x55fd568c58c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f99040398d0 tx=0x7f9904016000).ready entity=mon.0 client_cookie=4df711ee77999103 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f98ea7fc700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f98ea7fc700 1 -- 172.21.15.78:0/612748478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904011d30 con 0x55fd5686b5b0 2024-04-25T02:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f98ea7fc700 1 -- 172.21.15.78:0/612748478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f99040116e0 con 0x55fd5686b5b0 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f992395ab80 1 -- 172.21.15.78:0/612748478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98fc00f7e0 con 0x55fd5686b5b0 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f98ea7fc700 1 -- 172.21.15.78:0/612748478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f990402c0d0 con 0x55fd5686b5b0 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f992395ab80 10 client.5016 fetch_fsmap learned FSMap version 5 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f992395ab80 1 -- 172.21.15.78:0/612748478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x7f990c11aaf0 con 0x55fd5686b5b0 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f98ea7fc700 1 -- 172.21.15.78:0/612748478 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc00f7e0 con 0x55fd5686b5b0 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f98ea7fc700 1 -- 172.21.15.78:0/612748478 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f990402c230 con 0x55fd5686b5b0 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f992395ab80 10 client.5016 fetch_fsmap finished waiting for FSMap version 5 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f992395ab80 10 client.5016 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f992395ab80 20 client.5016 populate_metadata read hostname 'smithi078' 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f992395ab80 4 client.5016 mds_command: new command op to 4187 tid=0[{"prefix": "status"}] 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f992395ab80 1 -- 172.21.15.78:0/612748478 --> v1:172.21.15.78:6817/281509915 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fd565ffef0 con 0x55fd568ccc60 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.412+0000 7f98ea7fc700 10 client.5016 ms_handle_connect on v1:172.21.15.78:6817/281509915 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f98ea7fc700 1 -- 172.21.15.78:0/612748478 <== mds.0 v1:172.21.15.78:6817/281509915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (unknown 0 0 620726900) 0x55fd565ffef0 con 0x55fd568ccc60 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f98ea7fc700 10 client.5016 handle_command_reply: tid=0 2024-04-25T02:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 client.5016 shutdown 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 -- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 msgr2=0x55fd568c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 0x55fd568c58c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f99040398d0 tx=0x7f9904016000).stop 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 -- 172.21.15.78:0/612748478 shutdown_connections 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd5686b5b0 0x55fd568c58c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55fd568411a0 0x55fd56874050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f98ea7fc700 0 client.5016 ms_handle_reset on v1:172.21.15.78:6817/281509915 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 --2- 172.21.15.78:0/612748478 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x55fd56841a70 0x55fd56874540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 -- 172.21.15.78:0/612748478 >> 172.21.15.78:0/612748478 conn(0x55fd566af940 msgr2=0x55fd56867580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 -- 172.21.15.78:0/612748478 shutdown_connections 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 1 -- 172.21.15.78:0/612748478 wait complete. 2024-04-25T02:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f992395ab80 20 client.5016 trim_cache size 0 max 16384 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "c7765ec7-39fd-490f-9c17-2b734a0c4de0", 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4187, 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 120.710582864, 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 5, 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 19, 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 16, 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 125.09888809100001 2024-04-25T02:12:03.427 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-25T02:12:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f9911fa5700 1 -- 172.21.15.78:0/629526281 >> v1:172.21.15.78:6816/46507 conn(0x7f98ec02bd30 legacy=0x7f98ec02e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f9911fa5700 1 -- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c127f30 msgr2=0x7f990c116e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f9911fa5700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c127f30 0x7f990c116e60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f990400c7e0 tx=0x7f9904007eb0).stop 2024-04-25T02:12:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f9911fa5700 1 -- 172.21.15.78:0/629526281 shutdown_connections 2024-04-25T02:12:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f9911fa5700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c127f30 0x7f990c116e60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f9911fa5700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f990c064ad0 0x7f990c127a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f9911fa5700 1 --2- 172.21.15.78:0/629526281 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f990c098530 0x7f990c116970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.413+0000 7f9911fa5700 1 -- 172.21.15.78:0/629526281 >> 172.21.15.78:0/629526281 conn(0x7f990c09a630 msgr2=0x7f990c128560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.414+0000 7f9911fa5700 1 -- 172.21.15.78:0/629526281 shutdown_connections 2024-04-25T02:12:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.414+0000 7f9911fa5700 1 -- 172.21.15.78:0/629526281 wait complete. 2024-04-25T02:12:03.432 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T02:12:03.442 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T02:12:03.442 INFO:tasks.ceph_fuse:config is {'client.0': None} 2024-04-25T02:12:03.442 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T02:12:03.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:03.443 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T02:12:03.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:03.467 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T02:12:03.545 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T02:12:03.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:12:03.546 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T02:12:03.547 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:12:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b51835700 1 Processor -- start 2024-04-25T02:12:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b51835700 1 -- start start 2024-04-25T02:12:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b51835700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c064ad0 0x7f2b4c12abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b51835700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b4c12a750 0x7f2b4c12b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b51835700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c065750 con 0x7f2b4c098530 2024-04-25T02:12:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b51835700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c064eb0 con 0x7f2b4c12a750 2024-04-25T02:12:03.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b51835700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c099930 con 0x7f2b4c064ad0 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b4affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c064ad0 0x7f2b4c12abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b4affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c064ad0 0x7f2b4c12abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:49980/0 (socket says 172.21.15.78:49980) 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b4affd700 1 -- 172.21.15.78:0/299834796 learned_addr learned my addr 172.21.15.78:0/299834796 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.654+0000 7f2b4a7fc700 1 --2- 172.21.15.78:0/299834796 >> v2:172.21.15.78:3300/0 conn(0x7f2b4c12a750 0x7f2b4c12b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b4affd700 1 -- 172.21.15.78:0/299834796 >> v2:172.21.15.78:3300/0 conn(0x7f2b4c12a750 msgr2=0x7f2b4c12b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b4affd700 1 --2- 172.21.15.78:0/299834796 >> v2:172.21.15.78:3300/0 conn(0x7f2b4c12a750 0x7f2b4c12b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b4affd700 1 -- 172.21.15.78:0/299834796 >> v1:172.21.15.78:6789/0 conn(0x7f2b4c098530 legacy=0x7f2b4c0989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b4affd700 1 -- 172.21.15.78:0/299834796 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c065b40 con 0x7f2b4c064ad0 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b4affd700 1 --2- 172.21.15.78:0/299834796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c064ad0 0x7f2b4c12abe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2b3c006fd0 tx=0x7f2b3c0090f0).ready entity=mon.1 client_cookie=1b06171e6d97a7b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b49ffb700 1 -- 172.21.15.78:0/299834796 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00b580 con 0x7f2b4c064ad0 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b49ffb700 1 -- 172.21.15.78:0/299834796 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c00b6e0 con 0x7f2b4c064ad0 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b49ffb700 1 -- 172.21.15.78:0/299834796 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00ba80 con 0x7f2b4c064ad0 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b51835700 1 -- 172.21.15.78:0/299834796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c064ad0 msgr2=0x7f2b4c12abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b51835700 1 --2- 172.21.15.78:0/299834796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c064ad0 0x7f2b4c12abe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2b3c006fd0 tx=0x7f2b3c0090f0).stop 2024-04-25T02:12:03.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b51835700 1 -- 172.21.15.78:0/299834796 shutdown_connections 2024-04-25T02:12:03.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b51835700 1 --2- 172.21.15.78:0/299834796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c064ad0 0x7f2b4c12abe0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b51835700 1 --2- 172.21.15.78:0/299834796 >> v2:172.21.15.78:3300/0 conn(0x7f2b4c12a750 0x7f2b4c12b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b51835700 1 -- 172.21.15.78:0/299834796 >> 172.21.15.78:0/299834796 conn(0x7f2b4c09a630 msgr2=0x7f2b4c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b51835700 1 -- 172.21.15.78:0/299834796 shutdown_connections 2024-04-25T02:12:03.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.655+0000 7f2b51835700 1 -- 172.21.15.78:0/299834796 wait complete. 2024-04-25T02:12:03.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.656+0000 7f2b51835700 1 Processor -- start 2024-04-25T02:12:03.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.656+0000 7f2b51835700 1 -- start start 2024-04-25T02:12:03.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b51835700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2b4c064ad0 0x7f2b4c11ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b51835700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4c098530 0x7f2b4c116cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b51835700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c1171e0 0x7f2b4c117640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b51835700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c127e50 con 0x7f2b4c098530 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b51835700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c099ab0 con 0x7f2b4c1171e0 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b51835700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c11a280 con 0x7f2b4c064ad0 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4c098530 0x7f2b4c116cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4c098530 0x7f2b4c116cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53294/0 (socket says 172.21.15.78:53294) 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4a7fc700 1 -- 172.21.15.78:0/173535660 learned_addr learned my addr 172.21.15.78:0/173535660 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4b7fe700 1 --2- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c1171e0 0x7f2b4c117640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4affd700 1 --2- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2b4c064ad0 0x7f2b4c11ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4a7fc700 1 -- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2b4c064ad0 msgr2=0x7f2b4c11ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4a7fc700 1 --2- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2b4c064ad0 0x7f2b4c11ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4a7fc700 1 -- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c1171e0 msgr2=0x7f2b4c117640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4a7fc700 1 --2- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c1171e0 0x7f2b4c117640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4a7fc700 1 -- 172.21.15.78:0/173535660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c009370 con 0x7f2b4c098530 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.657+0000 7f2b4a7fc700 1 --2- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4c098530 0x7f2b4c116cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f2b4000e900 tx=0x7f2b40009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.658+0000 7f2b337fe700 1 -- 172.21.15.78:0/173535660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40012600 con 0x7f2b4c098530 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.658+0000 7f2b337fe700 1 -- 172.21.15.78:0/173535660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40012760 con 0x7f2b4c098530 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.658+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c09d1d0 con 0x7f2b4c098530 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.658+0000 7f2b337fe700 1 -- 172.21.15.78:0/173535660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40012ae0 con 0x7f2b4c098530 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.658+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c1180f0 con 0x7f2b4c098530 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.658+0000 7f2b337fe700 1 -- 172.21.15.78:0/173535660 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f2b4001b400 con 0x7f2b4c098530 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.658+0000 7f2b337fe700 1 -- 172.21.15.78:0/173535660 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f2b4003b6a0 con 0x7f2b4c098530 2024-04-25T02:12:03.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.659+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c09cd40 con 0x7f2b4c098530 2024-04-25T02:12:03.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.663+0000 7f2b337fe700 1 -- 172.21.15.78:0/173535660 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f2b40019900 con 0x7f2b4c098530 2024-04-25T02:12:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.858+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2b4c09b150 con 0x7f2b4c098530 2024-04-25T02:12:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.858+0000 7f2b337fe700 1 -- 172.21.15.78:0/173535660 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2b40029030 con 0x7f2b4c098530 2024-04-25T02:12:03.865 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:12:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.859+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 >> v1:172.21.15.78:6816/46507 conn(0x7f2b3802bd00 legacy=0x7f2b3802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.859+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4c098530 msgr2=0x7f2b4c116cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.859+0000 7f2b51835700 1 --2- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4c098530 0x7f2b4c116cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f2b4000e900 tx=0x7f2b40009060).stop 2024-04-25T02:12:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.860+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 shutdown_connections 2024-04-25T02:12:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.860+0000 7f2b51835700 1 --2- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2b4c1171e0 0x7f2b4c117640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.860+0000 7f2b51835700 1 --2- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2b4c064ad0 0x7f2b4c11ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.860+0000 7f2b51835700 1 --2- 172.21.15.78:0/173535660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b4c098530 0x7f2b4c116cf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:12:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.860+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 >> 172.21.15.78:0/173535660 conn(0x7f2b4c09a630 msgr2=0x7f2b4c097240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.860+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 shutdown_connections 2024-04-25T02:12:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:12:03.860+0000 7f2b51835700 1 -- 172.21.15.78:0/173535660 wait complete. 2024-04-25T02:12:03.878 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:12:03.878 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:12:03.878 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-04-25T02:12:03.878 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:12:03.878 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:03.879 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:12:03.879 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:12:03.879 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:12:03.879 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:12:03.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:03.879 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-04-25T02:12:03.901 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:12:03.901 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:12:03.901 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:12:03.901 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:12:03.902 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42525sec preferred_lft 42525sec 2024-04-25T02:12:03.903 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-04-25T02:12:03.903 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:12:03.903 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:12:03.903 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:12:03.903 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:12:03.903 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:12:03.903 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-04-25T02:12:03.903 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-04-25T02:12:03.903 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:12:03.903 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:12:03.998 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:12:04.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:04.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:04.065 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:12:04.092 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-25T02:12:04.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:04.094 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-04-25T02:12:04.153 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-04-25T02:12:04.153 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:12:04.153 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:12:04.153 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:12:04.153 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:12:04.153 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:12:04.154 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:12:04.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:12:04.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:12:04.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:12:04.154 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:12:04.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:12:04.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:04.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:04.295 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T02:12:04.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:04.313 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-04-25T02:12:04.371 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:12:04.371 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:12:04.371 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:12:04.371 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T02:12:04.371 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:12:04.460 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:12:04.497 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:04.502 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T02:12:04.502 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:12:04.503 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:12:04.503 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T02:12:04.503 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:12:04.503 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T02:12:04.503 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T02:12:04.503 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T02:12:04.503 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:12:04.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:12:04.729 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:04.734 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:12:04.735 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-04-25T02:12:04.735 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-04-25T02:12:04.735 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:12:04.735 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-04-25T02:12:04.785 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:12:04.864 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:04.870 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T02:12:04.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:12:04.871 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:04.888 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:12:04.888 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:12:04.888 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:04.944 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-04-25T02:12:05.011 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:12:05.069 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-04-25T02:12:05.070 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/memory 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/devices 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/pids 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:12:05.071 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/selinux 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-04-25T02:12:05.072 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:12:05.073 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:12:05.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:05.074 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-04-25T02:12:05.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T02:12:05.133 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T02:12:05.175 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-04-25T02:12:05.200 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:12:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-04-25T02:12:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-04-25T02:12:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/memory 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:12:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/devices 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/pids 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/selinux 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-04-25T02:12:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-04-25T02:12:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:12:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-04-25T02:12:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-04-25T02:12:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-04-25T02:12:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:12:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:12:05.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:05.262 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-04-25T02:12:05.263 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi195.stderr:2024-04-25T02:12:05.255+0000 7f8eb0c615c0 -1 init, newargv = 0x55a72a21d630 newargc=15 2024-04-25T02:12:05.263 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi195.stderr:ceph-fuse[42281]: starting ceph client 2024-04-25T02:12:05.267 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi195.stderr:ceph-fuse[42281]: starting fuse 2024-04-25T02:12:05.280 INFO:teuthology.orchestra.run.smithi195.stdout:47 2024-04-25T02:12:05.280 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-04-25T02:12:05.280 DEBUG:teuthology.orchestra.run.smithi195:> sudo stdin-killer -- python3 -c ' 2024-04-25T02:12:05.280 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2024-04-25T02:12:05.280 DEBUG:teuthology.orchestra.run.smithi195:> import re 2024-04-25T02:12:05.280 DEBUG:teuthology.orchestra.run.smithi195:> import os 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T02:12:05.281 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T02:12:05.282 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2024-04-25T02:12:05.282 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2024-04-25T02:12:05.282 DEBUG:teuthology.orchestra.run.smithi195:> return f 2024-04-25T02:12:05.282 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T02:12:05.282 DEBUG:teuthology.orchestra.run.smithi195:> 2024-04-25T02:12:05.282 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.0")) 2024-04-25T02:12:05.282 DEBUG:teuthology.orchestra.run.smithi195:> ' 2024-04-25T02:12:05.401 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.0.42281.asok 2024-04-25T02:12:05.405 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T02:12:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:12:05.411 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42281.asok 2024-04-25T02:12:05.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:05.411 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42281.asok status 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "76424b2fe1bb19c32c52140f39764599abf5e035", 2024-04-25T02:12:05.566 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.2.3 (76424b2fe1bb19c32c52140f39764599abf5e035) reef (stable)", 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "0", 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "42281", 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 4750, 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 4750 2024-04-25T02:12:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "172.21.15.195:0", 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 593591170 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "172.21.15.195:0", 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 593591170 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.4750 172.21.15.195:0/593591170", 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "172.21.15.195:0/593591170", 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2024-04-25T02:12:05.568 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 5, 2024-04-25T02:12:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 19, 2024-04-25T02:12:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2024-04-25T02:12:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2024-04-25T02:12:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2024-04-25T02:12:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-25T02:12:05.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:05.576 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2024-04-25T02:12:05.576 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:05.594 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2024-04-25T02:12:05.594 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:05.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:12:05.594 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:05.660 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:12:05.669 INFO:teuthology.task.print:**** done remount client.0 2024-04-25T02:12:05.669 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T02:12:05.696 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:12:05.696 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T02:12:05.696 INFO:tasks.workunit:timeout=3h 2024-04-25T02:12:05.696 INFO:tasks.workunit:cleanup=True 2024-04-25T02:12:05.697 DEBUG:teuthology.orchestra.run.smithi195:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:05.717 INFO:teuthology.orchestra.run.smithi195.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:05.717 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T02:12:05.718 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 2fh/47d Inode: 1 Links: 2 2024-04-25T02:12:05.718 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:12:05.718 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-25T02:12:05.718 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T02:12:05.718 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 02:10:02.704130337 +0000 2024-04-25T02:12:05.718 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 02:10:22.291365165 +0000 2024-04-25T02:12:05.718 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-04-25T02:12:05.718 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T02:12:05.718 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T02:12:05.788 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:12:05.847 INFO:tasks.workunit.client.0.smithi195.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T02:13:13.339 INFO:tasks.workunit.client.0.smithi195.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-25T02:13:13.339 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:13.339 INFO:tasks.workunit.client.0.smithi195.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T02:13:13.339 INFO:tasks.workunit.client.0.smithi195.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr: git switch -c 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr:Or undo this operation with: 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr: git switch - 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:13.340 INFO:tasks.workunit.client.0.smithi195.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-25T02:13:13.343 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T02:13:13.485 INFO:tasks.workunit.client.0.smithi195.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T02:13:13.487 INFO:tasks.workunit.client.0.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T02:13:13.487 INFO:tasks.workunit.client.0.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T02:13:13.995 INFO:tasks.workunit.client.0.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T02:13:14.070 INFO:tasks.workunit.client.0.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T02:13:14.108 INFO:tasks.workunit.client.0.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T02:13:14.109 INFO:tasks.workunit.client.0.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T02:13:14.109 INFO:tasks.workunit.client.0.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T02:13:14.146 INFO:tasks.workunit.client.0.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T02:13:14.149 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:13:14.149 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T02:13:14.167 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-04-25T02:13:14.168 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-04-25T02:13:14.168 DEBUG:teuthology.orchestra.run.smithi195:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-04-25T02:13:14.236 INFO:tasks.workunit.client.0.smithi195.stdout:getting blogbench 2024-04-25T02:13:14.236 INFO:tasks.workunit.client.0.smithi195.stderr:+ echo 'getting blogbench' 2024-04-25T02:13:14.237 INFO:tasks.workunit.client.0.smithi195.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-04-25T02:13:14.257 INFO:tasks.workunit.client.0.smithi195.stderr:--2024-04-25 02:13:14-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-04-25T02:13:14.258 INFO:tasks.workunit.client.0.smithi195.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-25T02:13:14.279 INFO:tasks.workunit.client.0.smithi195.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-25T02:13:14.299 INFO:tasks.workunit.client.0.smithi195.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-25T02:13:14.300 INFO:tasks.workunit.client.0.smithi195.stderr:Length: 103355 (101K) [application/octet-stream] 2024-04-25T02:13:14.301 INFO:tasks.workunit.client.0.smithi195.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-04-25T02:13:14.304 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:14.342 INFO:tasks.workunit.client.0.smithi195.stderr: 0K .......... .......... .......... .......... .......... 49% 1.25M 0s 2024-04-25T02:13:14.361 INFO:tasks.workunit.client.0.smithi195.stderr: 50K .......... .......... .......... .......... .......... 99% 2.42M 0s 2024-04-25T02:13:14.362 INFO:tasks.workunit.client.0.smithi195.stderr: 100K 100% 1779G=0.06s 2024-04-25T02:13:14.362 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:14.362 INFO:tasks.workunit.client.0.smithi195.stderr:2024-04-25 02:13:14 (1.66 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-04-25T02:13:14.362 INFO:tasks.workunit.client.0.smithi195.stderr: 2024-04-25T02:13:14.362 INFO:tasks.workunit.client.0.smithi195.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-04-25T02:13:14.388 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/ 2024-04-25T02:13:14.390 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/m4/ 2024-04-25T02:13:14.391 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-04-25T02:13:14.394 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/man/ 2024-04-25T02:13:14.396 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/man/blogbench.8 2024-04-25T02:13:14.398 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/man/Makefile.am 2024-04-25T02:13:14.400 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/man/Makefile.in 2024-04-25T02:13:14.402 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/ 2024-04-25T02:13:14.404 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/mysnprintf.c 2024-04-25T02:13:14.405 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/mysnprintf.h 2024-04-25T02:13:14.407 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/blogbench.c 2024-04-25T02:13:14.409 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/blogbench.h 2024-04-25T02:13:14.411 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/fakesnprintf.c 2024-04-25T02:13:14.413 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/fakesnprintf.h 2024-04-25T02:13:14.415 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/blogbench_p.h 2024-04-25T02:13:14.417 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-04-25T02:13:14.419 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-04-25T02:13:14.422 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/Makefile.am 2024-04-25T02:13:14.423 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/Makefile.in 2024-04-25T02:13:14.426 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/process.c 2024-04-25T02:13:14.428 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/globals.h 2024-04-25T02:13:14.429 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/commenter.c 2024-04-25T02:13:14.431 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/rewriter.c 2024-04-25T02:13:14.433 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/reader.c 2024-04-25T02:13:14.435 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/writer.c 2024-04-25T02:13:14.437 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/src/helpers.c 2024-04-25T02:13:14.438 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/NEWS 2024-04-25T02:13:14.441 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/compile 2024-04-25T02:13:14.442 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/depcomp 2024-04-25T02:13:14.444 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/aclocal.m4 2024-04-25T02:13:14.447 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/README 2024-04-25T02:13:14.448 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/configure 2024-04-25T02:13:14.457 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/configure.ac 2024-04-25T02:13:14.459 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/config.guess 2024-04-25T02:13:14.462 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/install-sh 2024-04-25T02:13:14.464 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/config.sub 2024-04-25T02:13:14.466 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/missing 2024-04-25T02:13:14.468 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/mkinstalldirs 2024-04-25T02:13:14.470 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/Makefile.am 2024-04-25T02:13:14.472 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/Makefile.in 2024-04-25T02:13:14.474 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/config.h.in 2024-04-25T02:13:14.476 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/AUTHORS 2024-04-25T02:13:14.477 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/INSTALL 2024-04-25T02:13:14.480 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/ChangeLog 2024-04-25T02:13:14.481 INFO:tasks.workunit.client.0.smithi195.stdout:blogbench-1.0/COPYING 2024-04-25T02:13:14.484 INFO:tasks.workunit.client.0.smithi195.stderr:+ cd blogbench-1.0/ 2024-04-25T02:13:14.485 INFO:tasks.workunit.client.0.smithi195.stdout:making blogbench 2024-04-25T02:13:14.485 INFO:tasks.workunit.client.0.smithi195.stderr:+ echo 'making blogbench' 2024-04-25T02:13:14.485 INFO:tasks.workunit.client.0.smithi195.stderr:+ ./configure 2024-04-25T02:13:14.580 INFO:tasks.workunit.client.0.smithi195.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-25T02:13:15.590 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether build environment is sane... yes 2024-04-25T02:13:15.607 INFO:tasks.workunit.client.0.smithi195.stdout:checking for gawk... gawk 2024-04-25T02:13:15.634 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether make sets $(MAKE)... yes 2024-04-25T02:13:15.651 INFO:tasks.workunit.client.0.smithi195.stdout:checking for gcc... gcc 2024-04-25T02:13:15.723 INFO:tasks.workunit.client.0.smithi195.stdout:checking for C compiler default output file name... a.out 2024-04-25T02:13:15.726 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether the C compiler works... yes 2024-04-25T02:13:15.730 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether we are cross compiling... no 2024-04-25T02:13:15.778 INFO:tasks.workunit.client.0.smithi195.stdout:checking for suffix of executables... 2024-04-25T02:13:15.824 INFO:tasks.workunit.client.0.smithi195.stdout:checking for suffix of object files... o 2024-04-25T02:13:15.868 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether we are using the GNU C compiler... yes 2024-04-25T02:13:15.915 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether gcc accepts -g... yes 2024-04-25T02:13:15.969 INFO:tasks.workunit.client.0.smithi195.stdout:checking for gcc option to accept ANSI C... none needed 2024-04-25T02:13:16.037 INFO:tasks.workunit.client.0.smithi195.stdout:checking for style of include used by make... GNU 2024-04-25T02:13:16.183 INFO:tasks.workunit.client.0.smithi195.stdout:checking dependency style of gcc... gcc3 2024-04-25T02:13:16.184 INFO:tasks.workunit.client.0.smithi195.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-25T02:13:16.269 INFO:tasks.workunit.client.0.smithi195.stdout:checking how to run the C preprocessor... gcc -E 2024-04-25T02:13:16.321 INFO:tasks.workunit.client.0.smithi195.stdout:checking for egrep... grep -E 2024-04-25T02:13:16.332 INFO:tasks.workunit.client.0.smithi195.stdout:checking for AIX... no 2024-04-25T02:13:16.418 INFO:tasks.workunit.client.0.smithi195.stdout:checking for library containing strerror... none required 2024-04-25T02:13:16.601 INFO:tasks.workunit.client.0.smithi195.stdout:checking for ANSI C header files... yes 2024-04-25T02:13:16.660 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-25T02:13:16.716 INFO:tasks.workunit.client.0.smithi195.stdout:checking for sys/types.h... yes 2024-04-25T02:13:16.776 INFO:tasks.workunit.client.0.smithi195.stdout:checking for sys/stat.h... yes 2024-04-25T02:13:16.840 INFO:tasks.workunit.client.0.smithi195.stdout:checking for stdlib.h... yes 2024-04-25T02:13:16.900 INFO:tasks.workunit.client.0.smithi195.stdout:checking for string.h... yes 2024-04-25T02:13:16.963 INFO:tasks.workunit.client.0.smithi195.stdout:checking for memory.h... yes 2024-04-25T02:13:17.025 INFO:tasks.workunit.client.0.smithi195.stdout:checking for strings.h... yes 2024-04-25T02:13:17.090 INFO:tasks.workunit.client.0.smithi195.stdout:checking for inttypes.h... yes 2024-04-25T02:13:17.153 INFO:tasks.workunit.client.0.smithi195.stdout:checking for stdint.h... yes 2024-04-25T02:13:17.217 INFO:tasks.workunit.client.0.smithi195.stdout:checking for unistd.h... yes 2024-04-25T02:13:17.234 INFO:tasks.workunit.client.0.smithi195.stdout:checking for memory.h... (cached) yes 2024-04-25T02:13:17.244 INFO:tasks.workunit.client.0.smithi195.stdout:checking for strings.h... (cached) yes 2024-04-25T02:13:17.254 INFO:tasks.workunit.client.0.smithi195.stdout:checking for unistd.h... (cached) yes 2024-04-25T02:13:17.320 INFO:tasks.workunit.client.0.smithi195.stdout:checking locale.h usability... yes 2024-04-25T02:13:17.344 INFO:tasks.workunit.client.0.smithi195.stdout:checking locale.h presence... yes 2024-04-25T02:13:17.345 INFO:tasks.workunit.client.0.smithi195.stdout:checking for locale.h... yes 2024-04-25T02:13:17.366 INFO:tasks.workunit.client.0.smithi195.stdout:checking for stdlib.h... (cached) yes 2024-04-25T02:13:17.377 INFO:tasks.workunit.client.0.smithi195.stdout:checking for string.h... (cached) yes 2024-04-25T02:13:17.445 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/socket.h usability... yes 2024-04-25T02:13:17.470 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/socket.h presence... yes 2024-04-25T02:13:17.471 INFO:tasks.workunit.client.0.smithi195.stdout:checking for sys/socket.h... yes 2024-04-25T02:13:17.541 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/time.h usability... yes 2024-04-25T02:13:17.566 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/time.h presence... yes 2024-04-25T02:13:17.567 INFO:tasks.workunit.client.0.smithi195.stdout:checking for sys/time.h... yes 2024-04-25T02:13:17.636 INFO:tasks.workunit.client.0.smithi195.stdout:checking fcntl.h usability... yes 2024-04-25T02:13:17.662 INFO:tasks.workunit.client.0.smithi195.stdout:checking fcntl.h presence... yes 2024-04-25T02:13:17.663 INFO:tasks.workunit.client.0.smithi195.stdout:checking for fcntl.h... yes 2024-04-25T02:13:17.730 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/fcntl.h usability... yes 2024-04-25T02:13:17.755 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/fcntl.h presence... yes 2024-04-25T02:13:17.756 INFO:tasks.workunit.client.0.smithi195.stdout:checking for sys/fcntl.h... yes 2024-04-25T02:13:17.861 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/param.h usability... yes 2024-04-25T02:13:17.888 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/param.h presence... yes 2024-04-25T02:13:17.889 INFO:tasks.workunit.client.0.smithi195.stdout:checking for sys/param.h... yes 2024-04-25T02:13:17.951 INFO:tasks.workunit.client.0.smithi195.stdout:checking ioctl.h usability... no 2024-04-25T02:13:17.978 INFO:tasks.workunit.client.0.smithi195.stdout:checking ioctl.h presence... no 2024-04-25T02:13:17.979 INFO:tasks.workunit.client.0.smithi195.stdout:checking for ioctl.h... no 2024-04-25T02:13:18.041 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/ioctl.h usability... yes 2024-04-25T02:13:18.066 INFO:tasks.workunit.client.0.smithi195.stdout:checking sys/ioctl.h presence... yes 2024-04-25T02:13:18.067 INFO:tasks.workunit.client.0.smithi195.stdout:checking for sys/ioctl.h... yes 2024-04-25T02:13:18.134 INFO:tasks.workunit.client.0.smithi195.stdout:checking return type of signal handlers... void 2024-04-25T02:13:18.190 INFO:tasks.workunit.client.0.smithi195.stdout:checking for size_t... yes 2024-04-25T02:13:18.239 INFO:tasks.workunit.client.0.smithi195.stdout:checking for dev_t... yes 2024-04-25T02:13:18.296 INFO:tasks.workunit.client.0.smithi195.stdout:checking for short... yes 2024-04-25T02:13:18.374 INFO:tasks.workunit.client.0.smithi195.stdout:checking size of short... 2 2024-04-25T02:13:18.432 INFO:tasks.workunit.client.0.smithi195.stdout:checking for int... yes 2024-04-25T02:13:18.517 INFO:tasks.workunit.client.0.smithi195.stdout:checking size of int... 4 2024-04-25T02:13:18.575 INFO:tasks.workunit.client.0.smithi195.stdout:checking for long... yes 2024-04-25T02:13:18.663 INFO:tasks.workunit.client.0.smithi195.stdout:checking size of long... 8 2024-04-25T02:13:18.722 INFO:tasks.workunit.client.0.smithi195.stdout:checking for long long... yes 2024-04-25T02:13:18.820 INFO:tasks.workunit.client.0.smithi195.stdout:checking size of long long... 8 2024-04-25T02:13:18.887 INFO:tasks.workunit.client.0.smithi195.stdout:checking for ssize_t... yes 2024-04-25T02:13:18.937 INFO:tasks.workunit.client.0.smithi195.stdout:checking for sig_atomic_t... yes 2024-04-25T02:13:18.994 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether gcc needs -traditional... no 2024-04-25T02:13:19.037 INFO:tasks.workunit.client.0.smithi195.stdout:checking for an ANSI C-conforming const... yes 2024-04-25T02:13:19.070 INFO:tasks.workunit.client.0.smithi195.stdout:checking for inline... inline 2024-04-25T02:13:19.148 INFO:tasks.workunit.client.0.smithi195.stdout:checking for working alloca.h... yes 2024-04-25T02:13:19.214 INFO:tasks.workunit.client.0.smithi195.stdout:checking for alloca... yes 2024-04-25T02:13:19.299 INFO:tasks.workunit.client.0.smithi195.stdout:checking for working memcmp... yes 2024-04-25T02:13:19.374 INFO:tasks.workunit.client.0.smithi195.stdout:checking for strftime... yes 2024-04-25T02:13:19.463 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-04-25T02:13:19.541 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether stat accepts an empty string... no 2024-04-25T02:13:19.616 INFO:tasks.workunit.client.0.smithi195.stdout:checking for vprintf... yes 2024-04-25T02:13:19.699 INFO:tasks.workunit.client.0.smithi195.stdout:checking for _doprnt... no 2024-04-25T02:13:19.731 INFO:tasks.workunit.client.0.smithi195.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-25T02:13:19.746 INFO:tasks.workunit.client.0.smithi195.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-25T02:13:19.822 INFO:tasks.workunit.client.0.smithi195.stdout:checking for the pthreads library -lpthreads... no 2024-04-25T02:13:19.908 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether pthreads work without any flags... no 2024-04-25T02:13:19.933 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether pthreads work with -Kthread... no 2024-04-25T02:13:19.958 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether pthreads work with -kthread... no 2024-04-25T02:13:20.013 INFO:tasks.workunit.client.0.smithi195.stdout:checking for the pthreads library -llthread... no 2024-04-25T02:13:20.083 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether pthreads work with -pthread... yes 2024-04-25T02:13:20.147 INFO:tasks.workunit.client.0.smithi195.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-04-25T02:13:20.147 INFO:tasks.workunit.client.0.smithi195.stdout:checking if more special flags are required for pthreads... no 2024-04-25T02:13:20.147 INFO:tasks.workunit.client.0.smithi195.stdout:checking for cc_r... gcc 2024-04-25T02:13:20.227 INFO:tasks.workunit.client.0.smithi195.stdout:checking for setrlimit... yes 2024-04-25T02:13:20.326 INFO:tasks.workunit.client.0.smithi195.stdout:checking for setproctitle... no 2024-04-25T02:13:20.421 INFO:tasks.workunit.client.0.smithi195.stdout:checking for getopt_long... yes 2024-04-25T02:13:20.500 INFO:tasks.workunit.client.0.smithi195.stdout:checking for strtoull... yes 2024-04-25T02:13:20.579 INFO:tasks.workunit.client.0.smithi195.stdout:checking for strtoq... yes 2024-04-25T02:13:20.662 INFO:tasks.workunit.client.0.smithi195.stdout:checking for snprintf... yes 2024-04-25T02:13:20.743 INFO:tasks.workunit.client.0.smithi195.stdout:checking for vsnprintf... yes 2024-04-25T02:13:20.829 INFO:tasks.workunit.client.0.smithi195.stdout:checking for vfprintf... yes 2024-04-25T02:13:20.911 INFO:tasks.workunit.client.0.smithi195.stdout:checking for gethostname... yes 2024-04-25T02:13:20.993 INFO:tasks.workunit.client.0.smithi195.stdout:checking for setlocale... yes 2024-04-25T02:13:21.073 INFO:tasks.workunit.client.0.smithi195.stdout:checking for sync... yes 2024-04-25T02:13:21.153 INFO:tasks.workunit.client.0.smithi195.stdout:checking whether snprintf is C99 conformant... done 2024-04-25T02:13:21.170 INFO:tasks.workunit.client.0.smithi195.stdout:configure: creating ./config.status 2024-04-25T02:13:21.401 INFO:tasks.workunit.client.0.smithi195.stdout:config.status: creating Makefile 2024-04-25T02:13:21.422 INFO:tasks.workunit.client.0.smithi195.stdout:config.status: creating src/Makefile 2024-04-25T02:13:21.448 INFO:tasks.workunit.client.0.smithi195.stdout:config.status: creating man/Makefile 2024-04-25T02:13:21.465 INFO:tasks.workunit.client.0.smithi195.stdout:config.status: creating config.h 2024-04-25T02:13:21.532 INFO:tasks.workunit.client.0.smithi195.stdout:config.status: executing depfiles commands 2024-04-25T02:13:21.695 INFO:tasks.workunit.client.0.smithi195.stderr:+ make 2024-04-25T02:13:21.710 INFO:tasks.workunit.client.0.smithi195.stdout:make all-recursive 2024-04-25T02:13:21.717 INFO:tasks.workunit.client.0.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-25T02:13:21.720 INFO:tasks.workunit.client.0.smithi195.stdout:Making all in src 2024-04-25T02:13:21.744 INFO:tasks.workunit.client.0.smithi195.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-04-25T02:13:21.744 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-04-25T02:13:21.744 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-04-25T02:13:21.833 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-04-25T02:13:21.834 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-04-25T02:13:21.921 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-04-25T02:13:21.922 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-04-25T02:13:21.998 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-04-25T02:13:21.998 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-04-25T02:13:22.074 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-04-25T02:13:22.074 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-04-25T02:13:22.148 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-04-25T02:13:22.148 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-04-25T02:13:22.220 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-04-25T02:13:22.220 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-04-25T02:13:22.317 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-04-25T02:13:22.317 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-04-25T02:13:22.376 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-04-25T02:13:22.376 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-04-25T02:13:22.435 INFO:tasks.workunit.client.0.smithi195.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-04-25T02:13:22.436 INFO:tasks.workunit.client.0.smithi195.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-04-25T02:13:22.488 INFO:tasks.workunit.client.0.smithi195.stdout:gcc -g -O2 -pthread -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-04-25T02:13:22.541 INFO:tasks.workunit.client.0.smithi195.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-04-25T02:13:22.541 INFO:tasks.workunit.client.0.smithi195.stdout:Making all in man 2024-04-25T02:13:22.554 INFO:tasks.workunit.client.0.smithi195.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-04-25T02:13:22.554 INFO:tasks.workunit.client.0.smithi195.stdout:make[2]: Nothing to be done for 'all'. 2024-04-25T02:13:22.554 INFO:tasks.workunit.client.0.smithi195.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-04-25T02:13:22.563 INFO:tasks.workunit.client.0.smithi195.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-25T02:13:22.566 INFO:tasks.workunit.client.0.smithi195.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-25T02:13:22.566 INFO:tasks.workunit.client.0.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-04-25T02:13:22.569 INFO:tasks.workunit.client.0.smithi195.stderr:+ cd src 2024-04-25T02:13:22.569 INFO:tasks.workunit.client.0.smithi195.stderr:+ mkdir blogtest_in 2024-04-25T02:13:22.571 INFO:tasks.workunit.client.0.smithi195.stderr:+ echo 'running blogbench' 2024-04-25T02:13:22.572 INFO:tasks.workunit.client.0.smithi195.stdout:running blogbench 2024-04-25T02:13:22.572 INFO:tasks.workunit.client.0.smithi195.stderr:+ ./blogbench -d blogtest_in 2024-04-25T02:13:22.572 INFO:tasks.workunit.client.0.smithi195.stdout: 2024-04-25T02:13:22.572 INFO:tasks.workunit.client.0.smithi195.stdout:Frequency = 10 secs 2024-04-25T02:13:22.572 INFO:tasks.workunit.client.0.smithi195.stdout:Scratch dir = [blogtest_in] 2024-04-25T02:13:25.258 INFO:tasks.workunit.client.0.smithi195.stdout:Spawning 3 writers... 2024-04-25T02:13:25.258 INFO:tasks.workunit.client.0.smithi195.stdout:Spawning 1 rewriters... 2024-04-25T02:13:25.258 INFO:tasks.workunit.client.0.smithi195.stdout:Spawning 5 commenters... 2024-04-25T02:13:25.259 INFO:tasks.workunit.client.0.smithi195.stdout:Spawning 100 readers... 2024-04-25T02:13:25.260 INFO:tasks.workunit.client.0.smithi195.stdout:Benchmarking for 30 iterations. 2024-04-25T02:13:25.260 INFO:tasks.workunit.client.0.smithi195.stdout:The test will run during 5 minutes. 2024-04-25T02:13:25.260 INFO:tasks.workunit.client.0.smithi195.stdout: 2024-04-25T02:13:25.260 INFO:tasks.workunit.client.0.smithi195.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-04-25T02:13:35.260 INFO:tasks.workunit.client.0.smithi195.stdout: 4 15974 412 6450 277 1740 631 2024-04-25T02:13:45.260 INFO:tasks.workunit.client.0.smithi195.stdout: 7 16479 151 8164 197 4086 312 2024-04-25T02:13:55.261 INFO:tasks.workunit.client.0.smithi195.stdout: 9 15083 89 7934 126 6333 281 2024-04-25T02:14:05.260 INFO:tasks.workunit.client.0.smithi195.stdout: 11 14363 149 9359 59 5776 260 2024-04-25T02:14:15.260 INFO:tasks.workunit.client.0.smithi195.stdout: 13 14852 99 9229 99 5254 267 2024-04-25T02:14:25.260 INFO:tasks.workunit.client.0.smithi195.stdout: 16 14398 130 8413 88 6610 271 2024-04-25T02:14:35.260 INFO:tasks.workunit.client.0.smithi195.stdout: 16 14453 94 8990 104 6189 266 2024-04-25T02:14:45.260 INFO:tasks.workunit.client.0.smithi195.stdout: 19 14527 78 8753 116 6221 265 2024-04-25T02:14:55.260 INFO:tasks.workunit.client.0.smithi195.stdout: 20 13583 56 8722 106 7108 170 2024-04-25T02:15:05.260 INFO:tasks.workunit.client.0.smithi195.stdout: 22 13610 118 8936 27 7296 171 2024-04-25T02:15:15.260 INFO:tasks.workunit.client.0.smithi195.stdout: 22 13383 108 8891 7 7702 127 2024-04-25T02:15:25.260 INFO:tasks.workunit.client.0.smithi195.stdout: 22 13632 38 9182 45 7791 91 2024-04-25T02:15:35.260 INFO:tasks.workunit.client.0.smithi195.stdout: 25 14100 32 8584 83 6904 146 2024-04-25T02:15:45.260 INFO:tasks.workunit.client.0.smithi195.stdout: 25 13589 95 8338 47 6801 179 2024-04-25T02:15:55.260 INFO:tasks.workunit.client.0.smithi195.stdout: 26 13791 62 8696 76 6368 178 2024-04-25T02:16:05.261 INFO:tasks.workunit.client.0.smithi195.stdout: 27 13508 57 8615 73 6763 150 2024-04-25T02:16:15.260 INFO:tasks.workunit.client.0.smithi195.stdout: 27 14115 38 8574 83 6225 153 2024-04-25T02:16:25.260 INFO:tasks.workunit.client.0.smithi195.stdout: 29 13854 43 8769 63 6497 118 2024-04-25T02:16:35.260 INFO:tasks.workunit.client.0.smithi195.stdout: 29 13421 75 8479 40 6272 155 2024-04-25T02:16:45.260 INFO:tasks.workunit.client.0.smithi195.stdout: 30 13516 37 8553 41 6384 110 2024-04-25T02:16:55.260 INFO:tasks.workunit.client.0.smithi195.stdout: 31 13382 55 8197 22 7128 93 2024-04-25T02:17:05.260 INFO:tasks.workunit.client.0.smithi195.stdout: 31 13249 69 7919 24 7517 106 2024-04-25T02:17:15.260 INFO:tasks.workunit.client.0.smithi195.stdout: 32 13322 28 8509 67 6768 112 2024-04-25T02:17:25.260 INFO:tasks.workunit.client.0.smithi195.stdout: 33 12755 48 8889 42 6785 92 2024-04-25T02:17:35.260 INFO:tasks.workunit.client.0.smithi195.stdout: 34 13055 74 8544 11 6528 97 2024-04-25T02:17:45.260 INFO:tasks.workunit.client.0.smithi195.stdout: 35 13548 59 8542 54 5704 126 2024-04-25T02:17:55.260 INFO:tasks.workunit.client.0.smithi195.stdout: 36 12669 59 8391 71 6679 146 2024-04-25T02:18:05.260 INFO:tasks.workunit.client.0.smithi195.stdout: 38 13066 88 8686 45 5918 148 2024-04-25T02:18:15.260 INFO:tasks.workunit.client.0.smithi195.stdout: 38 12515 101 8492 44 6480 155 2024-04-25T02:18:25.260 INFO:tasks.workunit.client.0.smithi195.stdout: 38 12962 79 8467 41 5880 138 2024-04-25T02:18:28.378 INFO:tasks.workunit.client.0.smithi195.stdout: 2024-04-25T02:18:28.378 INFO:tasks.workunit.client.0.smithi195.stdout:Final score for writes: 38 2024-04-25T02:18:28.379 INFO:tasks.workunit.client.0.smithi195.stdout:Final score for reads : 8183 2024-04-25T02:18:28.379 INFO:tasks.workunit.client.0.smithi195.stdout: 2024-04-25T02:18:28.379 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T02:18:28.379 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T02:18:46.984 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-04-25T02:18:46.984 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T02:18:47.260 DEBUG:teuthology.parallel:result is None 2024-04-25T02:18:47.260 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T02:18:47.294 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T02:18:47.294 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T02:18:47.307 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T02:18:47.308 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:18:47.308 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:47.355 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:18:47.355 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:47.413 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:18:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb566596700 1 Processor -- start 2024-04-25T02:18:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb566596700 1 -- start start 2024-04-25T02:18:47.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb566596700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb56012fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb566596700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb56012fff0 0x7fb5601323e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb566596700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb560092c00 con 0x7fb560069630 2024-04-25T02:18:47.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb566596700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb560069a10 con 0x7fb56012fff0 2024-04-25T02:18:47.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb566596700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56012a7d0 con 0x7fb56012b180 2024-04-25T02:18:47.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb55f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb56012fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb564b33700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb56012fff0 0x7fb5601323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb55ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb560069630 0x7fb56012aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52830/0 (socket says 172.21.15.78:52830) 2024-04-25T02:18:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb55ffff700 1 -- 172.21.15.78:0/2375347653 learned_addr learned my addr 172.21.15.78:0/2375347653 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:18:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb55f7fe700 1 -- 172.21.15.78:0/2375347653 >> v2:172.21.15.78:3300/0 conn(0x7fb56012fff0 msgr2=0x7fb5601323e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.581+0000 7fb55f7fe700 1 --2- 172.21.15.78:0/2375347653 >> v2:172.21.15.78:3300/0 conn(0x7fb56012fff0 0x7fb5601323e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb55f7fe700 1 -- 172.21.15.78:0/2375347653 >> v1:172.21.15.78:6789/0 conn(0x7fb560069630 legacy=0x7fb56012aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb55effd700 1 -- 172.21.15.78:0/2375347653 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590703968 0 0) 0x7fb560092c00 con 0x7fb560069630 2024-04-25T02:18:47.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb55f7fe700 1 -- 172.21.15.78:0/2375347653 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb560091a10 con 0x7fb56012b180 2024-04-25T02:18:47.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb564b33700 1 --2- 172.21.15.78:0/2375347653 >> v2:172.21.15.78:3300/0 conn(0x7fb56012fff0 0x7fb5601323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:47.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb55f7fe700 1 --2- 172.21.15.78:0/2375347653 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb56012fb00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb548009760 tx=0x7fb548009060).ready entity=mon.1 client_cookie=35c460568810d6f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:47.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb55effd700 1 -- 172.21.15.78:0/2375347653 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800f510 con 0x7fb56012b180 2024-04-25T02:18:47.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb55effd700 1 -- 172.21.15.78:0/2375347653 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54800f670 con 0x7fb56012b180 2024-04-25T02:18:47.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb55effd700 1 -- 172.21.15.78:0/2375347653 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800f9f0 con 0x7fb56012b180 2024-04-25T02:18:47.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb566596700 1 -- 172.21.15.78:0/2375347653 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 msgr2=0x7fb56012fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:47.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb566596700 1 --2- 172.21.15.78:0/2375347653 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb56012fb00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb548009760 tx=0x7fb548009060).stop 2024-04-25T02:18:47.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb566596700 1 -- 172.21.15.78:0/2375347653 shutdown_connections 2024-04-25T02:18:47.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb566596700 1 --2- 172.21.15.78:0/2375347653 >> v2:172.21.15.78:3300/0 conn(0x7fb56012fff0 0x7fb5601323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb566596700 1 --2- 172.21.15.78:0/2375347653 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb56012fb00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb566596700 1 -- 172.21.15.78:0/2375347653 >> 172.21.15.78:0/2375347653 conn(0x7fb560096210 msgr2=0x7fb560096620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:47.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb566596700 1 -- 172.21.15.78:0/2375347653 shutdown_connections 2024-04-25T02:18:47.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.582+0000 7fb566596700 1 -- 172.21.15.78:0/2375347653 wait complete. 2024-04-25T02:18:47.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.583+0000 7fb566596700 1 Processor -- start 2024-04-25T02:18:47.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.583+0000 7fb566596700 1 -- start start 2024-04-25T02:18:47.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb566596700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb560069630 0x7fb560123cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb566596700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb5601241e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb566596700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56012fff0 0x7fb56010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb566596700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5601110e0 con 0x7fb56012fff0 2024-04-25T02:18:47.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb566596700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5601127d0 con 0x7fb56012b180 2024-04-25T02:18:47.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb566596700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb56012f8a0 con 0x7fb560069630 2024-04-25T02:18:47.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb55f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb5601241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb55f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb5601241e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46406/0 (socket says 172.21.15.78:46406) 2024-04-25T02:18:47.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb564b33700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56012fff0 0x7fb56010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb55f7fe700 1 -- 172.21.15.78:0/2344636551 learned_addr learned my addr 172.21.15.78:0/2344636551 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:47.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb55ffff700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb560069630 0x7fb560123cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb564b33700 1 -- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb560069630 msgr2=0x7fb560123cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:47.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb564b33700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb560069630 0x7fb560123cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb564b33700 1 -- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 msgr2=0x7fb5601241e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:47.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb564b33700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb5601241e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb564b33700 1 -- 172.21.15.78:0/2344636551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558009a20 con 0x7fb56012fff0 2024-04-25T02:18:47.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb55ffff700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb560069630 0x7fb560123cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:47.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb55f7fe700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb5601241e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:47.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.584+0000 7fb564b33700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56012fff0 0x7fb56010fd50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb558009f10 tx=0x7fb55800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:47.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.585+0000 7fb55cff9700 1 -- 172.21.15.78:0/2344636551 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800cb70 con 0x7fb56012fff0 2024-04-25T02:18:47.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.585+0000 7fb55cff9700 1 -- 172.21.15.78:0/2344636551 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55800f040 con 0x7fb56012fff0 2024-04-25T02:18:47.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.585+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5480092a0 con 0x7fb56012fff0 2024-04-25T02:18:47.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.585+0000 7fb55cff9700 1 -- 172.21.15.78:0/2344636551 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558013400 con 0x7fb56012fff0 2024-04-25T02:18:47.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.585+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb560111320 con 0x7fb56012fff0 2024-04-25T02:18:47.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.585+0000 7fb55cff9700 1 -- 172.21.15.78:0/2344636551 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fb5580137f0 con 0x7fb56012fff0 2024-04-25T02:18:47.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.585+0000 7fb55cff9700 1 -- 172.21.15.78:0/2344636551 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fb55803bd20 con 0x7fb56012fff0 2024-04-25T02:18:47.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.586+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5600992f0 con 0x7fb56012fff0 2024-04-25T02:18:47.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.590+0000 7fb55cff9700 1 -- 172.21.15.78:0/2344636551 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fb558007340 con 0x7fb56012fff0 2024-04-25T02:18:47.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.750+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb560096d30 con 0x7fb56012fff0 2024-04-25T02:18:47.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.751+0000 7fb55cff9700 1 -- 172.21.15.78:0/2344636551 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11609 (secure 0 0 0) 0x7fb55801cbb0 con 0x7fb56012fff0 2024-04-25T02:18:47.755 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:18:47.755 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:53.832053+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:18:47.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 >> v1:172.21.15.78:6816/46507 conn(0x7fb54002bd00 legacy=0x7fb54002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:47.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56012fff0 msgr2=0x7fb56010fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:47.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56012fff0 0x7fb56010fd50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb558009f10 tx=0x7fb55800b040).stop 2024-04-25T02:18:47.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 shutdown_connections 2024-04-25T02:18:47.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb56012fff0 0x7fb56010fd50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fb560069630 0x7fb560123cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 --2- 172.21.15.78:0/2344636551 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb56012b180 0x7fb5601241e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 >> 172.21.15.78:0/2344636551 conn(0x7fb560096210 msgr2=0x7fb5600627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:47.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 shutdown_connections 2024-04-25T02:18:47.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.752+0000 7fb566596700 1 -- 172.21.15.78:0/2344636551 wait complete. 2024-04-25T02:18:47.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:00.989685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:01.680090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:18:47.769 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:18:47.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.881+0000 7fddcb80f700 1 Processor -- start 2024-04-25T02:18:47.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.881+0000 7fddcb80f700 1 -- start start 2024-04-25T02:18:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.881+0000 7fddcb80f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095190 0x7fddc4095570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.881+0000 7fddcb80f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095a60 0x7fddc412c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.881+0000 7fddcb80f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddc412c4f0 0x7fddc412e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.881+0000 7fddcb80f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc4096570 con 0x7fddc412c4f0 2024-04-25T02:18:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.881+0000 7fddcb80f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40923f0 con 0x7fddc4095a60 2024-04-25T02:18:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.881+0000 7fddcb80f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddc4094c70 con 0x7fddc4095190 2024-04-25T02:18:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc8daa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095a60 0x7fddc412c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc9dac700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddc412c4f0 0x7fddc412e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc95ab700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095190 0x7fddc4095570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc8daa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095a60 0x7fddc412c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46418/0 (socket says 172.21.15.78:46418) 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc95ab700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095190 0x7fddc4095570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:38324/0 (socket says 172.21.15.78:38324) 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc9dac700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddc412c4f0 0x7fddc412e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42960/0 (socket says 172.21.15.78:42960) 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc8daa700 1 -- 172.21.15.78:0/2423435273 learned_addr learned my addr 172.21.15.78:0/2423435273 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc95ab700 1 -- 172.21.15.78:0/2423435273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095a60 msgr2=0x7fddc412c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc95ab700 1 --2- 172.21.15.78:0/2423435273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095a60 0x7fddc412c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc95ab700 1 -- 172.21.15.78:0/2423435273 >> v2:172.21.15.78:3300/0 conn(0x7fddc412c4f0 msgr2=0x7fddc412e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc95ab700 1 --2- 172.21.15.78:0/2423435273 >> v2:172.21.15.78:3300/0 conn(0x7fddc412c4f0 0x7fddc412e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc95ab700 1 -- 172.21.15.78:0/2423435273 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4096da0 con 0x7fddc4095190 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc8daa700 1 --2- 172.21.15.78:0/2423435273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095a60 0x7fddc412c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc9dac700 1 --2- 172.21.15.78:0/2423435273 >> v2:172.21.15.78:3300/0 conn(0x7fddc412c4f0 0x7fddc412e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:47.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddc95ab700 1 --2- 172.21.15.78:0/2423435273 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095190 0x7fddc4095570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fddb4009790 tx=0x7fddb4009060).ready entity=mon.2 client_cookie=14e599f188256b65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:47.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddbbfff700 1 -- 172.21.15.78:0/2423435273 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb40090d0 con 0x7fddc4095190 2024-04-25T02:18:47.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddbbfff700 1 -- 172.21.15.78:0/2423435273 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb400d4a0 con 0x7fddc4095190 2024-04-25T02:18:47.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.882+0000 7fddbbfff700 1 -- 172.21.15.78:0/2423435273 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb400d820 con 0x7fddc4095190 2024-04-25T02:18:47.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.883+0000 7fddcb80f700 1 -- 172.21.15.78:0/2423435273 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095190 msgr2=0x7fddc4095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:47.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.883+0000 7fddcb80f700 1 --2- 172.21.15.78:0/2423435273 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095190 0x7fddc4095570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fddb4009790 tx=0x7fddb4009060).stop 2024-04-25T02:18:47.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.883+0000 7fddcb80f700 1 -- 172.21.15.78:0/2423435273 shutdown_connections 2024-04-25T02:18:47.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.883+0000 7fddcb80f700 1 --2- 172.21.15.78:0/2423435273 >> v2:172.21.15.78:3300/0 conn(0x7fddc412c4f0 0x7fddc412e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.883+0000 7fddcb80f700 1 --2- 172.21.15.78:0/2423435273 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095190 0x7fddc4095570 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.883+0000 7fddcb80f700 1 --2- 172.21.15.78:0/2423435273 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095a60 0x7fddc412c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.883+0000 7fddcb80f700 1 -- 172.21.15.78:0/2423435273 >> 172.21.15.78:0/2423435273 conn(0x7fddc409a970 msgr2=0x7fddc409ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.883+0000 7fddcb80f700 1 -- 172.21.15.78:0/2423435273 shutdown_connections 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.883+0000 7fddcb80f700 1 -- 172.21.15.78:0/2423435273 wait complete. 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddcb80f700 1 Processor -- start 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddcb80f700 1 -- start start 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddcb80f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095190 0x7fddc411a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddcb80f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095a60 0x7fddc411a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddcb80f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc412c4f0 0x7fddc411ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddcb80f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc411b220 con 0x7fddc412c4f0 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddcb80f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc411b7e0 con 0x7fddc4095190 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddcb80f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddc406a090 con 0x7fddc4095a60 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddc95ab700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095190 0x7fddc411a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddc9dac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc412c4f0 0x7fddc411ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddc95ab700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095190 0x7fddc411a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46420/0 (socket says 172.21.15.78:46420) 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddc95ab700 1 -- 172.21.15.78:0/530026260 learned_addr learned my addr 172.21.15.78:0/530026260 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddc9dac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc412c4f0 0x7fddc411ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42966/0 (socket says 172.21.15.78:42966) 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.884+0000 7fddc8daa700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095a60 0x7fddc411a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddc95ab700 1 -- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095a60 msgr2=0x7fddc411a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddc95ab700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095a60 0x7fddc411a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddc95ab700 1 -- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc412c4f0 msgr2=0x7fddc411ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddc95ab700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc412c4f0 0x7fddc411ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddc95ab700 1 -- 172.21.15.78:0/530026260 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc000b610 con 0x7fddc4095190 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddc8daa700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095a60 0x7fddc411a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddc9dac700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc412c4f0 0x7fddc411ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddc95ab700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095190 0x7fddc411a350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fddc4094e00 tx=0x7fddb4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddb9ffb700 1 -- 172.21.15.78:0/530026260 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb40128a0 con 0x7fddc4095190 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddb9ffb700 1 -- 172.21.15.78:0/530026260 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4012a00 con 0x7fddc4095190 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc009a20 con 0x7fddc4095190 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddb9ffb700 1 -- 172.21.15.78:0/530026260 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4012dc0 con 0x7fddc4095190 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.885+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb40092a0 con 0x7fddc4095190 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.886+0000 7fddb9ffb700 1 -- 172.21.15.78:0/530026260 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fddb401c630 con 0x7fddc4095190 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.886+0000 7fddb9ffb700 1 -- 172.21.15.78:0/530026260 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fddb403c770 con 0x7fddc4095190 2024-04-25T02:18:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.886+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc411db20 con 0x7fddc4095190 2024-04-25T02:18:47.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:47.891+0000 7fddb9ffb700 1 -- 172.21.15.78:0/530026260 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fddc411db20 con 0x7fddc4095190 2024-04-25T02:18:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.045+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fddc411db20 con 0x7fddc4095190 2024-04-25T02:18:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.046+0000 7fddb9ffb700 1 -- 172.21.15.78:0/530026260 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7fddc411db20 con 0x7fddc4095190 2024-04-25T02:18:48.050 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:18:48.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 >> v1:172.21.15.78:6816/46507 conn(0x7fdda802bd30 legacy=0x7fdda802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095190 msgr2=0x7fddc411a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095190 0x7fddc411a350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fddc4094e00 tx=0x7fddb4016000).stop 2024-04-25T02:18:48.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 shutdown_connections 2024-04-25T02:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc412c4f0 0x7fddc411ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fddc4095190 0x7fddc411a350 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 --2- 172.21.15.78:0/530026260 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fddc4095a60 0x7fddc411a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 >> 172.21.15.78:0/530026260 conn(0x7fddc409a970 msgr2=0x7fddc4098690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 shutdown_connections 2024-04-25T02:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.048+0000 7fddcb80f700 1 -- 172.21.15.78:0/530026260 wait complete. 2024-04-25T02:18:48.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:18:48.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.176+0000 7f582b953700 1 Processor -- start 2024-04-25T02:18:48.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.176+0000 7f582b953700 1 -- start start 2024-04-25T02:18:48.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f582b953700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5824095190 0x7f5824095570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f582b953700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5824095a60 0x7f582412c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f582b953700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f582412c4f0 0x7f582412e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f582b953700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5824096570 con 0x7f5824095190 2024-04-25T02:18:48.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f582b953700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58240923f0 con 0x7f5824095a60 2024-04-25T02:18:48.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f582b953700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5824094c70 con 0x7f582412c4f0 2024-04-25T02:18:48.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f58296ef700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5824095190 0x7f5824095570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5828eee700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5824095a60 0x7f582412c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5829ef0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f582412c4f0 0x7f582412e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f58296ef700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5824095190 0x7f5824095570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42976/0 (socket says 172.21.15.78:42976) 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f58296ef700 1 -- 172.21.15.78:0/993300086 learned_addr learned my addr 172.21.15.78:0/993300086 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5829ef0700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f582412c4f0 0x7f582412e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:38342/0 (socket says 172.21.15.78:38342) 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5828eee700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5824095a60 0x7f582412c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46428/0 (socket says 172.21.15.78:46428) 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5828eee700 1 -- 172.21.15.78:0/993300086 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f582412c4f0 msgr2=0x7f582412e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5828eee700 1 --2- 172.21.15.78:0/993300086 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f582412c4f0 0x7f582412e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5828eee700 1 -- 172.21.15.78:0/993300086 >> v2:172.21.15.78:3300/0 conn(0x7f5824095190 msgr2=0x7f5824095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5828eee700 1 --2- 172.21.15.78:0/993300086 >> v2:172.21.15.78:3300/0 conn(0x7f5824095190 0x7f5824095570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5828eee700 1 -- 172.21.15.78:0/993300086 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824096da0 con 0x7f5824095a60 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f5829ef0700 1 --2- 172.21.15.78:0/993300086 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f582412c4f0 0x7f582412e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.177+0000 7f58296ef700 1 --2- 172.21.15.78:0/993300086 >> v2:172.21.15.78:3300/0 conn(0x7f5824095190 0x7f5824095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:48.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f5828eee700 1 --2- 172.21.15.78:0/993300086 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5824095a60 0x7f582412c000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f5820009760 tx=0x7f5820009060).ready entity=mon.1 client_cookie=9f9bfdb5f5ede7df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f581bfff700 1 -- 172.21.15.78:0/993300086 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200090d0 con 0x7f5824095a60 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f581bfff700 1 -- 172.21.15.78:0/993300086 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000d4a0 con 0x7f5824095a60 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f581bfff700 1 -- 172.21.15.78:0/993300086 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000d820 con 0x7f5824095a60 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f582b953700 1 -- 172.21.15.78:0/993300086 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5824095a60 msgr2=0x7f582412c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f582b953700 1 --2- 172.21.15.78:0/993300086 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5824095a60 0x7f582412c000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f5820009760 tx=0x7f5820009060).stop 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f582b953700 1 -- 172.21.15.78:0/993300086 shutdown_connections 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f582b953700 1 --2- 172.21.15.78:0/993300086 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f582412c4f0 0x7f582412e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f582b953700 1 --2- 172.21.15.78:0/993300086 >> v2:172.21.15.78:3300/0 conn(0x7f5824095190 0x7f5824095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f582b953700 1 --2- 172.21.15.78:0/993300086 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5824095a60 0x7f582412c000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f582b953700 1 -- 172.21.15.78:0/993300086 >> 172.21.15.78:0/993300086 conn(0x7f582409a970 msgr2=0x7f582409ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f582b953700 1 -- 172.21.15.78:0/993300086 shutdown_connections 2024-04-25T02:18:48.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.178+0000 7f582b953700 1 -- 172.21.15.78:0/993300086 wait complete. 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.179+0000 7f582b953700 1 Processor -- start 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.179+0000 7f582b953700 1 -- start start 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f582b953700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824095190 0x7f582412bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f582b953700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5824095a60 0x7f5824115e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f582b953700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f582412c4f0 0x7f5824116370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f582b953700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582411a2e0 con 0x7f5824095190 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f582b953700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5824119e30 con 0x7f582412c4f0 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f582b953700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5824119100 con 0x7f5824095a60 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f58296ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824095190 0x7f582412bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f58296ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824095190 0x7f582412bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42986/0 (socket says 172.21.15.78:42986) 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f58296ef700 1 -- 172.21.15.78:0/2066590078 learned_addr learned my addr 172.21.15.78:0/2066590078 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f5828eee700 1 --2- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5824095a60 0x7f5824115e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f5829ef0700 1 --2- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f582412c4f0 0x7f5824116370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f58296ef700 1 -- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5824095a60 msgr2=0x7f5824115e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f58296ef700 1 --2- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5824095a60 0x7f5824115e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f58296ef700 1 -- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f582412c4f0 msgr2=0x7f5824116370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.180+0000 7f58296ef700 1 --2- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f582412c4f0 0x7f5824116370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.181+0000 7f58296ef700 1 -- 172.21.15.78:0/2066590078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581400b610 con 0x7f5824095190 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.181+0000 7f58296ef700 1 --2- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824095190 0x7f582412bf10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f5814010e90 tx=0x7f581400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.181+0000 7f5819ffb700 1 -- 172.21.15.78:0/2066590078 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581400ece0 con 0x7f5824095190 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.181+0000 7f5819ffb700 1 -- 172.21.15.78:0/2066590078 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581400ee40 con 0x7f5824095190 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.181+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c009a20 con 0x7f5824095190 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.181+0000 7f5819ffb700 1 -- 172.21.15.78:0/2066590078 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581401a680 con 0x7f5824095190 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.181+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58200092a0 con 0x7f5824095190 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.182+0000 7f5819ffb700 1 -- 172.21.15.78:0/2066590078 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f5814017070 con 0x7f5824095190 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.182+0000 7f5819ffb700 1 -- 172.21.15.78:0/2066590078 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f581403dfb0 con 0x7f5824095190 2024-04-25T02:18:48.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.182+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58241192f0 con 0x7f5824095190 2024-04-25T02:18:48.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.186+0000 7f5819ffb700 1 -- 172.21.15.78:0/2066590078 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f58241192f0 con 0x7f5824095190 2024-04-25T02:18:48.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.351+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f58241192f0 con 0x7f5824095190 2024-04-25T02:18:48.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.351+0000 7f5819ffb700 1 -- 172.21.15.78:0/2066590078 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f58241192f0 con 0x7f5824095190 2024-04-25T02:18:48.355 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:18:48.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 >> v1:172.21.15.78:6816/46507 conn(0x7f580802bd00 legacy=0x7f580802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824095190 msgr2=0x7f582412bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 --2- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824095190 0x7f582412bf10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f5814010e90 tx=0x7f581400b3b0).stop 2024-04-25T02:18:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 shutdown_connections 2024-04-25T02:18:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 --2- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f582412c4f0 0x7f5824116370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 --2- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5824095190 0x7f582412bf10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 --2- 172.21.15.78:0/2066590078 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5824095a60 0x7f5824115e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 >> 172.21.15.78:0/2066590078 conn(0x7f582409a970 msgr2=0x7f5824098690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 shutdown_connections 2024-04-25T02:18:48.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.353+0000 7f582b953700 1 -- 172.21.15.78:0/2066590078 wait complete. 2024-04-25T02:18:48.370 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.523+0000 7ffa7d386700 1 Processor -- start 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa7d386700 1 -- start start 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa7d386700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78064b70 0x7ffa78098840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa7d386700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa78099130 0x7ffa7812aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa7d386700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa78091c40 con 0x7ffa78098d30 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa7d386700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa78064f50 con 0x7ffa78099130 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa7d386700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78065930 con 0x7ffa78064b70 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa76ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78064b70 0x7ffa78098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa777fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa78099130 0x7ffa7812aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa767fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ffa78098d30 0x7ffa7812a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52838/0 (socket says 172.21.15.78:52838) 2024-04-25T02:18:48.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa777fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa78099130 0x7ffa7812aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42990/0 (socket says 172.21.15.78:42990) 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa767fc700 1 -- 172.21.15.78:0/1706257345 learned_addr learned my addr 172.21.15.78:0/1706257345 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa76ffd700 1 --2- 172.21.15.78:0/1706257345 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78064b70 0x7ffa78098840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46444/0 (socket says 172.21.15.78:46444) 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa76ffd700 1 -- 172.21.15.78:0/1706257345 >> v2:172.21.15.78:3300/0 conn(0x7ffa78099130 msgr2=0x7ffa7812aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa76ffd700 1 --2- 172.21.15.78:0/1706257345 >> v2:172.21.15.78:3300/0 conn(0x7ffa78099130 0x7ffa7812aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa76ffd700 1 -- 172.21.15.78:0/1706257345 >> v1:172.21.15.78:6789/0 conn(0x7ffa78098d30 legacy=0x7ffa7812a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa76ffd700 1 -- 172.21.15.78:0/1706257345 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78098530 con 0x7ffa78064b70 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.524+0000 7ffa777fe700 1 --2- 172.21.15.78:0/1706257345 >> v2:172.21.15.78:3300/0 conn(0x7ffa78099130 0x7ffa7812aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa76ffd700 1 --2- 172.21.15.78:0/1706257345 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78064b70 0x7ffa78098840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ffa6c009790 tx=0x7ffa6c009060).ready entity=mon.1 client_cookie=f2b8c447b5dd5fec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa75ffb700 1 -- 172.21.15.78:0/1706257345 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00f510 con 0x7ffa78064b70 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa75ffb700 1 -- 172.21.15.78:0/1706257345 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c00f670 con 0x7ffa78064b70 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa75ffb700 1 -- 172.21.15.78:0/1706257345 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00f9f0 con 0x7ffa78064b70 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa7d386700 1 -- 172.21.15.78:0/1706257345 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78064b70 msgr2=0x7ffa78098840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa7d386700 1 --2- 172.21.15.78:0/1706257345 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78064b70 0x7ffa78098840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ffa6c009790 tx=0x7ffa6c009060).stop 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa7d386700 1 -- 172.21.15.78:0/1706257345 shutdown_connections 2024-04-25T02:18:48.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa7d386700 1 --2- 172.21.15.78:0/1706257345 >> v2:172.21.15.78:3300/0 conn(0x7ffa78099130 0x7ffa7812aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa7d386700 1 --2- 172.21.15.78:0/1706257345 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78064b70 0x7ffa78098840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa7d386700 1 -- 172.21.15.78:0/1706257345 >> 172.21.15.78:0/1706257345 conn(0x7ffa7809e7a0 msgr2=0x7ffa7809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:48.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa7d386700 1 -- 172.21.15.78:0/1706257345 shutdown_connections 2024-04-25T02:18:48.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.525+0000 7ffa7d386700 1 -- 172.21.15.78:0/1706257345 wait complete. 2024-04-25T02:18:48.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa7d386700 1 Processor -- start 2024-04-25T02:18:48.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa7d386700 1 -- start start 2024-04-25T02:18:48.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa7d386700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa78098d30 0x7ffa7811ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa7d386700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78099130 0x7ffa78116e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa7d386700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ffa78117350 0x7ffa781177d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa7d386700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78118300 con 0x7ffa78098d30 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa7d386700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78127f30 con 0x7ffa78099130 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa7d386700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78099a80 con 0x7ffa78117350 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa76ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa78098d30 0x7ffa7811ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa76ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa78098d30 0x7ffa7811ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42996/0 (socket says 172.21.15.78:42996) 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa76ffd700 1 -- 172.21.15.78:0/1856679608 learned_addr learned my addr 172.21.15.78:0/1856679608 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa767fc700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78099130 0x7ffa78116e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.527+0000 7ffa777fe700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ffa78117350 0x7ffa781177d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa76ffd700 1 -- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ffa78117350 msgr2=0x7ffa781177d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa76ffd700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ffa78117350 0x7ffa781177d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa76ffd700 1 -- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78099130 msgr2=0x7ffa78116e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa76ffd700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78099130 0x7ffa78116e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa76ffd700 1 -- 172.21.15.78:0/1856679608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70009a20 con 0x7ffa78098d30 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa777fe700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ffa78117350 0x7ffa781177d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa767fc700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78099130 0x7ffa78116e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa76ffd700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa78098d30 0x7ffa7811ae00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7ffa6c009e30 tx=0x7ffa6c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa5f7fe700 1 -- 172.21.15.78:0/1856679608 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00f9f0 con 0x7ffa78098d30 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa5f7fe700 1 -- 172.21.15.78:0/1856679608 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c000c90 con 0x7ffa78098d30 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c0092a0 con 0x7ffa78098d30 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa5f7fe700 1 -- 172.21.15.78:0/1856679608 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c01b660 con 0x7ffa78098d30 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.528+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7811a360 con 0x7ffa78098d30 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.529+0000 7ffa5f7fe700 1 -- 172.21.15.78:0/1856679608 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7ffa6c01ba10 con 0x7ffa78098d30 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.529+0000 7ffa5f7fe700 1 -- 172.21.15.78:0/1856679608 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7ffa6c03ce00 con 0x7ffa78098d30 2024-04-25T02:18:48.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.529+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa78129230 con 0x7ffa78098d30 2024-04-25T02:18:48.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.534+0000 7ffa5f7fe700 1 -- 172.21.15.78:0/1856679608 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7ffa6c018320 con 0x7ffa78098d30 2024-04-25T02:18:48.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.690+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa78128c50 con 0x7ffa78098d30 2024-04-25T02:18:48.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.691+0000 7ffa5f7fe700 1 -- 172.21.15.78:0/1856679608 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa6c019b70 con 0x7ffa78098d30 2024-04-25T02:18:48.695 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 >> v1:172.21.15.78:6816/46507 conn(0x7ffa6402bd00 legacy=0x7ffa6402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa78098d30 msgr2=0x7ffa7811ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa78098d30 0x7ffa7811ae00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7ffa6c009e30 tx=0x7ffa6c017000).stop 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 shutdown_connections 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7ffa78117350 0x7ffa781177d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa78098d30 0x7ffa7811ae00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 --2- 172.21.15.78:0/1856679608 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa78099130 0x7ffa78116e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 >> 172.21.15.78:0/1856679608 conn(0x7ffa78064b70 msgr2=0x7ffa78097280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 shutdown_connections 2024-04-25T02:18:48.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.692+0000 7ffa7d386700 1 -- 172.21.15.78:0/1856679608 wait complete. 2024-04-25T02:18:48.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:18:48.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41bc6f1700 1 Processor -- start 2024-04-25T02:18:48.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41bc6f1700 1 -- start start 2024-04-25T02:18:48.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41bc6f1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41b4065d60 0x7f41b40972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41bc6f1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127fb0 0x7f41b412afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41bc6f1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b40652a0 con 0x7f41b4127b70 2024-04-25T02:18:48.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41bc6f1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b4066140 con 0x7f41b4065d60 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41bc6f1700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40649e0 con 0x7f41b4127fb0 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41bac8e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127fb0 0x7f41b412afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41ba48d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41b4065d60 0x7f41b40972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.821+0000 7f41b9c8c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f41b4127b70 0x7f41b412a8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52854/0 (socket says 172.21.15.78:52854) 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41b9c8c700 1 -- 172.21.15.78:0/1133697520 learned_addr learned my addr 172.21.15.78:0/1133697520 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41ba48d700 1 -- 172.21.15.78:0/1133697520 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127fb0 msgr2=0x7f41b412afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41ba48d700 1 --2- 172.21.15.78:0/1133697520 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127fb0 0x7f41b412afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41ba48d700 1 -- 172.21.15.78:0/1133697520 >> v1:172.21.15.78:6789/0 conn(0x7f41b4127b70 legacy=0x7f41b412a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41b948b700 1 -- 172.21.15.78:0/1133697520 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109073347 0 0) 0x7f41b40652a0 con 0x7f41b4127b70 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41ba48d700 1 -- 172.21.15.78:0/1133697520 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b4097fb0 con 0x7f41b4065d60 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41bac8e700 1 --2- 172.21.15.78:0/1133697520 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127fb0 0x7f41b412afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41ba48d700 1 --2- 172.21.15.78:0/1133697520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4065d60 0x7f41b40972f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f41b0009760 tx=0x7f41b0009060).ready entity=mon.0 client_cookie=ba4407bd27a30188 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41b948b700 1 -- 172.21.15.78:0/1133697520 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000f510 con 0x7f41b4065d60 2024-04-25T02:18:48.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41b948b700 1 -- 172.21.15.78:0/1133697520 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b000f670 con 0x7f41b4065d60 2024-04-25T02:18:48.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.822+0000 7f41b948b700 1 -- 172.21.15.78:0/1133697520 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000f9f0 con 0x7f41b4065d60 2024-04-25T02:18:48.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.823+0000 7f41bc6f1700 1 -- 172.21.15.78:0/1133697520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4065d60 msgr2=0x7f41b40972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.823+0000 7f41bc6f1700 1 --2- 172.21.15.78:0/1133697520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4065d60 0x7f41b40972f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f41b0009760 tx=0x7f41b0009060).stop 2024-04-25T02:18:48.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.823+0000 7f41bc6f1700 1 -- 172.21.15.78:0/1133697520 shutdown_connections 2024-04-25T02:18:48.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.823+0000 7f41bc6f1700 1 --2- 172.21.15.78:0/1133697520 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127fb0 0x7f41b412afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.823+0000 7f41bc6f1700 1 --2- 172.21.15.78:0/1133697520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4065d60 0x7f41b40972f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.823+0000 7f41bc6f1700 1 -- 172.21.15.78:0/1133697520 >> 172.21.15.78:0/1133697520 conn(0x7f41b409ba80 msgr2=0x7f41b409be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:48.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.823+0000 7f41bc6f1700 1 -- 172.21.15.78:0/1133697520 shutdown_connections 2024-04-25T02:18:48.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.823+0000 7f41bc6f1700 1 -- 172.21.15.78:0/1133697520 wait complete. 2024-04-25T02:18:48.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bc6f1700 1 Processor -- start 2024-04-25T02:18:48.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bc6f1700 1 -- start start 2024-04-25T02:18:48.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bc6f1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41b4065d60 0x7f41b4117b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bc6f1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127b70 0x7f41b4113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bc6f1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4127fb0 0x7f41b4114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bc6f1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b41176d0 con 0x7f41b4127fb0 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bc6f1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4115020 con 0x7f41b4065d60 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bc6f1700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4064c10 con 0x7f41b4127b70 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bac8e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4127fb0 0x7f41b4114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41ba48d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41b4065d60 0x7f41b4117b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41b9c8c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127b70 0x7f41b4113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bac8e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4127fb0 0x7f41b4114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43022/0 (socket says 172.21.15.78:43022) 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bac8e700 1 -- 172.21.15.78:0/628859704 learned_addr learned my addr 172.21.15.78:0/628859704 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bac8e700 1 -- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127b70 msgr2=0x7f41b4113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bac8e700 1 --2- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127b70 0x7f41b4113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bac8e700 1 -- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41b4065d60 msgr2=0x7f41b4117b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bac8e700 1 --2- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41b4065d60 0x7f41b4117b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.824+0000 7f41bac8e700 1 -- 172.21.15.78:0/628859704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac009a20 con 0x7f41b4127fb0 2024-04-25T02:18:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.825+0000 7f41bac8e700 1 --2- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4127fb0 0x7f41b4114070 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f41ac00c0f0 tx=0x7f41ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.825+0000 7f41aaffd700 1 -- 172.21.15.78:0/628859704 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00cc30 con 0x7f41b4127fb0 2024-04-25T02:18:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.825+0000 7f41aaffd700 1 -- 172.21.15.78:0/628859704 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac00f040 con 0x7f41b4127fb0 2024-04-25T02:18:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.825+0000 7f41aaffd700 1 -- 172.21.15.78:0/628859704 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac013400 con 0x7f41b4127fb0 2024-04-25T02:18:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.825+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b00092a0 con 0x7f41b4127fb0 2024-04-25T02:18:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.825+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b4115750 con 0x7f41b4127fb0 2024-04-25T02:18:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.825+0000 7f41aaffd700 1 -- 172.21.15.78:0/628859704 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f41ac0137f0 con 0x7f41b4127fb0 2024-04-25T02:18:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.825+0000 7f41aaffd700 1 -- 172.21.15.78:0/628859704 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f41ac03bb90 con 0x7f41b4127fb0 2024-04-25T02:18:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.826+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b4115910 con 0x7f41b4127fb0 2024-04-25T02:18:48.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.830+0000 7f41aaffd700 1 -- 172.21.15.78:0/628859704 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f41ac013aa0 con 0x7f41b4127fb0 2024-04-25T02:18:48.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.986+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41b4099f40 con 0x7f41b4127fb0 2024-04-25T02:18:48.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.986+0000 7f41aaffd700 1 -- 172.21.15.78:0/628859704 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41ac02c0a0 con 0x7f41b4127fb0 2024-04-25T02:18:48.991 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-25T02:18:48.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 >> v1:172.21.15.78:6816/46507 conn(0x7f419802bd00 legacy=0x7f419802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4127fb0 msgr2=0x7f41b4114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 --2- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4127fb0 0x7f41b4114070 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f41ac00c0f0 tx=0x7f41ac00b040).stop 2024-04-25T02:18:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 shutdown_connections 2024-04-25T02:18:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 --2- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b4127fb0 0x7f41b4114070 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 --2- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41b4065d60 0x7f41b4117b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 --2- 172.21.15.78:0/628859704 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f41b4127b70 0x7f41b4113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 >> 172.21.15.78:0/628859704 conn(0x7f41b409ba80 msgr2=0x7f41b4069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 shutdown_connections 2024-04-25T02:18:48.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:48.988+0000 7f41bc6f1700 1 -- 172.21.15.78:0/628859704 wait complete. 2024-04-25T02:18:49.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:18:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f290c5e3700 1 Processor -- start 2024-04-25T02:18:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f290c5e3700 1 -- start start 2024-04-25T02:18:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f290c5e3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2904098e40 0x7f2904099220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f290c5e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904130860 0x7f2904132c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f290c5e3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2904092070 con 0x7f2904099710 2024-04-25T02:18:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f290c5e3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2904092ff0 con 0x7f2904098e40 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f290c5e3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29040978e0 con 0x7f2904130860 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f290ab80700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904130860 0x7f2904132c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f290a37f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2904098e40 0x7f2904099220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.117+0000 7f2909b7e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2904099710 0x7f290412f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52856/0 (socket says 172.21.15.78:52856) 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f2909b7e700 1 -- 172.21.15.78:0/2000170592 learned_addr learned my addr 172.21.15.78:0/2000170592 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290ab80700 1 -- 172.21.15.78:0/2000170592 >> v2:172.21.15.78:3300/0 conn(0x7f2904098e40 msgr2=0x7f2904099220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290937d700 1 -- 172.21.15.78:0/2000170592 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194079537 0 0) 0x7f2904092070 con 0x7f2904099710 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290ab80700 1 --2- 172.21.15.78:0/2000170592 >> v2:172.21.15.78:3300/0 conn(0x7f2904098e40 0x7f2904099220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290ab80700 1 -- 172.21.15.78:0/2000170592 >> v1:172.21.15.78:6789/0 conn(0x7f2904099710 legacy=0x7f290412f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290ab80700 1 -- 172.21.15.78:0/2000170592 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2904090e50 con 0x7f2904130860 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290a37f700 1 --2- 172.21.15.78:0/2000170592 >> v2:172.21.15.78:3300/0 conn(0x7f2904098e40 0x7f2904099220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290ab80700 1 --2- 172.21.15.78:0/2000170592 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904130860 0x7f2904132c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f28fc009e60 tx=0x7f28fc009780).ready entity=mon.1 client_cookie=481d6e896813a0d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290937d700 1 -- 172.21.15.78:0/2000170592 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc00e070 con 0x7f2904130860 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290937d700 1 -- 172.21.15.78:0/2000170592 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc00bb60 con 0x7f2904130860 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.118+0000 7f290937d700 1 -- 172.21.15.78:0/2000170592 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc012410 con 0x7f2904130860 2024-04-25T02:18:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.119+0000 7f290c5e3700 1 -- 172.21.15.78:0/2000170592 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904130860 msgr2=0x7f2904132c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.119+0000 7f290c5e3700 1 --2- 172.21.15.78:0/2000170592 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904130860 0x7f2904132c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f28fc009e60 tx=0x7f28fc009780).stop 2024-04-25T02:18:49.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.119+0000 7f290c5e3700 1 -- 172.21.15.78:0/2000170592 shutdown_connections 2024-04-25T02:18:49.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.119+0000 7f290c5e3700 1 --2- 172.21.15.78:0/2000170592 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904130860 0x7f2904132c50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.119+0000 7f290c5e3700 1 --2- 172.21.15.78:0/2000170592 >> v2:172.21.15.78:3300/0 conn(0x7f2904098e40 0x7f2904099220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.119+0000 7f290c5e3700 1 -- 172.21.15.78:0/2000170592 >> 172.21.15.78:0/2000170592 conn(0x7f29040974d0 msgr2=0x7f2904099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:49.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.119+0000 7f290c5e3700 1 -- 172.21.15.78:0/2000170592 shutdown_connections 2024-04-25T02:18:49.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.119+0000 7f290c5e3700 1 -- 172.21.15.78:0/2000170592 wait complete. 2024-04-25T02:18:49.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.119+0000 7f290c5e3700 1 Processor -- start 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290c5e3700 1 -- start start 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290c5e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904098e40 0x7f290408ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290c5e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2904099710 0x7f290408fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290c5e3700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2904130860 0x7f290408b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290c5e3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904091ac0 con 0x7f2904099710 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290c5e3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290408f6e0 con 0x7f2904098e40 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290c5e3700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f290408ea60 con 0x7f2904130860 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290a37f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904098e40 0x7f290408ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f2909b7e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2904099710 0x7f290408fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290a37f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904098e40 0x7f290408ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46472/0 (socket says 172.21.15.78:46472) 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290a37f700 1 -- 172.21.15.78:0/979896002 learned_addr learned my addr 172.21.15.78:0/979896002 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290ab80700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2904130860 0x7f290408b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f2909b7e700 1 -- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2904130860 msgr2=0x7f290408b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f2909b7e700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2904130860 0x7f290408b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f2909b7e700 1 -- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904098e40 msgr2=0x7f290408ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f2909b7e700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904098e40 0x7f290408ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f2909b7e700 1 -- 172.21.15.78:0/979896002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000092a0 con 0x7f2904099710 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290a37f700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904098e40 0x7f290408ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f290ab80700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2904130860 0x7f290408b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.120+0000 7f2909b7e700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2904099710 0x7f290408fac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f28f4000c00 tx=0x7f28f4007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.121+0000 7f28faffd700 1 -- 172.21.15.78:0/979896002 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f40070d0 con 0x7f2904099710 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.121+0000 7f28faffd700 1 -- 172.21.15.78:0/979896002 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f4007250 con 0x7f2904099710 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.121+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc009a20 con 0x7f2904099710 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.121+0000 7f28faffd700 1 -- 172.21.15.78:0/979896002 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4007610 con 0x7f2904099710 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.121+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290408cd10 con 0x7f2904099710 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.122+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290408e8a0 con 0x7f2904099710 2024-04-25T02:18:49.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.122+0000 7f28faffd700 1 -- 172.21.15.78:0/979896002 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f28f40059b0 con 0x7f2904099710 2024-04-25T02:18:49.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.122+0000 7f28faffd700 1 -- 172.21.15.78:0/979896002 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f28f403a860 con 0x7f2904099710 2024-04-25T02:18:49.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.126+0000 7f28faffd700 1 -- 172.21.15.78:0/979896002 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f28f4013970 con 0x7f2904099710 2024-04-25T02:18:49.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.298+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f290409a660 con 0x7f2904099710 2024-04-25T02:18:49.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.298+0000 7f28faffd700 1 -- 172.21.15.78:0/979896002 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v19) v1 ==== 80+0+0 (secure 0 0 0) 0x7f28f4010300 con 0x7f2904099710 2024-04-25T02:18:49.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 >> v1:172.21.15.78:6816/46507 conn(0x7f28e802bd00 legacy=0x7f28e802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2904099710 msgr2=0x7f290408fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2904099710 0x7f290408fac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f28f4000c00 tx=0x7f28f4007b90).stop 2024-04-25T02:18:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 shutdown_connections 2024-04-25T02:18:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2904130860 0x7f290408b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2904098e40 0x7f290408ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 --2- 172.21.15.78:0/979896002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2904099710 0x7f290408fac0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 >> 172.21.15.78:0/979896002 conn(0x7f29040974d0 msgr2=0x7f2904093390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 shutdown_connections 2024-04-25T02:18:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.300+0000 7f290c5e3700 1 -- 172.21.15.78:0/979896002 wait complete. 2024-04-25T02:18:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-04-25T02:18:49.315 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:18:49.315 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:49.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:18:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda26006700 1 Processor -- start 2024-04-25T02:18:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda26006700 1 -- start start 2024-04-25T02:18:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda26006700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda201279d0 0x7fda20127db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda26006700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda20099550 0x7fda2012faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda26006700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda20093180 con 0x7fda201282a0 2024-04-25T02:18:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda26006700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda20094120 con 0x7fda201279d0 2024-04-25T02:18:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda26006700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda20092a80 con 0x7fda20099550 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1ffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda20099550 0x7fda2012faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda201279d0 0x7fda20127db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1ffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda20099550 0x7fda2012faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46486/0 (socket says 172.21.15.78:46486) 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1ffff700 1 -- 172.21.15.78:0/3442903933 learned_addr learned my addr 172.21.15.78:0/3442903933 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1effd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fda201282a0 0x7fda20098e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52872/0 (socket says 172.21.15.78:52872) 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1f7fe700 1 -- 172.21.15.78:0/3442903933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda20099550 msgr2=0x7fda2012faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1f7fe700 1 --2- 172.21.15.78:0/3442903933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda20099550 0x7fda2012faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1f7fe700 1 -- 172.21.15.78:0/3442903933 >> v1:172.21.15.78:6789/0 conn(0x7fda201282a0 legacy=0x7fda20098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1f7fe700 1 -- 172.21.15.78:0/3442903933 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20093440 con 0x7fda201279d0 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1e7fc700 1 -- 172.21.15.78:0/3442903933 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870378534 0 0) 0x7fda20093180 con 0x7fda201282a0 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.447+0000 7fda1ffff700 1 --2- 172.21.15.78:0/3442903933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda20099550 0x7fda2012faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda1f7fe700 1 --2- 172.21.15.78:0/3442903933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 0x7fda20127db0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fda08009760 tx=0x7fda08009060).ready entity=mon.0 client_cookie=1ee600b8a0de975 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda1e7fc700 1 -- 172.21.15.78:0/3442903933 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0800f510 con 0x7fda201279d0 2024-04-25T02:18:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda1e7fc700 1 -- 172.21.15.78:0/3442903933 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0800f670 con 0x7fda201279d0 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda1e7fc700 1 -- 172.21.15.78:0/3442903933 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0800f9f0 con 0x7fda201279d0 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda26006700 1 -- 172.21.15.78:0/3442903933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 msgr2=0x7fda20127db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda26006700 1 --2- 172.21.15.78:0/3442903933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 0x7fda20127db0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fda08009760 tx=0x7fda08009060).stop 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda26006700 1 -- 172.21.15.78:0/3442903933 shutdown_connections 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda26006700 1 --2- 172.21.15.78:0/3442903933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda20099550 0x7fda2012faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda26006700 1 --2- 172.21.15.78:0/3442903933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 0x7fda20127db0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda26006700 1 -- 172.21.15.78:0/3442903933 >> 172.21.15.78:0/3442903933 conn(0x7fda200974d0 msgr2=0x7fda20099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda26006700 1 -- 172.21.15.78:0/3442903933 shutdown_connections 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.448+0000 7fda26006700 1 -- 172.21.15.78:0/3442903933 wait complete. 2024-04-25T02:18:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.449+0000 7fda26006700 1 Processor -- start 2024-04-25T02:18:49.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.449+0000 7fda26006700 1 -- start start 2024-04-25T02:18:49.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda26006700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fda20099550 0x7fda20120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda26006700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 0x7fda20121010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda26006700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda201282a0 0x7fda20121500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda26006700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda20090b20 con 0x7fda201279d0 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda26006700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda20124600 con 0x7fda201282a0 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda26006700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda20095180 con 0x7fda20099550 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 0x7fda20121010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1ffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda201282a0 0x7fda20121500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 0x7fda20121010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43046/0 (socket says 172.21.15.78:43046) 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1effd700 1 -- 172.21.15.78:0/578432339 learned_addr learned my addr 172.21.15.78:0/578432339 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1f7fe700 1 --2- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fda20099550 0x7fda20120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1effd700 1 -- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fda20099550 msgr2=0x7fda20120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1effd700 1 --2- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fda20099550 0x7fda20120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1effd700 1 -- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda201282a0 msgr2=0x7fda20121500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1effd700 1 --2- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda201282a0 0x7fda20121500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1effd700 1 -- 172.21.15.78:0/578432339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1800bcf0 con 0x7fda201279d0 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda1effd700 1 --2- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 0x7fda20121010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fda1000c4c0 tx=0x7fda10007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda17fff700 1 -- 172.21.15.78:0/578432339 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1000ce30 con 0x7fda201279d0 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda17fff700 1 -- 172.21.15.78:0/578432339 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda100072e0 con 0x7fda201279d0 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda080092a0 con 0x7fda201279d0 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda17fff700 1 -- 172.21.15.78:0/578432339 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda100056e0 con 0x7fda201279d0 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.450+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda20124ea0 con 0x7fda201279d0 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.451+0000 7fda17fff700 1 -- 172.21.15.78:0/578432339 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fda10005a90 con 0x7fda201279d0 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.451+0000 7fda17fff700 1 -- 172.21.15.78:0/578432339 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fda1003a810 con 0x7fda201279d0 2024-04-25T02:18:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.451+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda20124ea0 con 0x7fda201279d0 2024-04-25T02:18:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.456+0000 7fda17fff700 1 -- 172.21.15.78:0/578432339 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fda20124ea0 con 0x7fda201279d0 2024-04-25T02:18:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.616+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda20124260 con 0x7fda201279d0 2024-04-25T02:18:49.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.617+0000 7fda17fff700 1 -- 172.21.15.78:0/578432339 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11609 (secure 0 0 0) 0x7fda20124260 con 0x7fda201279d0 2024-04-25T02:18:49.621 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:18:49.621 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:53.832053+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:18:49.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 >> v1:172.21.15.78:6816/46507 conn(0x7fda0002bd00 legacy=0x7fda0002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 msgr2=0x7fda20121010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 --2- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 0x7fda20121010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fda1000c4c0 tx=0x7fda10007c10).stop 2024-04-25T02:18:49.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 shutdown_connections 2024-04-25T02:18:49.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 --2- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda201282a0 0x7fda20121500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 --2- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fda20099550 0x7fda20120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 --2- 172.21.15.78:0/578432339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda201279d0 0x7fda20121010 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 >> 172.21.15.78:0/578432339 conn(0x7fda200974d0 msgr2=0x7fda20098480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 shutdown_connections 2024-04-25T02:18:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.619+0000 7fda26006700 1 -- 172.21.15.78:0/578432339 wait complete. 2024-04-25T02:18:49.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:09:56.245660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:09:57.192525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:10:00.989685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:10:01.680090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:18:49.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:18:49.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1193c2700 1 Processor -- start 2024-04-25T02:18:49.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1193c2700 1 -- start start 2024-04-25T02:18:49.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1193c2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc114098f50 0x7fc11412fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1193c2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114132430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1193c2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc114091c40 con 0x7fc114064b70 2024-04-25T02:18:49.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1193c2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc114064f50 con 0x7fc114098f50 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1193c2700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc114065930 con 0x7fc114130040 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1137fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114132430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1127fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc114098f50 0x7fc11412fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1137fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114132430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:38426/0 (socket says 172.21.15.78:38426) 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc1137fe700 1 -- 172.21.15.78:0/3415809056 learned_addr learned my addr 172.21.15.78:0/3415809056 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.748+0000 7fc112ffd700 1 --1- 172.21.15.78:0/3415809056 >> v1:172.21.15.78:6789/0 conn(0x7fc114064b70 0x7fc114098840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52886/0 (socket says 172.21.15.78:52886) 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc111ffb700 1 -- 172.21.15.78:0/3415809056 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826300309 0 0) 0x7fc114091c40 con 0x7fc114064b70 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc111ffb700 1 -- 172.21.15.78:0/3415809056 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0fc0033f0 con 0x7fc114064b70 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1127fc700 1 -- 172.21.15.78:0/3415809056 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 msgr2=0x7fc114132430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1127fc700 1 --2- 172.21.15.78:0/3415809056 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114132430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1127fc700 1 -- 172.21.15.78:0/3415809056 >> v1:172.21.15.78:6789/0 conn(0x7fc114064b70 legacy=0x7fc114098840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1127fc700 1 -- 172.21.15.78:0/3415809056 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc114098530 con 0x7fc114098f50 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1137fe700 1 --2- 172.21.15.78:0/3415809056 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114132430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1127fc700 1 --2- 172.21.15.78:0/3415809056 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc114098f50 0x7fc11412fb50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc108009790 tx=0x7fc108009060).ready entity=mon.1 client_cookie=bba841c5585136c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:49.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc111ffb700 1 -- 172.21.15.78:0/3415809056 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10800f510 con 0x7fc114098f50 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc111ffb700 1 -- 172.21.15.78:0/3415809056 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10800f670 con 0x7fc114098f50 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc111ffb700 1 -- 172.21.15.78:0/3415809056 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10800f9f0 con 0x7fc114098f50 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1193c2700 1 -- 172.21.15.78:0/3415809056 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc114098f50 msgr2=0x7fc11412fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1193c2700 1 --2- 172.21.15.78:0/3415809056 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc114098f50 0x7fc11412fb50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc108009790 tx=0x7fc108009060).stop 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1193c2700 1 -- 172.21.15.78:0/3415809056 shutdown_connections 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1193c2700 1 --2- 172.21.15.78:0/3415809056 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114132430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1193c2700 1 --2- 172.21.15.78:0/3415809056 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc114098f50 0x7fc11412fb50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.749+0000 7fc1193c2700 1 -- 172.21.15.78:0/3415809056 >> 172.21.15.78:0/3415809056 conn(0x7fc11409e7a0 msgr2=0x7fc11409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.750+0000 7fc1193c2700 1 -- 172.21.15.78:0/3415809056 shutdown_connections 2024-04-25T02:18:49.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.750+0000 7fc1193c2700 1 -- 172.21.15.78:0/3415809056 wait complete. 2024-04-25T02:18:49.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.750+0000 7fc1193c2700 1 Processor -- start 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1193c2700 1 -- start start 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1193c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc114098f50 0x7fc114095ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1193c2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114095fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1193c2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1140964b0 0x7fc1141404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1193c2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc114097610 con 0x7fc114098f50 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1193c2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc114096910 con 0x7fc1140964b0 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1193c2700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1141155c0 con 0x7fc114130040 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc112ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc114098f50 0x7fc114095ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1127fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114095fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1127fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114095fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:38430/0 (socket says 172.21.15.78:38430) 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1127fc700 1 -- 172.21.15.78:0/2252230030 learned_addr learned my addr 172.21.15.78:0/2252230030 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:49.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1137fe700 1 --2- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1140964b0 0x7fc1141404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1127fc700 1 -- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1140964b0 msgr2=0x7fc1141404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1127fc700 1 --2- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1140964b0 0x7fc1141404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1127fc700 1 -- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc114098f50 msgr2=0x7fc114095ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1127fc700 1 --2- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc114098f50 0x7fc114095ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1127fc700 1 -- 172.21.15.78:0/2252230030 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c009ae0 con 0x7fc114130040 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc112ffd700 1 --2- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc114098f50 0x7fc114095ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.751+0000 7fc1127fc700 1 --2- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114095fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc108009d80 tx=0x7fc108017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.752+0000 7fc0fb7fe700 1 -- 172.21.15.78:0/2252230030 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10800f7e0 con 0x7fc114130040 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.752+0000 7fc0fb7fe700 1 -- 172.21.15.78:0/2252230030 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10800f940 con 0x7fc114130040 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.752+0000 7fc0fb7fe700 1 -- 172.21.15.78:0/2252230030 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10801b660 con 0x7fc114130040 2024-04-25T02:18:49.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.752+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1080092a0 con 0x7fc114130040 2024-04-25T02:18:49.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.752+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc114115210 con 0x7fc114130040 2024-04-25T02:18:49.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.752+0000 7fc0fb7fe700 1 -- 172.21.15.78:0/2252230030 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fc10801b9d0 con 0x7fc114130040 2024-04-25T02:18:49.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.752+0000 7fc0fb7fe700 1 -- 172.21.15.78:0/2252230030 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fc10803cb00 con 0x7fc114130040 2024-04-25T02:18:49.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.753+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc114115430 con 0x7fc114130040 2024-04-25T02:18:49.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.757+0000 7fc0fb7fe700 1 -- 172.21.15.78:0/2252230030 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fc10803ce60 con 0x7fc114130040 2024-04-25T02:18:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.913+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc114063870 con 0x7fc114130040 2024-04-25T02:18:49.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.914+0000 7fc0fb7fe700 1 -- 172.21.15.78:0/2252230030 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc108028070 con 0x7fc114130040 2024-04-25T02:18:49.918 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-04-25T02:18:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 >> v1:172.21.15.78:6816/46507 conn(0x7fc10002bd30 legacy=0x7fc10002e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 msgr2=0x7fc114095fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 --2- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114095fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc108009d80 tx=0x7fc108017000).stop 2024-04-25T02:18:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 shutdown_connections 2024-04-25T02:18:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 --2- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc1140964b0 0x7fc1141404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 --2- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc114098f50 0x7fc114095ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 --2- 172.21.15.78:0/2252230030 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc114130040 0x7fc114095fc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 >> 172.21.15.78:0/2252230030 conn(0x7fc114064b70 msgr2=0x7fc11412a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 shutdown_connections 2024-04-25T02:18:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:49.915+0000 7fc1193c2700 1 -- 172.21.15.78:0/2252230030 wait complete. 2024-04-25T02:18:49.931 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:18:50.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.043+0000 7f9c717c2700 1 Processor -- start 2024-04-25T02:18:50.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.043+0000 7f9c717c2700 1 -- start start 2024-04-25T02:18:50.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c717c2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c129100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c717c2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9c6c095b10 0x7f9c6c095f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c717c2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c05f7b0 con 0x7f9c6c096400 2024-04-25T02:18:50.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c717c2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c128880 con 0x7f9c6c095b10 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c717c2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c128b20 con 0x7f9c6c128d20 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c129100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c129100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46520/0 (socket says 172.21.15.78:46520) 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9c6c095b10 0x7f9c6c095f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9c6c096400 0x7f9c6c12fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52892/0 (socket says 172.21.15.78:52892) 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6affd700 1 -- 172.21.15.78:0/1930792953 learned_addr learned my addr 172.21.15.78:0/1930792953 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6a7fc700 1 -- 172.21.15.78:0/1930792953 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 msgr2=0x7f9c6c129100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6a7fc700 1 --2- 172.21.15.78:0/1930792953 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c129100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6a7fc700 1 -- 172.21.15.78:0/1930792953 >> v1:172.21.15.78:6789/0 conn(0x7f9c6c096400 legacy=0x7f9c6c12fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c69ffb700 1 -- 172.21.15.78:0/1930792953 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836023500 0 0) 0x7f9c6c05f7b0 con 0x7f9c6c096400 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6a7fc700 1 -- 172.21.15.78:0/1930792953 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c05ed80 con 0x7f9c6c095b10 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6affd700 1 --2- 172.21.15.78:0/1930792953 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c129100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c6a7fc700 1 --2- 172.21.15.78:0/1930792953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c6c095b10 0x7f9c6c095f10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f9c60009760 tx=0x7f9c60009060).ready entity=mon.0 client_cookie=6f9d4002bb3782f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c69ffb700 1 -- 172.21.15.78:0/1930792953 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000f510 con 0x7f9c6c095b10 2024-04-25T02:18:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c69ffb700 1 -- 172.21.15.78:0/1930792953 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6000f670 con 0x7f9c6c095b10 2024-04-25T02:18:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.044+0000 7f9c69ffb700 1 -- 172.21.15.78:0/1930792953 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000f9f0 con 0x7f9c6c095b10 2024-04-25T02:18:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.045+0000 7f9c717c2700 1 -- 172.21.15.78:0/1930792953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c6c095b10 msgr2=0x7f9c6c095f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.045+0000 7f9c717c2700 1 --2- 172.21.15.78:0/1930792953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c6c095b10 0x7f9c6c095f10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f9c60009760 tx=0x7f9c60009060).stop 2024-04-25T02:18:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.045+0000 7f9c717c2700 1 -- 172.21.15.78:0/1930792953 shutdown_connections 2024-04-25T02:18:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.045+0000 7f9c717c2700 1 --2- 172.21.15.78:0/1930792953 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c129100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.045+0000 7f9c717c2700 1 --2- 172.21.15.78:0/1930792953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c6c095b10 0x7f9c6c095f10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.045+0000 7f9c717c2700 1 -- 172.21.15.78:0/1930792953 >> 172.21.15.78:0/1930792953 conn(0x7f9c6c09abf0 msgr2=0x7f9c6c096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:50.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.045+0000 7f9c717c2700 1 -- 172.21.15.78:0/1930792953 shutdown_connections 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.045+0000 7f9c717c2700 1 -- 172.21.15.78:0/1930792953 wait complete. 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c717c2700 1 Processor -- start 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c717c2700 1 -- start start 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c717c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c6c095b10 0x7f9c6c122ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c717c2700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9c6c096400 0x7f9c6c1233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c717c2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c1238c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c717c2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1252c0 con 0x7f9c6c095b10 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c717c2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0909c0 con 0x7f9c6c128d20 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c717c2700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c127230 con 0x7f9c6c096400 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c6a7fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9c6c096400 0x7f9c6c1233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c6b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c1238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c6a7fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9c6c096400 0x7f9c6c1233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:38434/0 (socket says 172.21.15.78:38434) 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c6a7fc700 1 -- 172.21.15.78:0/2215786739 learned_addr learned my addr 172.21.15.78:0/2215786739 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.046+0000 7f9c6affd700 1 --2- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c6c095b10 0x7f9c6c122ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c6a7fc700 1 -- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 msgr2=0x7f9c6c1238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c6a7fc700 1 --2- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c1238c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c6a7fc700 1 -- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c6c095b10 msgr2=0x7f9c6c122ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c6a7fc700 1 --2- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c6c095b10 0x7f9c6c122ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c6a7fc700 1 -- 172.21.15.78:0/2215786739 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c009370 con 0x7f9c6c096400 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c6a7fc700 1 --2- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9c6c096400 0x7f9c6c1233d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9c60009e00 tx=0x7f9c60017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c537fe700 1 -- 172.21.15.78:0/2215786739 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000f7e0 con 0x7f9c6c096400 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c537fe700 1 -- 172.21.15.78:0/2215786739 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6000f940 con 0x7f9c6c096400 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c600092a0 con 0x7f9c6c096400 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c537fe700 1 -- 172.21.15.78:0/2215786739 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6001b660 con 0x7f9c6c096400 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.047+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c083a70 con 0x7f9c6c096400 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.048+0000 7f9c537fe700 1 -- 172.21.15.78:0/2215786739 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9c6001ba10 con 0x7f9c6c096400 2024-04-25T02:18:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.048+0000 7f9c537fe700 1 -- 172.21.15.78:0/2215786739 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f9c6003cae0 con 0x7f9c6c096400 2024-04-25T02:18:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.048+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c068cc0 con 0x7f9c6c096400 2024-04-25T02:18:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.053+0000 7f9c537fe700 1 -- 172.21.15.78:0/2215786739 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f9c60029080 con 0x7f9c6c096400 2024-04-25T02:18:50.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.212+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c6c06c550 con 0x7f9c6c096400 2024-04-25T02:18:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.212+0000 7f9c537fe700 1 -- 172.21.15.78:0/2215786739 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c6001f020 con 0x7f9c6c096400 2024-04-25T02:18:50.217 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 >> v1:172.21.15.78:6816/46507 conn(0x7f9c5802bd30 legacy=0x7f9c5802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9c6c096400 msgr2=0x7f9c6c1233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 --2- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9c6c096400 0x7f9c6c1233d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9c60009e00 tx=0x7f9c60017000).stop 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 shutdown_connections 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 --2- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9c6c128d20 0x7f9c6c1238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 --2- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c6c095b10 0x7f9c6c122ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 --2- 172.21.15.78:0/2215786739 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9c6c096400 0x7f9c6c1233d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 >> 172.21.15.78:0/2215786739 conn(0x7f9c6c09abf0 msgr2=0x7f9c6c099630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 shutdown_connections 2024-04-25T02:18:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.214+0000 7f9c717c2700 1 -- 172.21.15.78:0/2215786739 wait complete. 2024-04-25T02:18:50.230 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:18:50.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.343+0000 7fee74ea5700 1 Processor -- start 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.343+0000 7fee74ea5700 1 -- start start 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.343+0000 7fee74ea5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fee7006a270 0x7fee7006a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee74ea5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7006ab40 0x7fee700915a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee74ea5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee70065e00 con 0x7fee70091a90 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee74ea5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee70060040 con 0x7fee7006a270 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee74ea5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700967d0 con 0x7fee7006ab40 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6dd9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7006ab40 0x7fee700915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fee7006a270 0x7fee7006a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6dd9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7006ab40 0x7fee700915a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46538/0 (socket says 172.21.15.78:46538) 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6dd9b700 1 -- 172.21.15.78:0/2969813388 learned_addr learned my addr 172.21.15.78:0/2969813388 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:50.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6ed9d700 1 --1- 172.21.15.78:0/2969813388 >> v1:172.21.15.78:6789/0 conn(0x7fee70091a90 0x7fee7012e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52904/0 (socket says 172.21.15.78:52904) 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6e59c700 1 -- 172.21.15.78:0/2969813388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7006ab40 msgr2=0x7fee700915a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6e59c700 1 --2- 172.21.15.78:0/2969813388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7006ab40 0x7fee700915a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6e59c700 1 -- 172.21.15.78:0/2969813388 >> v1:172.21.15.78:6789/0 conn(0x7fee70091a90 legacy=0x7fee7012e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6e59c700 1 -- 172.21.15.78:0/2969813388 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70092fb0 con 0x7fee7006a270 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6d59a700 1 -- 172.21.15.78:0/2969813388 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107384118 0 0) 0x7fee70065e00 con 0x7fee70091a90 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6dd9b700 1 --2- 172.21.15.78:0/2969813388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7006ab40 0x7fee700915a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6e59c700 1 --2- 172.21.15.78:0/2969813388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7006a270 0x7fee7006a650 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fee6400a900 tx=0x7fee6400a200).ready entity=mon.0 client_cookie=bf329736a803ac36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6d59a700 1 -- 172.21.15.78:0/2969813388 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400c790 con 0x7fee7006a270 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6d59a700 1 -- 172.21.15.78:0/2969813388 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6400c8f0 con 0x7fee7006a270 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.344+0000 7fee6d59a700 1 -- 172.21.15.78:0/2969813388 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400cc70 con 0x7fee7006a270 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.345+0000 7fee74ea5700 1 -- 172.21.15.78:0/2969813388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7006a270 msgr2=0x7fee7006a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.345+0000 7fee74ea5700 1 --2- 172.21.15.78:0/2969813388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7006a270 0x7fee7006a650 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fee6400a900 tx=0x7fee6400a200).stop 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.345+0000 7fee74ea5700 1 -- 172.21.15.78:0/2969813388 shutdown_connections 2024-04-25T02:18:50.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.345+0000 7fee74ea5700 1 --2- 172.21.15.78:0/2969813388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7006a270 0x7fee7006a650 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.345+0000 7fee74ea5700 1 --2- 172.21.15.78:0/2969813388 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7006ab40 0x7fee700915a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.345+0000 7fee74ea5700 1 -- 172.21.15.78:0/2969813388 >> 172.21.15.78:0/2969813388 conn(0x7fee7009abf0 msgr2=0x7fee70096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:50.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.345+0000 7fee74ea5700 1 -- 172.21.15.78:0/2969813388 shutdown_connections 2024-04-25T02:18:50.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.345+0000 7fee74ea5700 1 -- 172.21.15.78:0/2969813388 wait complete. 2024-04-25T02:18:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee74ea5700 1 Processor -- start 2024-04-25T02:18:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee74ea5700 1 -- start start 2024-04-25T02:18:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee74ea5700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fee7006a270 0x7fee7012c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee74ea5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee70091a90 0x7fee7012c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee74ea5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7012cbf0 0x7fee70126800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee74ea5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee70095b10 con 0x7fee70091a90 2024-04-25T02:18:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee74ea5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee70129fc0 con 0x7fee7012cbf0 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee74ea5700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee700695f0 con 0x7fee7006a270 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee6ed9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7012cbf0 0x7fee70126800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee6e59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fee7006a270 0x7fee7012c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee6dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee70091a90 0x7fee7012c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee6e59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fee7006a270 0x7fee7012c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:38448/0 (socket says 172.21.15.78:38448) 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee6ed9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7012cbf0 0x7fee70126800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46542/0 (socket says 172.21.15.78:46542) 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.346+0000 7fee6e59c700 1 -- 172.21.15.78:0/3360346752 learned_addr learned my addr 172.21.15.78:0/3360346752 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee6dd9b700 1 -- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fee7006a270 msgr2=0x7fee7012c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee6dd9b700 1 --2- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fee7006a270 0x7fee7012c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee6dd9b700 1 -- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7012cbf0 msgr2=0x7fee70126800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee6dd9b700 1 --2- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7012cbf0 0x7fee70126800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee6dd9b700 1 -- 172.21.15.78:0/3360346752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009370 con 0x7fee70091a90 2024-04-25T02:18:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee6dd9b700 1 --2- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee70091a90 0x7fee7012c700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fee60006fd0 tx=0x7fee600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee5effd700 1 -- 172.21.15.78:0/3360346752 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60015070 con 0x7fee70091a90 2024-04-25T02:18:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee5effd700 1 -- 172.21.15.78:0/3360346752 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60009650 con 0x7fee70091a90 2024-04-25T02:18:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6400a440 con 0x7fee70091a90 2024-04-25T02:18:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee5effd700 1 -- 172.21.15.78:0/3360346752 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000bd30 con 0x7fee70091a90 2024-04-25T02:18:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.347+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7012a980 con 0x7fee70091a90 2024-04-25T02:18:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.348+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7006a900 con 0x7fee70091a90 2024-04-25T02:18:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.348+0000 7fee5effd700 1 -- 172.21.15.78:0/3360346752 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fee600243f0 con 0x7fee70091a90 2024-04-25T02:18:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.349+0000 7fee5effd700 1 -- 172.21.15.78:0/3360346752 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fee6003f0c0 con 0x7fee70091a90 2024-04-25T02:18:50.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.353+0000 7fee5effd700 1 -- 172.21.15.78:0/3360346752 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fee600226c0 con 0x7fee70091a90 2024-04-25T02:18:50.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.512+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee7012a200 con 0x7fee70091a90 2024-04-25T02:18:50.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.512+0000 7fee5effd700 1 -- 172.21.15.78:0/3360346752 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee60022300 con 0x7fee70091a90 2024-04-25T02:18:50.516 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-04-25T02:18:50.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 >> v1:172.21.15.78:6816/46507 conn(0x7fee5002bd30 legacy=0x7fee5002e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee70091a90 msgr2=0x7fee7012c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 --2- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee70091a90 0x7fee7012c700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fee60006fd0 tx=0x7fee600090f0).stop 2024-04-25T02:18:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 shutdown_connections 2024-04-25T02:18:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 --2- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fee7012cbf0 0x7fee70126800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 --2- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fee7006a270 0x7fee7012c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 --2- 172.21.15.78:0/3360346752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee70091a90 0x7fee7012c700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 >> 172.21.15.78:0/3360346752 conn(0x7fee7009abf0 msgr2=0x7fee70098c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 shutdown_connections 2024-04-25T02:18:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.514+0000 7fee74ea5700 1 -- 172.21.15.78:0/3360346752 wait complete. 2024-04-25T02:18:50.529 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:18:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedd5fee700 1 Processor -- start 2024-04-25T02:18:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedd5fee700 1 -- start start 2024-04-25T02:18:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedd5fee700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd0097750 0x7fedd0095b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedd5fee700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fedd0090d40 0x7fedd0096000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedd5fee700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd00931b0 con 0x7fedd00964f0 2024-04-25T02:18:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedd5fee700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd0097b30 con 0x7fedd0090d40 2024-04-25T02:18:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedd5fee700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0092640 con 0x7fedd0097750 2024-04-25T02:18:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedcf7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd0097750 0x7fedd0095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedceffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fedd0090d40 0x7fedd0096000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedcffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fedd00964f0 0x7fedd0131380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52906/0 (socket says 172.21.15.78:52906) 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedceffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fedd0090d40 0x7fedd0096000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43082/0 (socket says 172.21.15.78:43082) 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedcf7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd0097750 0x7fedd0095b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46548/0 (socket says 172.21.15.78:46548) 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.643+0000 7fedceffd700 1 -- 172.21.15.78:0/3499934024 learned_addr learned my addr 172.21.15.78:0/3499934024 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedcf7fe700 1 -- 172.21.15.78:0/3499934024 >> v2:172.21.15.78:3300/0 conn(0x7fedd0090d40 msgr2=0x7fedd0096000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedcf7fe700 1 --2- 172.21.15.78:0/3499934024 >> v2:172.21.15.78:3300/0 conn(0x7fedd0090d40 0x7fedd0096000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedcf7fe700 1 -- 172.21.15.78:0/3499934024 >> v1:172.21.15.78:6789/0 conn(0x7fedd00964f0 legacy=0x7fedd0131380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedcf7fe700 1 -- 172.21.15.78:0/3499934024 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd005ed80 con 0x7fedd0097750 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedceffd700 1 --2- 172.21.15.78:0/3499934024 >> v2:172.21.15.78:3300/0 conn(0x7fedd0090d40 0x7fedd0096000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedcf7fe700 1 --2- 172.21.15.78:0/3499934024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd0097750 0x7fedd0095b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fedc0009760 tx=0x7fedc0009060).ready entity=mon.1 client_cookie=9bce874fb8f3787d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedce7fc700 1 -- 172.21.15.78:0/3499934024 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000f510 con 0x7fedd0097750 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedce7fc700 1 -- 172.21.15.78:0/3499934024 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc000f670 con 0x7fedd0097750 2024-04-25T02:18:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedce7fc700 1 -- 172.21.15.78:0/3499934024 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000f9f0 con 0x7fedd0097750 2024-04-25T02:18:50.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedd5fee700 1 -- 172.21.15.78:0/3499934024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd0097750 msgr2=0x7fedd0095b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedd5fee700 1 --2- 172.21.15.78:0/3499934024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd0097750 0x7fedd0095b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fedc0009760 tx=0x7fedc0009060).stop 2024-04-25T02:18:50.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedd5fee700 1 -- 172.21.15.78:0/3499934024 shutdown_connections 2024-04-25T02:18:50.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedd5fee700 1 --2- 172.21.15.78:0/3499934024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd0097750 0x7fedd0095b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedd5fee700 1 --2- 172.21.15.78:0/3499934024 >> v2:172.21.15.78:3300/0 conn(0x7fedd0090d40 0x7fedd0096000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedd5fee700 1 -- 172.21.15.78:0/3499934024 >> 172.21.15.78:0/3499934024 conn(0x7fedd009abf0 msgr2=0x7fedd0096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:50.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedd5fee700 1 -- 172.21.15.78:0/3499934024 shutdown_connections 2024-04-25T02:18:50.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.644+0000 7fedd5fee700 1 -- 172.21.15.78:0/3499934024 wait complete. 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.645+0000 7fedd5fee700 1 Processor -- start 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.645+0000 7fedd5fee700 1 -- start start 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedd5fee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd00964f0 0x7fedd013a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedd5fee700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fedd0097750 0x7fedd013ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedd5fee700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd013b200 0x7fedd008b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedd5fee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd008cca0 con 0x7fedd00964f0 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedd5fee700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd008d310 con 0x7fedd013b200 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedd5fee700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedd00992d0 con 0x7fedd0097750 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd00964f0 0x7fedd013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd00964f0 0x7fedd013a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43086/0 (socket says 172.21.15.78:43086) 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcf7fe700 1 -- 172.21.15.78:0/2812829780 learned_addr learned my addr 172.21.15.78:0/2812829780 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedceffd700 1 --2- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fedd0097750 0x7fedd013ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcffff700 1 --2- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd013b200 0x7fedd008b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcf7fe700 1 -- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fedd0097750 msgr2=0x7fedd013ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcf7fe700 1 --2- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fedd0097750 0x7fedd013ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcf7fe700 1 -- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd013b200 msgr2=0x7fedd008b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcf7fe700 1 --2- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd013b200 0x7fedd008b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcf7fe700 1 -- 172.21.15.78:0/2812829780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4009370 con 0x7fedd00964f0 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.646+0000 7fedcf7fe700 1 --2- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd00964f0 0x7fedd013a820 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fedc0011e80 tx=0x7fedc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.647+0000 7fedb7fff700 1 -- 172.21.15.78:0/2812829780 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000f7e0 con 0x7fedd00964f0 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.647+0000 7fedb7fff700 1 -- 172.21.15.78:0/2812829780 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc000f940 con 0x7fedd00964f0 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.647+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc00092a0 con 0x7fedd00964f0 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.647+0000 7fedb7fff700 1 -- 172.21.15.78:0/2812829780 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc001c670 con 0x7fedd00964f0 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.647+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd008ec80 con 0x7fedd00964f0 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.647+0000 7fedb7fff700 1 -- 172.21.15.78:0/2812829780 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fedc001ca20 con 0x7fedd00964f0 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.647+0000 7fedb7fff700 1 -- 172.21.15.78:0/2812829780 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fedc003cf40 con 0x7fedd00964f0 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.648+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd0099a10 con 0x7fedd00964f0 2024-04-25T02:18:50.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.652+0000 7fedb7fff700 1 -- 172.21.15.78:0/2812829780 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fedc0020070 con 0x7fedd00964f0 2024-04-25T02:18:50.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.813+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fedd006c550 con 0x7fedd00964f0 2024-04-25T02:18:50.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.813+0000 7fedb7fff700 1 -- 172.21.15.78:0/2812829780 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7fedc0020020 con 0x7fedd00964f0 2024-04-25T02:18:50.818 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-04-25T02:18:50.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 >> v1:172.21.15.78:6816/46507 conn(0x7fedbc02bd00 legacy=0x7fedbc02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd00964f0 msgr2=0x7fedd013a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 --2- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd00964f0 0x7fedd013a820 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fedc0011e80 tx=0x7fedc0017000).stop 2024-04-25T02:18:50.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 shutdown_connections 2024-04-25T02:18:50.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 --2- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedd013b200 0x7fedd008b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 --2- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedd00964f0 0x7fedd013a820 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 --2- 172.21.15.78:0/2812829780 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fedd0097750 0x7fedd013ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 >> 172.21.15.78:0/2812829780 conn(0x7fedd009abf0 msgr2=0x7fedd00689b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:50.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 shutdown_connections 2024-04-25T02:18:50.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.815+0000 7fedd5fee700 1 -- 172.21.15.78:0/2812829780 wait complete. 2024-04-25T02:18:50.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:18:50.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.941+0000 7fcaf3f21700 1 Processor -- start 2024-04-25T02:18:50.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.941+0000 7fcaf3f21700 1 -- start start 2024-04-25T02:18:50.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf3f21700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec098e40 0x7fcaec099220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf3f21700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcaec099710 0x7fcaec12f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf3f21700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec092070 con 0x7fcaec12f630 2024-04-25T02:18:50.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf3f21700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec092ff0 con 0x7fcaec099710 2024-04-25T02:18:50.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf3f21700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0978e0 con 0x7fcaec098e40 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf1cbd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec098e40 0x7fcaec099220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf14bc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcaec099710 0x7fcaec12f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf24be700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcaec12f630 0x7fcaec131a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52920/0 (socket says 172.21.15.78:52920) 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf24be700 1 -- 172.21.15.78:0/2387525931 learned_addr learned my addr 172.21.15.78:0/2387525931 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf1cbd700 1 -- 172.21.15.78:0/2387525931 >> v2:172.21.15.78:3300/0 conn(0x7fcaec099710 msgr2=0x7fcaec12f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf1cbd700 1 --2- 172.21.15.78:0/2387525931 >> v2:172.21.15.78:3300/0 conn(0x7fcaec099710 0x7fcaec12f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf1cbd700 1 -- 172.21.15.78:0/2387525931 >> v1:172.21.15.78:6789/0 conn(0x7fcaec12f630 legacy=0x7fcaec131a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf1cbd700 1 -- 172.21.15.78:0/2387525931 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec090e50 con 0x7fcaec098e40 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf0cbb700 1 -- 172.21.15.78:0/2387525931 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125809779 0 0) 0x7fcaec092070 con 0x7fcaec12f630 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf14bc700 1 --2- 172.21.15.78:0/2387525931 >> v2:172.21.15.78:3300/0 conn(0x7fcaec099710 0x7fcaec12f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf1cbd700 1 --2- 172.21.15.78:0/2387525931 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec098e40 0x7fcaec099220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcadc009760 tx=0x7fcadc009060).ready entity=mon.1 client_cookie=6eded90c157e607 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf0cbb700 1 -- 172.21.15.78:0/2387525931 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc00f510 con 0x7fcaec098e40 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf0cbb700 1 -- 172.21.15.78:0/2387525931 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc00f670 con 0x7fcaec098e40 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.942+0000 7fcaf0cbb700 1 -- 172.21.15.78:0/2387525931 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc00f9f0 con 0x7fcaec098e40 2024-04-25T02:18:50.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.943+0000 7fcaf3f21700 1 -- 172.21.15.78:0/2387525931 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec098e40 msgr2=0x7fcaec099220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.943+0000 7fcaf3f21700 1 --2- 172.21.15.78:0/2387525931 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec098e40 0x7fcaec099220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcadc009760 tx=0x7fcadc009060).stop 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.943+0000 7fcaf3f21700 1 -- 172.21.15.78:0/2387525931 shutdown_connections 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.943+0000 7fcaf3f21700 1 --2- 172.21.15.78:0/2387525931 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec098e40 0x7fcaec099220 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.943+0000 7fcaf3f21700 1 --2- 172.21.15.78:0/2387525931 >> v2:172.21.15.78:3300/0 conn(0x7fcaec099710 0x7fcaec12f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.943+0000 7fcaf3f21700 1 -- 172.21.15.78:0/2387525931 >> 172.21.15.78:0/2387525931 conn(0x7fcaec0974d0 msgr2=0x7fcaec099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.943+0000 7fcaf3f21700 1 -- 172.21.15.78:0/2387525931 shutdown_connections 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.943+0000 7fcaf3f21700 1 -- 172.21.15.78:0/2387525931 wait complete. 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf3f21700 1 Processor -- start 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf3f21700 1 -- start start 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf3f21700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaec098e40 0x7fcaec08b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf3f21700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcaec099710 0x7fcaec08b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf3f21700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec12f630 0x7fcaec08bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf3f21700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec08c780 con 0x7fcaec098e40 2024-04-25T02:18:50.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf3f21700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec08e250 con 0x7fcaec12f630 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf3f21700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec06aba0 con 0x7fcaec099710 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf1cbd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaec098e40 0x7fcaec08b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf1cbd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaec098e40 0x7fcaec08b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43102/0 (socket says 172.21.15.78:43102) 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf14bc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcaec099710 0x7fcaec08b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf1cbd700 1 -- 172.21.15.78:0/3883981318 learned_addr learned my addr 172.21.15.78:0/3883981318 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.944+0000 7fcaf24be700 1 --2- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec12f630 0x7fcaec08bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcaf1cbd700 1 -- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcaec099710 msgr2=0x7fcaec08b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcaf1cbd700 1 --2- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcaec099710 0x7fcaec08b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcaf1cbd700 1 -- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec12f630 msgr2=0x7fcaec08bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcaf1cbd700 1 --2- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec12f630 0x7fcaec08bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcaf1cbd700 1 -- 172.21.15.78:0/3883981318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80092a0 con 0x7fcaec098e40 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcaf14bc700 1 --2- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcaec099710 0x7fcaec08b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcaf1cbd700 1 --2- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaec098e40 0x7fcaec08b2b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fcadc006d90 tx=0x7fcadc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:50.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcae27fc700 1 -- 172.21.15.78:0/3883981318 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc00f7e0 con 0x7fcaec098e40 2024-04-25T02:18:50.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcae27fc700 1 -- 172.21.15.78:0/3883981318 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc00f940 con 0x7fcaec098e40 2024-04-25T02:18:50.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc0092a0 con 0x7fcaec098e40 2024-04-25T02:18:50.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcae27fc700 1 -- 172.21.15.78:0/3883981318 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc01b690 con 0x7fcaec098e40 2024-04-25T02:18:50.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.945+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec08e6e0 con 0x7fcaec098e40 2024-04-25T02:18:50.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.946+0000 7fcae27fc700 1 -- 172.21.15.78:0/3883981318 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fcadc01ba80 con 0x7fcaec098e40 2024-04-25T02:18:50.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.946+0000 7fcae27fc700 1 -- 172.21.15.78:0/3883981318 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fcadc03c890 con 0x7fcaec098e40 2024-04-25T02:18:50.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.946+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec08e870 con 0x7fcaec098e40 2024-04-25T02:18:50.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:50.951+0000 7fcae27fc700 1 -- 172.21.15.78:0/3883981318 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fcaec08e870 con 0x7fcaec098e40 2024-04-25T02:18:51.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.124+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcaec08e870 con 0x7fcaec098e40 2024-04-25T02:18:51.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.124+0000 7fcae27fc700 1 -- 172.21.15.78:0/3883981318 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v19) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcaec08e870 con 0x7fcaec098e40 2024-04-25T02:18:51.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.125+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 >> v1:172.21.15.78:6816/46507 conn(0x7fcad002bd00 legacy=0x7fcad002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:51.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.126+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaec098e40 msgr2=0x7fcaec08b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:51.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.126+0000 7fcaf3f21700 1 --2- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaec098e40 0x7fcaec08b2b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fcadc006d90 tx=0x7fcadc017000).stop 2024-04-25T02:18:51.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.126+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 shutdown_connections 2024-04-25T02:18:51.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.126+0000 7fcaf3f21700 1 --2- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcaec12f630 0x7fcaec08bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:51.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.126+0000 7fcaf3f21700 1 --2- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcaec098e40 0x7fcaec08b2b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:51.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.126+0000 7fcaf3f21700 1 --2- 172.21.15.78:0/3883981318 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcaec099710 0x7fcaec08b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:51.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.126+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 >> 172.21.15.78:0/3883981318 conn(0x7fcaec0974d0 msgr2=0x7fcaec094890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:51.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.126+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 shutdown_connections 2024-04-25T02:18:51.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:51.126+0000 7fcaf3f21700 1 -- 172.21.15.78:0/3883981318 wait complete. 2024-04-25T02:18:51.131 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-04-25T02:18:51.141 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi195.front.sepia.ceph.com... 2024-04-25T02:18:51.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:51.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T02:18:51.184 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:18:51.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi195.stderr:ceph-fuse[42281]: fuse finished with error 0 and tester_r 0 2024-04-25T02:18:57.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T02:18:57.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:57.286 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:18:57.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:57.308 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T02:18:57.370 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:18:57.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:57.370 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:18:57.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:57.459 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T02:18:57.535 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2024-04-25T02:18:57.545 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T02:18:57.564 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T02:18:57.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:57.565 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T02:18:57.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:57.584 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T02:18:57.655 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T02:18:57.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:18:57.657 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T02:18:57.667 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T02:18:57.668 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T02:18:57.668 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:18:57.716 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16251104k,nr_inodes=4062776,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=33,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18783 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253756k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2024-04-25T02:18:57.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:57.716 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-04-25T02:18:57.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:18:57.774 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-04-25T02:18:57.841 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-04-25T02:18:57.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:18:57.843 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T02:18:57.852 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:18:57.852 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:18:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.977+0000 7f409efd3700 1 Processor -- start 2024-04-25T02:18:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.977+0000 7f409efd3700 1 -- start start 2024-04-25T02:18:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.977+0000 7f409efd3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f409805e960 0x7f4098098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.977+0000 7f409efd3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4098099330 0x7f4098099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.977+0000 7f409efd3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40980682e0 con 0x7f409812d120 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.977+0000 7f409efd3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409806ad80 con 0x7f4098099330 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.977+0000 7f409efd3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409805ed40 con 0x7f409805e960 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.977+0000 7f409cd6f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f409805e960 0x7f4098098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f4097fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4098099330 0x7f4098099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f409d570700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f409812d120 0x7f409812f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33028/0 (socket says 172.21.15.78:33028) 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f409d570700 1 -- 172.21.15.78:0/3412834591 learned_addr learned my addr 172.21.15.78:0/3412834591 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f4097fff700 1 -- 172.21.15.78:0/3412834591 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f409805e960 msgr2=0x7f4098098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f4097fff700 1 --2- 172.21.15.78:0/3412834591 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f409805e960 0x7f4098098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f4097fff700 1 -- 172.21.15.78:0/3412834591 >> v1:172.21.15.78:6789/0 conn(0x7f409812d120 legacy=0x7f409812f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f4097fff700 1 -- 172.21.15.78:0/3412834591 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098069060 con 0x7f4098099330 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f40977fe700 1 -- 172.21.15.78:0/3412834591 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068104862 0 0) 0x7f40980682e0 con 0x7f409812d120 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f409cd6f700 1 --2- 172.21.15.78:0/3412834591 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f409805e960 0x7f4098098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:57.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f4097fff700 1 --2- 172.21.15.78:0/3412834591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098099330 0x7f4098099730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f4084009760 tx=0x7f4084009060).ready entity=mon.0 client_cookie=5e6eff3918b19a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f40977fe700 1 -- 172.21.15.78:0/3412834591 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400f510 con 0x7f4098099330 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f40977fe700 1 -- 172.21.15.78:0/3412834591 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408400f670 con 0x7f4098099330 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.978+0000 7f40977fe700 1 -- 172.21.15.78:0/3412834591 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400f9f0 con 0x7f4098099330 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.979+0000 7f409efd3700 1 -- 172.21.15.78:0/3412834591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098099330 msgr2=0x7f4098099730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.979+0000 7f409efd3700 1 --2- 172.21.15.78:0/3412834591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098099330 0x7f4098099730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f4084009760 tx=0x7f4084009060).stop 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.979+0000 7f409efd3700 1 -- 172.21.15.78:0/3412834591 shutdown_connections 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.979+0000 7f409efd3700 1 --2- 172.21.15.78:0/3412834591 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f409805e960 0x7f4098098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.979+0000 7f409efd3700 1 --2- 172.21.15.78:0/3412834591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098099330 0x7f4098099730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.979+0000 7f409efd3700 1 -- 172.21.15.78:0/3412834591 >> 172.21.15.78:0/3412834591 conn(0x7f40980974d0 msgr2=0x7f4098099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.979+0000 7f409efd3700 1 -- 172.21.15.78:0/3412834591 shutdown_connections 2024-04-25T02:18:57.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.979+0000 7f409efd3700 1 -- 172.21.15.78:0/3412834591 wait complete. 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409efd3700 1 Processor -- start 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409efd3700 1 -- start start 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409efd3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f409805e960 0x7f409812be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409efd3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4098099330 0x7f4098065c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409efd3700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f409812d120 0x7f4098066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409efd3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409812aec0 con 0x7f409805e960 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409efd3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40980684a0 con 0x7f4098099330 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409efd3700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f409812b370 con 0x7f409812d120 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f4097fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4098099330 0x7f4098065c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409cd6f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f409805e960 0x7f409812be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f4097fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4098099330 0x7f4098065c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39152/0 (socket says 172.21.15.78:39152) 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f4097fff700 1 -- 172.21.15.78:0/1425168031 learned_addr learned my addr 172.21.15.78:0/1425168031 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.980+0000 7f409d570700 1 --2- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f409812d120 0x7f4098066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f409cd6f700 1 -- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f409812d120 msgr2=0x7f4098066140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f409cd6f700 1 --2- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f409812d120 0x7f4098066140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f409cd6f700 1 -- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4098099330 msgr2=0x7f4098065c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f409cd6f700 1 --2- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4098099330 0x7f4098065c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f409cd6f700 1 -- 172.21.15.78:0/1425168031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0092a0 con 0x7f409805e960 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f4097fff700 1 --2- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4098099330 0x7f4098065c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f409cd6f700 1 --2- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f409805e960 0x7f409812be10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f408c00e980 tx=0x7f408c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f40957fa700 1 -- 172.21.15.78:0/1425168031 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c009580 con 0x7f409805e960 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f40957fa700 1 -- 172.21.15.78:0/1425168031 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c012600 con 0x7f409805e960 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40840092a0 con 0x7f409805e960 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f40957fa700 1 -- 172.21.15.78:0/1425168031 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c012980 con 0x7f409805e960 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.981+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4098067770 con 0x7f409805e960 2024-04-25T02:18:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.982+0000 7f40957fa700 1 -- 172.21.15.78:0/1425168031 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f408c012d30 con 0x7f409805e960 2024-04-25T02:18:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.982+0000 7f40957fa700 1 -- 172.21.15.78:0/1425168031 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f408c03b6c0 con 0x7f409805e960 2024-04-25T02:18:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.982+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409809a660 con 0x7f409805e960 2024-04-25T02:18:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:57.987+0000 7f40957fa700 1 -- 172.21.15.78:0/1425168031 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f408c019310 con 0x7f409805e960 2024-04-25T02:18:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.142+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4098046ce0 con 0x7f407c02bd00 2024-04-25T02:18:58.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.148+0000 7f40957fa700 1 -- 172.21.15.78:0/1425168031 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256420 (unknown 2965378022 0 2126190081) 0x7f4098046ce0 con 0x7f407c02bd00 2024-04-25T02:18:58.156 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:18:58.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 >> v1:172.21.15.78:6816/46507 conn(0x7f407c02bd00 legacy=0x7f407c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f409805e960 msgr2=0x7f409812be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 --2- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f409805e960 0x7f409812be10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f408c00e980 tx=0x7f408c009060).stop 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 shutdown_connections 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 --2- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f409812d120 0x7f4098066140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 --2- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f409805e960 0x7f409812be10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 --2- 172.21.15.78:0/1425168031 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4098099330 0x7f4098065c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 >> 172.21.15.78:0/1425168031 conn(0x7f40980974d0 msgr2=0x7f4098093360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 shutdown_connections 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.151+0000 7f409efd3700 1 -- 172.21.15.78:0/1425168031 wait complete. 2024-04-25T02:18:58.159 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:18:58.167 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-04-25T02:18:56.303490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158290234,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":27624,"num_write_kb":366880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27098,"ondisk_log_size":27098,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1511040,"kb_used_data":309856,"kb_used_omap":0,"kb_used_meta":1201152,"kb_avail":375976320,"statfs":{"total":386547056640,"available":384999751680,"internally_reserved":0,"allocated":317292544,"data_stored":316807324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1229979648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-83268946,"num_objects":-2905,"num_object_clones":0,"num_object_copies":-5810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2905,"num_whiteouts":0,"num_read":22,"num_read_kb":304,"num_write":3273,"num_write_kb":7664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002562"},"pg_stats":[{"pgid":"4.3f","version":"19'354","reported_seq":366,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275043+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:18:51.275043+0000","last_peered":"2024-04-25T02:18:51.275043+0000","last_clean":"2024-04-25T02:18:51.275043+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:18:51.275043+0000","last_undegraded":"2024-04-25T02:18:51.275043+0000","last_fullsized":"2024-04-25T02:18:51.275043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277671+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:18:51.277671+0000","last_peered":"2024-04-25T02:18:51.277671+0000","last_clean":"2024-04-25T02:18:51.277671+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:18:51.277671+0000","last_undegraded":"2024-04-25T02:18:51.277671+0000","last_fullsized":"2024-04-25T02:18:51.277671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267056+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:18:51.267056+0000","last_peered":"2024-04-25T02:18:51.267056+0000","last_clean":"2024-04-25T02:18:51.267056+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:18:51.267056+0000","last_undegraded":"2024-04-25T02:18:51.267056+0000","last_fullsized":"2024-04-25T02:18:51.267056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267040+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:18:51.267040+0000","last_peered":"2024-04-25T02:18:51.267040+0000","last_clean":"2024-04-25T02:18:51.267040+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:18:51.267040+0000","last_undegraded":"2024-04-25T02:18:51.267040+0000","last_fullsized":"2024-04-25T02:18:51.267040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269216+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:18:51.269216+0000","last_peered":"2024-04-25T02:18:51.269216+0000","last_clean":"2024-04-25T02:18:51.269216+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:18:51.269216+0000","last_undegraded":"2024-04-25T02:18:51.269216+0000","last_fullsized":"2024-04-25T02:18:51.269216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278782+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:18:51.278782+0000","last_peered":"2024-04-25T02:18:51.278782+0000","last_clean":"2024-04-25T02:18:51.278782+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:18:51.278782+0000","last_undegraded":"2024-04-25T02:18:51.278782+0000","last_fullsized":"2024-04-25T02:18:51.278782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'376","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272984+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:18:51.272984+0000","last_peered":"2024-04-25T02:18:51.272984+0000","last_clean":"2024-04-25T02:18:51.272984+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:18:51.272984+0000","last_undegraded":"2024-04-25T02:18:51.272984+0000","last_fullsized":"2024-04-25T02:18:51.272984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":376,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":3216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'297","reported_seq":309,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272124+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:18:51.272124+0000","last_peered":"2024-04-25T02:18:51.272124+0000","last_clean":"2024-04-25T02:18:51.272124+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:18:51.272124+0000","last_undegraded":"2024-04-25T02:18:51.272124+0000","last_fullsized":"2024-04-25T02:18:51.272124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":297,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":2172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269598+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:18:51.269598+0000","last_peered":"2024-04-25T02:18:51.269598+0000","last_clean":"2024-04-25T02:18:51.269598+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:18:51.269598+0000","last_undegraded":"2024-04-25T02:18:51.269598+0000","last_fullsized":"2024-04-25T02:18:51.269598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'351","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267201+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:18:51.267201+0000","last_peered":"2024-04-25T02:18:51.267201+0000","last_clean":"2024-04-25T02:18:51.267201+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:18:51.267201+0000","last_undegraded":"2024-04-25T02:18:51.267201+0000","last_fullsized":"2024-04-25T02:18:51.267201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.256733+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:18:51.256733+0000","last_peered":"2024-04-25T02:18:51.256733+0000","last_clean":"2024-04-25T02:18:51.256733+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:18:51.256733+0000","last_undegraded":"2024-04-25T02:18:51.256733+0000","last_fullsized":"2024-04-25T02:18:51.256733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":2530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'322","reported_seq":334,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277216+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:18:51.277216+0000","last_peered":"2024-04-25T02:18:51.277216+0000","last_clean":"2024-04-25T02:18:51.277216+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:18:51.277216+0000","last_undegraded":"2024-04-25T02:18:51.277216+0000","last_fullsized":"2024-04-25T02:18:51.277216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":322,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'359","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277681+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:18:51.277681+0000","last_peered":"2024-04-25T02:18:51.277681+0000","last_clean":"2024-04-25T02:18:51.277681+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:18:51.277681+0000","last_undegraded":"2024-04-25T02:18:51.277681+0000","last_fullsized":"2024-04-25T02:18:51.277681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":359,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":2645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278233+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:18:51.278233+0000","last_peered":"2024-04-25T02:18:51.278233+0000","last_clean":"2024-04-25T02:18:51.278233+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:18:51.278233+0000","last_undegraded":"2024-04-25T02:18:51.278233+0000","last_fullsized":"2024-04-25T02:18:51.278233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253088+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:18:51.253088+0000","last_peered":"2024-04-25T02:18:51.253088+0000","last_clean":"2024-04-25T02:18:51.253088+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:18:51.253088+0000","last_undegraded":"2024-04-25T02:18:51.253088+0000","last_fullsized":"2024-04-25T02:18:51.253088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'380","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271052+0000","last_change":"2024-04-25T02:10:53.852512+0000","last_active":"2024-04-25T02:18:51.271052+0000","last_peered":"2024-04-25T02:18:51.271052+0000","last_clean":"2024-04-25T02:18:51.271052+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:18:51.271052+0000","last_undegraded":"2024-04-25T02:18:51.271052+0000","last_fullsized":"2024-04-25T02:18:51.271052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":380,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.264403+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:18:51.264403+0000","last_peered":"2024-04-25T02:18:51.264403+0000","last_clean":"2024-04-25T02:18:51.264403+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:18:51.264403+0000","last_undegraded":"2024-04-25T02:18:51.264403+0000","last_fullsized":"2024-04-25T02:18:51.264403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'340","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253849+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:18:51.253849+0000","last_peered":"2024-04-25T02:18:51.253849+0000","last_clean":"2024-04-25T02:18:51.253849+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:18:51.253849+0000","last_undegraded":"2024-04-25T02:18:51.253849+0000","last_fullsized":"2024-04-25T02:18:51.253849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'356","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276313+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:18:51.276313+0000","last_peered":"2024-04-25T02:18:51.276313+0000","last_clean":"2024-04-25T02:18:51.276313+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:18:51.276313+0000","last_undegraded":"2024-04-25T02:18:51.276313+0000","last_fullsized":"2024-04-25T02:18:51.276313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269721+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:18:51.269721+0000","last_peered":"2024-04-25T02:18:51.269721+0000","last_clean":"2024-04-25T02:18:51.269721+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:18:51.269721+0000","last_undegraded":"2024-04-25T02:18:51.269721+0000","last_fullsized":"2024-04-25T02:18:51.269721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'344","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273747+0000","last_change":"2024-04-25T02:10:53.852792+0000","last_active":"2024-04-25T02:18:51.273747+0000","last_peered":"2024-04-25T02:18:51.273747+0000","last_clean":"2024-04-25T02:18:51.273747+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:18:51.273747+0000","last_undegraded":"2024-04-25T02:18:51.273747+0000","last_fullsized":"2024-04-25T02:18:51.273747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'383","reported_seq":395,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267045+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:18:51.267045+0000","last_peered":"2024-04-25T02:18:51.267045+0000","last_clean":"2024-04-25T02:18:51.267045+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:18:51.267045+0000","last_undegraded":"2024-04-25T02:18:51.267045+0000","last_fullsized":"2024-04-25T02:18:51.267045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":2481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'350","reported_seq":362,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273435+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:18:51.273435+0000","last_peered":"2024-04-25T02:18:51.273435+0000","last_clean":"2024-04-25T02:18:51.273435+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:18:51.273435+0000","last_undegraded":"2024-04-25T02:18:51.273435+0000","last_fullsized":"2024-04-25T02:18:51.273435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":350,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271458+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:18:51.271458+0000","last_peered":"2024-04-25T02:18:51.271458+0000","last_clean":"2024-04-25T02:18:51.271458+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:18:51.271458+0000","last_undegraded":"2024-04-25T02:18:51.271458+0000","last_fullsized":"2024-04-25T02:18:51.271458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'386","reported_seq":398,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.250133+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:18:51.250133+0000","last_peered":"2024-04-25T02:18:51.250133+0000","last_clean":"2024-04-25T02:18:51.250133+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:18:51.250133+0000","last_undegraded":"2024-04-25T02:18:51.250133+0000","last_fullsized":"2024-04-25T02:18:51.250133+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281870+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:18:51.281870+0000","last_peered":"2024-04-25T02:18:51.281870+0000","last_clean":"2024-04-25T02:18:51.281870+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:18:51.281870+0000","last_undegraded":"2024-04-25T02:18:51.281870+0000","last_fullsized":"2024-04-25T02:18:51.281870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":421,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268411+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:18:51.268411+0000","last_peered":"2024-04-25T02:18:51.268411+0000","last_clean":"2024-04-25T02:18:51.268411+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:18:51.268411+0000","last_undegraded":"2024-04-25T02:18:51.268411+0000","last_fullsized":"2024-04-25T02:18:51.268411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'154","reported_seq":167,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.381581+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:18:45.381581+0000","last_peered":"2024-04-25T02:18:45.381581+0000","last_clean":"2024-04-25T02:18:45.381581+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:18:45.381581+0000","last_undegraded":"2024-04-25T02:18:45.381581+0000","last_fullsized":"2024-04-25T02:18:45.381581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":154,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":16455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'334","reported_seq":346,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272426+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:18:51.272426+0000","last_peered":"2024-04-25T02:18:51.272426+0000","last_clean":"2024-04-25T02:18:51.272426+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:18:51.272426+0000","last_undegraded":"2024-04-25T02:18:51.272426+0000","last_fullsized":"2024-04-25T02:18:51.272426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":334,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'76","reported_seq":89,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:44.365713+0000","last_change":"2024-04-25T02:10:02.370405+0000","last_active":"2024-04-25T02:18:44.365713+0000","last_peered":"2024-04-25T02:18:44.365713+0000","last_clean":"2024-04-25T02:18:44.365713+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:18:44.365713+0000","last_undegraded":"2024-04-25T02:18:44.365713+0000","last_fullsized":"2024-04-25T02:18:44.365713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":76,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'347","reported_seq":359,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263176+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:18:51.263176+0000","last_peered":"2024-04-25T02:18:51.263176+0000","last_clean":"2024-04-25T02:18:51.263176+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:18:51.263176+0000","last_undegraded":"2024-04-25T02:18:51.263176+0000","last_fullsized":"2024-04-25T02:18:51.263176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":347,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'243","reported_seq":256,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:31.210530+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:18:31.210530+0000","last_peered":"2024-04-25T02:18:31.210530+0000","last_clean":"2024-04-25T02:18:31.210530+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:18:31.210530+0000","last_undegraded":"2024-04-25T02:18:31.210530+0000","last_fullsized":"2024-04-25T02:18:31.210530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270570+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:18:51.270570+0000","last_peered":"2024-04-25T02:18:51.270570+0000","last_clean":"2024-04-25T02:18:51.270570+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:18:51.270570+0000","last_undegraded":"2024-04-25T02:18:51.270570+0000","last_fullsized":"2024-04-25T02:18:51.270570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'6","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.386829+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:18:39.386829+0000","last_peered":"2024-04-25T02:18:39.386829+0000","last_clean":"2024-04-25T02:18:39.386829+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:18:39.386829+0000","last_undegraded":"2024-04-25T02:18:39.386829+0000","last_fullsized":"2024-04-25T02:18:39.386829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'377","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273185+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:18:51.273185+0000","last_peered":"2024-04-25T02:18:51.273185+0000","last_clean":"2024-04-25T02:18:51.273185+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:18:51.273185+0000","last_undegraded":"2024-04-25T02:18:51.273185+0000","last_fullsized":"2024-04-25T02:18:51.273185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":377,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":2757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'77","reported_seq":90,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.184946+0000","last_change":"2024-04-25T02:10:02.367526+0000","last_active":"2024-04-25T02:18:51.184946+0000","last_peered":"2024-04-25T02:18:51.184946+0000","last_clean":"2024-04-25T02:18:51.184946+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:18:51.184946+0000","last_undegraded":"2024-04-25T02:18:51.184946+0000","last_fullsized":"2024-04-25T02:18:51.184946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6180250,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'412","reported_seq":424,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273256+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:18:51.273256+0000","last_peered":"2024-04-25T02:18:51.273256+0000","last_clean":"2024-04-25T02:18:51.273256+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:18:51.273256+0000","last_undegraded":"2024-04-25T02:18:51.273256+0000","last_fullsized":"2024-04-25T02:18:51.273256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":412,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'361","reported_seq":374,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.493452+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:18:48.493452+0000","last_peered":"2024-04-25T02:18:48.493452+0000","last_clean":"2024-04-25T02:18:48.493452+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:18:48.493452+0000","last_undegraded":"2024-04-25T02:18:48.493452+0000","last_fullsized":"2024-04-25T02:18:48.493452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":361,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270896+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:18:51.270896+0000","last_peered":"2024-04-25T02:18:51.270896+0000","last_clean":"2024-04-25T02:18:51.270896+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:18:51.270896+0000","last_undegraded":"2024-04-25T02:18:51.270896+0000","last_fullsized":"2024-04-25T02:18:51.270896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'305","reported_seq":318,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:47.440007+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:18:47.440007+0000","last_peered":"2024-04-25T02:18:47.440007+0000","last_clean":"2024-04-25T02:18:47.440007+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:18:47.440007+0000","last_undegraded":"2024-04-25T02:18:47.440007+0000","last_fullsized":"2024-04-25T02:18:47.440007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":305,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8389252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":12434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'364","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276850+0000","last_change":"2024-04-25T02:10:53.855075+0000","last_active":"2024-04-25T02:18:51.276850+0000","last_peered":"2024-04-25T02:18:51.276850+0000","last_clean":"2024-04-25T02:18:51.276850+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:18:51.276850+0000","last_undegraded":"2024-04-25T02:18:51.276850+0000","last_fullsized":"2024-04-25T02:18:51.276850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'126","reported_seq":139,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.464847+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:18:28.464847+0000","last_peered":"2024-04-25T02:18:28.464847+0000","last_clean":"2024-04-25T02:18:28.464847+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:18:28.464847+0000","last_undegraded":"2024-04-25T02:18:28.464847+0000","last_fullsized":"2024-04-25T02:18:28.464847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":126,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'333","reported_seq":342,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281255+0000","last_change":"2024-04-25T02:10:53.850733+0000","last_active":"2024-04-25T02:18:51.281255+0000","last_peered":"2024-04-25T02:18:51.281255+0000","last_clean":"2024-04-25T02:18:51.281255+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:18:51.281255+0000","last_undegraded":"2024-04-25T02:18:51.281255+0000","last_fullsized":"2024-04-25T02:18:51.281255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835508+0000","last_change":"2024-04-25T02:10:02.370169+0000","last_active":"2024-04-25T02:10:52.835508+0000","last_peered":"2024-04-25T02:10:52.835508+0000","last_clean":"2024-04-25T02:10:52.835508+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:10:52.835508+0000","last_undegraded":"2024-04-25T02:10:52.835508+0000","last_fullsized":"2024-04-25T02:10:52.835508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'353","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268219+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:18:51.268219+0000","last_peered":"2024-04-25T02:18:51.268219+0000","last_clean":"2024-04-25T02:18:51.268219+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:18:51.268219+0000","last_undegraded":"2024-04-25T02:18:51.268219+0000","last_fullsized":"2024-04-25T02:18:51.268219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":353,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'3","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.466944+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:18:28.466944+0000","last_peered":"2024-04-25T02:18:28.466944+0000","last_clean":"2024-04-25T02:18:28.466944+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:18:28.466944+0000","last_undegraded":"2024-04-25T02:18:28.466944+0000","last_fullsized":"2024-04-25T02:18:28.466944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'406","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253893+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:18:51.253893+0000","last_peered":"2024-04-25T02:18:51.253893+0000","last_clean":"2024-04-25T02:18:51.253893+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:18:51.253893+0000","last_undegraded":"2024-04-25T02:18:51.253893+0000","last_fullsized":"2024-04-25T02:18:51.253893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":2547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'135","reported_seq":148,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:43.341218+0000","last_change":"2024-04-25T02:10:02.360557+0000","last_active":"2024-04-25T02:18:43.341218+0000","last_peered":"2024-04-25T02:18:43.341218+0000","last_clean":"2024-04-25T02:18:43.341218+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:18:43.341218+0000","last_undegraded":"2024-04-25T02:18:43.341218+0000","last_fullsized":"2024-04-25T02:18:43.341218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":135,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'351","reported_seq":360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279851+0000","last_change":"2024-04-25T02:10:53.853097+0000","last_active":"2024-04-25T02:18:51.279851+0000","last_peered":"2024-04-25T02:18:51.279851+0000","last_clean":"2024-04-25T02:18:51.279851+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:18:51.279851+0000","last_undegraded":"2024-04-25T02:18:51.279851+0000","last_fullsized":"2024-04-25T02:18:51.279851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'46","reported_seq":59,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:16:36.265281+0000","last_change":"2024-04-25T02:10:02.370637+0000","last_active":"2024-04-25T02:16:36.265281+0000","last_peered":"2024-04-25T02:16:36.265281+0000","last_clean":"2024-04-25T02:16:36.265281+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:16:36.265281+0000","last_undegraded":"2024-04-25T02:16:36.265281+0000","last_fullsized":"2024-04-25T02:16:36.265281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'375","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273633+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:18:51.273633+0000","last_peered":"2024-04-25T02:18:51.273633+0000","last_clean":"2024-04-25T02:18:51.273633+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:18:51.273633+0000","last_undegraded":"2024-04-25T02:18:51.273633+0000","last_fullsized":"2024-04-25T02:18:51.273633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":375,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'107","reported_seq":120,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.406993+0000","last_change":"2024-04-25T02:10:02.358829+0000","last_active":"2024-04-25T02:18:45.406993+0000","last_peered":"2024-04-25T02:18:45.406993+0000","last_clean":"2024-04-25T02:18:45.406993+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:18:45.406993+0000","last_undegraded":"2024-04-25T02:18:45.406993+0000","last_fullsized":"2024-04-25T02:18:45.406993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":107,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'396","reported_seq":408,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.225239+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:18:51.225239+0000","last_peered":"2024-04-25T02:18:51.225239+0000","last_clean":"2024-04-25T02:18:51.225239+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:18:51.225239+0000","last_undegraded":"2024-04-25T02:18:51.225239+0000","last_fullsized":"2024-04-25T02:18:51.225239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":396,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'82","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:42.341444+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:18:42.341444+0000","last_peered":"2024-04-25T02:18:42.341444+0000","last_clean":"2024-04-25T02:18:42.341444+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:18:42.341444+0000","last_undegraded":"2024-04-25T02:18:42.341444+0000","last_fullsized":"2024-04-25T02:18:42.341444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":82,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'356","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280670+0000","last_change":"2024-04-25T02:10:02.744548+0000","last_active":"2024-04-25T02:18:51.280670+0000","last_peered":"2024-04-25T02:18:51.280670+0000","last_clean":"2024-04-25T02:18:51.280670+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:18:51.280670+0000","last_undegraded":"2024-04-25T02:18:51.280670+0000","last_fullsized":"2024-04-25T02:18:51.280670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'32","reported_seq":45,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.375524+0000","last_change":"2024-04-25T02:10:02.371223+0000","last_active":"2024-04-25T02:18:38.375524+0000","last_peered":"2024-04-25T02:18:38.375524+0000","last_clean":"2024-04-25T02:18:38.375524+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:18:38.375524+0000","last_undegraded":"2024-04-25T02:18:38.375524+0000","last_fullsized":"2024-04-25T02:18:38.375524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'398","reported_seq":410,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267105+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:18:51.267105+0000","last_peered":"2024-04-25T02:18:51.267105+0000","last_clean":"2024-04-25T02:18:51.267105+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:18:51.267105+0000","last_undegraded":"2024-04-25T02:18:51.267105+0000","last_fullsized":"2024-04-25T02:18:51.267105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":398,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'114","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:40.356060+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:18:40.356060+0000","last_peered":"2024-04-25T02:18:40.356060+0000","last_clean":"2024-04-25T02:18:40.356060+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:18:40.356060+0000","last_undegraded":"2024-04-25T02:18:40.356060+0000","last_fullsized":"2024-04-25T02:18:40.356060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":114,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":12332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'459","reported_seq":471,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.248908+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:18:51.248908+0000","last_peered":"2024-04-25T02:18:51.248908+0000","last_clean":"2024-04-25T02:18:51.248908+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:18:51.248908+0000","last_undegraded":"2024-04-25T02:18:51.248908+0000","last_fullsized":"2024-04-25T02:18:51.248908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":459,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'74","reported_seq":87,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:40.059312+0000","last_change":"2024-04-25T02:10:02.367348+0000","last_active":"2024-04-25T02:18:40.059312+0000","last_peered":"2024-04-25T02:18:40.059312+0000","last_clean":"2024-04-25T02:18:40.059312+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:18:40.059312+0000","last_undegraded":"2024-04-25T02:18:40.059312+0000","last_fullsized":"2024-04-25T02:18:40.059312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":74,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'354","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279792+0000","last_change":"2024-04-25T02:10:53.851188+0000","last_active":"2024-04-25T02:18:51.279792+0000","last_peered":"2024-04-25T02:18:51.279792+0000","last_clean":"2024-04-25T02:18:51.279792+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:18:51.279792+0000","last_undegraded":"2024-04-25T02:18:51.279792+0000","last_fullsized":"2024-04-25T02:18:51.279792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"19'31","reported_seq":44,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:37.320752+0000","last_change":"2024-04-25T02:10:02.360699+0000","last_active":"2024-04-25T02:18:37.320752+0000","last_peered":"2024-04-25T02:18:37.320752+0000","last_clean":"2024-04-25T02:18:37.320752+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:18:37.320752+0000","last_undegraded":"2024-04-25T02:18:37.320752+0000","last_fullsized":"2024-04-25T02:18:37.320752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'332","reported_seq":344,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275215+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:18:51.275215+0000","last_peered":"2024-04-25T02:18:51.275215+0000","last_clean":"2024-04-25T02:18:51.275215+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:18:51.275215+0000","last_undegraded":"2024-04-25T02:18:51.275215+0000","last_fullsized":"2024-04-25T02:18:51.275215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":332,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'112","reported_seq":125,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:15:40.889041+0000","last_change":"2024-04-25T02:10:02.365974+0000","last_active":"2024-04-25T02:15:40.889041+0000","last_peered":"2024-04-25T02:15:40.889041+0000","last_clean":"2024-04-25T02:15:40.889041+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:15:40.889041+0000","last_undegraded":"2024-04-25T02:15:40.889041+0000","last_fullsized":"2024-04-25T02:15:40.889041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":112,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'328","reported_seq":340,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270459+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:18:51.270459+0000","last_peered":"2024-04-25T02:18:51.270459+0000","last_clean":"2024-04-25T02:18:51.270459+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:18:51.270459+0000","last_undegraded":"2024-04-25T02:18:51.270459+0000","last_fullsized":"2024-04-25T02:18:51.270459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838364+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:10:52.838364+0000","last_peered":"2024-04-25T02:10:52.838364+0000","last_clean":"2024-04-25T02:10:52.838364+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:10:52.838364+0000","last_undegraded":"2024-04-25T02:10:52.838364+0000","last_fullsized":"2024-04-25T02:10:52.838364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'93","reported_seq":106,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.313037+0000","last_change":"2024-04-25T02:10:02.367538+0000","last_active":"2024-04-25T02:18:38.313037+0000","last_peered":"2024-04-25T02:18:38.313037+0000","last_clean":"2024-04-25T02:18:38.313037+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:18:38.313037+0000","last_undegraded":"2024-04-25T02:18:38.313037+0000","last_fullsized":"2024-04-25T02:18:38.313037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":93,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270717+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:18:51.270717+0000","last_peered":"2024-04-25T02:18:51.270717+0000","last_clean":"2024-04-25T02:18:51.270717+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:18:51.270717+0000","last_undegraded":"2024-04-25T02:18:51.270717+0000","last_fullsized":"2024-04-25T02:18:51.270717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839925+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:52.839925+0000","last_peered":"2024-04-25T02:10:52.839925+0000","last_clean":"2024-04-25T02:10:52.839925+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:52.839925+0000","last_undegraded":"2024-04-25T02:10:52.839925+0000","last_fullsized":"2024-04-25T02:10:52.839925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'15","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:43.756248+0000","last_change":"2024-04-25T02:10:02.360464+0000","last_active":"2024-04-25T02:18:43.756248+0000","last_peered":"2024-04-25T02:18:43.756248+0000","last_clean":"2024-04-25T02:18:43.756248+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:18:43.756248+0000","last_undegraded":"2024-04-25T02:18:43.756248+0000","last_fullsized":"2024-04-25T02:18:43.756248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'326","reported_seq":338,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279087+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:18:51.279087+0000","last_peered":"2024-04-25T02:18:51.279087+0000","last_clean":"2024-04-25T02:18:51.279087+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:18:51.279087+0000","last_undegraded":"2024-04-25T02:18:51.279087+0000","last_fullsized":"2024-04-25T02:18:51.279087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":326,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834714+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:10:52.834714+0000","last_peered":"2024-04-25T02:10:52.834714+0000","last_clean":"2024-04-25T02:10:52.834714+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:10:52.834714+0000","last_undegraded":"2024-04-25T02:10:52.834714+0000","last_fullsized":"2024-04-25T02:10:52.834714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'241","reported_seq":254,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:08.991600+0000","last_change":"2024-04-25T02:10:02.361010+0000","last_active":"2024-04-25T02:18:08.991600+0000","last_peered":"2024-04-25T02:18:08.991600+0000","last_clean":"2024-04-25T02:18:08.991600+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:18:08.991600+0000","last_undegraded":"2024-04-25T02:18:08.991600+0000","last_fullsized":"2024-04-25T02:18:08.991600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":241,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":12388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'331","reported_seq":343,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.266717+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:18:51.266717+0000","last_peered":"2024-04-25T02:18:51.266717+0000","last_clean":"2024-04-25T02:18:51.266717+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:18:51.266717+0000","last_undegraded":"2024-04-25T02:18:51.266717+0000","last_fullsized":"2024-04-25T02:18:51.266717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":331,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":2335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842499+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:52.842499+0000","last_peered":"2024-04-25T02:10:52.842499+0000","last_clean":"2024-04-25T02:10:52.842499+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:52.842499+0000","last_undegraded":"2024-04-25T02:10:52.842499+0000","last_fullsized":"2024-04-25T02:10:52.842499+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837741+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:10:52.837741+0000","last_peered":"2024-04-25T02:10:52.837741+0000","last_clean":"2024-04-25T02:10:52.837741+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:10:52.837741+0000","last_undegraded":"2024-04-25T02:10:52.837741+0000","last_fullsized":"2024-04-25T02:10:52.837741+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'160","reported_seq":173,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:32.342332+0000","last_change":"2024-04-25T02:10:02.364629+0000","last_active":"2024-04-25T02:18:32.342332+0000","last_peered":"2024-04-25T02:18:32.342332+0000","last_clean":"2024-04-25T02:18:32.342332+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:18:32.342332+0000","last_undegraded":"2024-04-25T02:18:32.342332+0000","last_fullsized":"2024-04-25T02:18:32.342332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":160,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'344","reported_seq":356,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268567+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:18:51.268567+0000","last_peered":"2024-04-25T02:18:51.268567+0000","last_clean":"2024-04-25T02:18:51.268567+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:18:51.268567+0000","last_undegraded":"2024-04-25T02:18:51.268567+0000","last_fullsized":"2024-04-25T02:18:51.268567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838954+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:52.838954+0000","last_peered":"2024-04-25T02:10:52.838954+0000","last_clean":"2024-04-25T02:10:52.838954+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:52.838954+0000","last_undegraded":"2024-04-25T02:10:52.838954+0000","last_fullsized":"2024-04-25T02:10:52.838954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'626","reported_seq":1261,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:50.371325+0000","last_change":"2024-04-25T02:10:02.356105+0000","last_active":"2024-04-25T02:18:50.371325+0000","last_peered":"2024-04-25T02:18:50.371325+0000","last_clean":"2024-04-25T02:18:50.371325+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:18:50.371325+0000","last_undegraded":"2024-04-25T02:18:50.371325+0000","last_fullsized":"2024-04-25T02:18:50.371325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":626,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1113626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":622,"num_write_kb":1507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'415","reported_seq":427,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263065+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:18:51.263065+0000","last_peered":"2024-04-25T02:18:51.263065+0000","last_clean":"2024-04-25T02:18:51.263065+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:18:51.263065+0000","last_undegraded":"2024-04-25T02:18:51.263065+0000","last_fullsized":"2024-04-25T02:18:51.263065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841699+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:52.841699+0000","last_peered":"2024-04-25T02:10:52.841699+0000","last_clean":"2024-04-25T02:10:52.841699+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:52.841699+0000","last_undegraded":"2024-04-25T02:10:52.841699+0000","last_fullsized":"2024-04-25T02:10:52.841699+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'44","reported_seq":57,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:23.925413+0000","last_change":"2024-04-25T02:10:02.360478+0000","last_active":"2024-04-25T02:18:23.925413+0000","last_peered":"2024-04-25T02:18:23.925413+0000","last_clean":"2024-04-25T02:18:23.925413+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:18:23.925413+0000","last_undegraded":"2024-04-25T02:18:23.925413+0000","last_fullsized":"2024-04-25T02:18:23.925413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'343","reported_seq":355,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271627+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:18:51.271627+0000","last_peered":"2024-04-25T02:18:51.271627+0000","last_clean":"2024-04-25T02:18:51.271627+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:18:51.271627+0000","last_undegraded":"2024-04-25T02:18:51.271627+0000","last_fullsized":"2024-04-25T02:18:51.271627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'63","reported_seq":76,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.385067+0000","last_change":"2024-04-25T02:10:02.370193+0000","last_active":"2024-04-25T02:18:48.385067+0000","last_peered":"2024-04-25T02:18:48.385067+0000","last_clean":"2024-04-25T02:18:48.385067+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:18:48.385067+0000","last_undegraded":"2024-04-25T02:18:48.385067+0000","last_fullsized":"2024-04-25T02:18:48.385067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839006+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:10:52.839006+0000","last_peered":"2024-04-25T02:10:52.839006+0000","last_clean":"2024-04-25T02:10:52.839006+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:10:52.839006+0000","last_undegraded":"2024-04-25T02:10:52.839006+0000","last_fullsized":"2024-04-25T02:10:52.839006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273457+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:18:51.273457+0000","last_peered":"2024-04-25T02:18:51.273457+0000","last_clean":"2024-04-25T02:18:51.273457+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:18:51.273457+0000","last_undegraded":"2024-04-25T02:18:51.273457+0000","last_fullsized":"2024-04-25T02:18:51.273457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841219+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:52.841219+0000","last_peered":"2024-04-25T02:10:52.841219+0000","last_clean":"2024-04-25T02:10:52.841219+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:52.841219+0000","last_undegraded":"2024-04-25T02:10:52.841219+0000","last_fullsized":"2024-04-25T02:10:52.841219+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'71","reported_seq":84,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:43.357215+0000","last_change":"2024-04-25T02:10:02.370537+0000","last_active":"2024-04-25T02:18:43.357215+0000","last_peered":"2024-04-25T02:18:43.357215+0000","last_clean":"2024-04-25T02:18:43.357215+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:18:43.357215+0000","last_undegraded":"2024-04-25T02:18:43.357215+0000","last_fullsized":"2024-04-25T02:18:43.357215+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":71,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'336","reported_seq":348,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277539+0000","last_change":"2024-04-25T02:10:02.748709+0000","last_active":"2024-04-25T02:18:51.277539+0000","last_peered":"2024-04-25T02:18:51.277539+0000","last_clean":"2024-04-25T02:18:51.277539+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:18:51.277539+0000","last_undegraded":"2024-04-25T02:18:51.277539+0000","last_fullsized":"2024-04-25T02:18:51.277539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":336,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'30","reported_seq":43,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.535566+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:18:38.535566+0000","last_peered":"2024-04-25T02:18:38.535566+0000","last_clean":"2024-04-25T02:18:38.535566+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:18:38.535566+0000","last_undegraded":"2024-04-25T02:18:38.535566+0000","last_fullsized":"2024-04-25T02:18:38.535566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281228+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:18:51.281228+0000","last_peered":"2024-04-25T02:18:51.281228+0000","last_clean":"2024-04-25T02:18:51.281228+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:18:51.281228+0000","last_undegraded":"2024-04-25T02:18:51.281228+0000","last_fullsized":"2024-04-25T02:18:51.281228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'46","reported_seq":59,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.361965+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:18:39.361965+0000","last_peered":"2024-04-25T02:18:39.361965+0000","last_clean":"2024-04-25T02:18:39.361965+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:18:39.361965+0000","last_undegraded":"2024-04-25T02:18:39.361965+0000","last_fullsized":"2024-04-25T02:18:39.361965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277504+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:18:51.277504+0000","last_peered":"2024-04-25T02:18:51.277504+0000","last_clean":"2024-04-25T02:18:51.277504+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:18:51.277504+0000","last_undegraded":"2024-04-25T02:18:51.277504+0000","last_fullsized":"2024-04-25T02:18:51.277504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":2199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'244","reported_seq":257,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.342289+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:18:48.342289+0000","last_peered":"2024-04-25T02:18:48.342289+0000","last_clean":"2024-04-25T02:18:48.342289+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:18:48.342289+0000","last_undegraded":"2024-04-25T02:18:48.342289+0000","last_fullsized":"2024-04-25T02:18:48.342289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":244,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277080+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:18:51.277080+0000","last_peered":"2024-04-25T02:18:51.277080+0000","last_clean":"2024-04-25T02:18:51.277080+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:18:51.277080+0000","last_undegraded":"2024-04-25T02:18:51.277080+0000","last_fullsized":"2024-04-25T02:18:51.277080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'110","reported_seq":123,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.799634+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:18:45.799634+0000","last_peered":"2024-04-25T02:18:45.799634+0000","last_clean":"2024-04-25T02:18:45.799634+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:18:45.799634+0000","last_undegraded":"2024-04-25T02:18:45.799634+0000","last_fullsized":"2024-04-25T02:18:45.799634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":110,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'370","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280559+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:18:51.280559+0000","last_peered":"2024-04-25T02:18:51.280559+0000","last_clean":"2024-04-25T02:18:51.280559+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:18:51.280559+0000","last_undegraded":"2024-04-25T02:18:51.280559+0000","last_fullsized":"2024-04-25T02:18:51.280559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":370,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'55","reported_seq":68,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:41.302148+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:18:41.302148+0000","last_peered":"2024-04-25T02:18:41.302148+0000","last_clean":"2024-04-25T02:18:41.302148+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:18:41.302148+0000","last_undegraded":"2024-04-25T02:18:41.302148+0000","last_fullsized":"2024-04-25T02:18:41.302148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":55,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'414","reported_seq":426,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280055+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:18:51.280055+0000","last_peered":"2024-04-25T02:18:51.280055+0000","last_clean":"2024-04-25T02:18:51.280055+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:18:51.280055+0000","last_undegraded":"2024-04-25T02:18:51.280055+0000","last_fullsized":"2024-04-25T02:18:51.280055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":414,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'413","reported_seq":425,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281808+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:18:51.281808+0000","last_peered":"2024-04-25T02:18:51.281808+0000","last_clean":"2024-04-25T02:18:51.281808+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:18:51.281808+0000","last_undegraded":"2024-04-25T02:18:51.281808+0000","last_fullsized":"2024-04-25T02:18:51.281808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":413,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":2919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276676+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:18:51.276676+0000","last_peered":"2024-04-25T02:18:51.276676+0000","last_clean":"2024-04-25T02:18:51.276676+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:18:51.276676+0000","last_undegraded":"2024-04-25T02:18:51.276676+0000","last_fullsized":"2024-04-25T02:18:51.276676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":3172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'394","reported_seq":406,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.251643+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:18:51.251643+0000","last_peered":"2024-04-25T02:18:51.251643+0000","last_clean":"2024-04-25T02:18:51.251643+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:18:51.251643+0000","last_undegraded":"2024-04-25T02:18:51.251643+0000","last_fullsized":"2024-04-25T02:18:51.251643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":394,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.259897+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:18:51.259897+0000","last_peered":"2024-04-25T02:18:51.259897+0000","last_clean":"2024-04-25T02:18:51.259897+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:18:51.259897+0000","last_undegraded":"2024-04-25T02:18:51.259897+0000","last_fullsized":"2024-04-25T02:18:51.259897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281654+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:18:51.281654+0000","last_peered":"2024-04-25T02:18:51.281654+0000","last_clean":"2024-04-25T02:18:51.281654+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:18:51.281654+0000","last_undegraded":"2024-04-25T02:18:51.281654+0000","last_fullsized":"2024-04-25T02:18:51.281654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":167505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23216,"ondisk_log_size":23216,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":158290234,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":3989,"num_write_kb":199375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316637184,"data_stored":316580468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3882,"ondisk_log_size":3882,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705775,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370052,"kb_used_data":72828,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94001788,"statfs":{"total":96636764160,"available":96257830912,"internally_reserved":0,"allocated":74575872,"data_stored":74460098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.22600000000000001,"15min":0.26800000000000002},"min":{"1min":0.16700000000000001,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.36199999999999999,"5min":0.437,"15min":0.44},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.248,"15min":0.29499999999999998},"min":{"1min":0.17999999999999999,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.40899999999999997,"5min":0.50900000000000001,"15min":0.53400000000000003},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.255,"5min":0.26400000000000001,"15min":0.30199999999999999},"min":{"1min":0.191,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39100000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.252,"5min":0.25800000000000001,"15min":0.30199999999999999},"min":{"1min":0.21099999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.373,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.441}]},{"osd":3,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.28399999999999997,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.192,"15min":0.192},"max":{"1min":0.36799999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.28100000000000003,"15min":0.32500000000000001},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":0.39900000000000002,"5min":0.628,"15min":0.628},"last":0.47899999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705774,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405840,"kb_used_data":100424,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93966000,"statfs":{"total":96636764160,"available":96221184000,"internally_reserved":0,"allocated":102834176,"data_stored":102706794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.22600000000000001,"5min":0.23599999999999999,"15min":0.28899999999999998},"min":{"1min":0.17000000000000001,"5min":0.13200000000000001,"15min":0.13200000000000001},"max":{"1min":0.308,"5min":0.43099999999999999,"15min":0.49299999999999999},"last":0.214},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.25,"15min":0.29699999999999999},"min":{"1min":0.17399999999999999,"5min":0.155,"15min":0.155},"max":{"1min":0.36599999999999999,"5min":0.44900000000000001,"15min":0.46700000000000003},"last":0.223}]},{"osd":1,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26700000000000002,"15min":0.318},"min":{"1min":0.20499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.316,"5min":0.47099999999999997,"15min":0.48299999999999998},"last":0.249},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.27000000000000002,"15min":0.316},"min":{"1min":0.20599999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.45200000000000001,"5min":0.46500000000000002,"15min":0.53400000000000003},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27700000000000002,"15min":0.33000000000000002},"min":{"1min":0.219,"5min":0.186,"15min":0.186},"max":{"1min":0.41999999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.255,"5min":0.28399999999999997,"15min":0.32900000000000001},"min":{"1min":0.222,"5min":0.193,"15min":0.193},"max":{"1min":0.41199999999999998,"5min":0.49099999999999999,"15min":0.51900000000000002},"last":0.23499999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705774,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364024,"kb_used_data":66800,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94007816,"statfs":{"total":96636764160,"available":96264003584,"internally_reserved":0,"allocated":68403200,"data_stored":68279904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.222,"15min":0.28899999999999998},"min":{"1min":0.156,"5min":0.156,"15min":0.14399999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.54900000000000004},"last":0.372},{"interface":"front","average":{"1min":0.246,"5min":0.246,"15min":0.29999999999999999},"min":{"1min":0.17000000000000001,"5min":0.16700000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.48799999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.253,"15min":0.316},"min":{"1min":0.19400000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.42399999999999999,"5min":0.42599999999999999,"15min":0.53400000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.317},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.47799999999999998,"5min":0.49399999999999999,"15min":0.52200000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.33400000000000002},"min":{"1min":0.215,"5min":0.182,"15min":0.182},"max":{"1min":0.42999999999999999,"5min":0.49299999999999999,"15min":0.56899999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.309,"5min":0.27400000000000002,"15min":0.32700000000000001},"min":{"1min":0.23200000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705775,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371124,"kb_used_data":69804,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94000716,"statfs":{"total":96636764160,"available":96256733184,"internally_reserved":0,"allocated":71479296,"data_stored":71360528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.218,"15min":0.27300000000000002},"min":{"1min":0.161,"5min":0.154,"15min":0.154},"max":{"1min":0.30099999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23699999999999999,"15min":0.28799999999999998},"min":{"1min":0.16900000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.34799999999999998,"5min":0.46700000000000003,"15min":0.5},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.255,"15min":0.312},"min":{"1min":0.19400000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.318,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.27500000000000002,"15min":0.33300000000000002},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.313,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.26000000000000001,"15min":0.308},"min":{"1min":0.20899999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.32500000000000001,"5min":0.46000000000000002,"15min":0.48399999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.377,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.252}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68239360,"data_stored":68223190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74412032,"data_stored":74403384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102670336,"data_stored":102650080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:18:58.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:18:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.318+0000 7f66c6a9e700 1 Processor -- start 2024-04-25T02:18:58.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.318+0000 7f66c6a9e700 1 -- start start 2024-04-25T02:18:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66c6a9e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f66c0127eb0 0x7f66c01271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66c6a9e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c012fb30 0x7f66c0131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66c6a9e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c0096490 con 0x7f66c0062860 2024-04-25T02:18:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66c6a9e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c0062c40 con 0x7f66c0127eb0 2024-04-25T02:18:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66c6a9e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c0091b90 con 0x7f66c012fb30 2024-04-25T02:18:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66c503b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c012fb30 0x7f66c0131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66bffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f66c0127eb0 0x7f66c01271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66c483a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f66c0062860 0x7f66c01277a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33034/0 (socket says 172.21.15.78:33034) 2024-04-25T02:18:58.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66c483a700 1 -- 172.21.15.78:0/3696140883 learned_addr learned my addr 172.21.15.78:0/3696140883 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66bffff700 1 -- 172.21.15.78:0/3696140883 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c012fb30 msgr2=0x7f66c0131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66bffff700 1 --2- 172.21.15.78:0/3696140883 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c012fb30 0x7f66c0131f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66bffff700 1 -- 172.21.15.78:0/3696140883 >> v1:172.21.15.78:6789/0 conn(0x7f66c0062860 legacy=0x7f66c01277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66bf7fe700 1 -- 172.21.15.78:0/3696140883 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404213563 0 0) 0x7f66c0096490 con 0x7f66c0062860 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66bffff700 1 -- 172.21.15.78:0/3696140883 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0091e50 con 0x7f66c0127eb0 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.319+0000 7f66c503b700 1 --2- 172.21.15.78:0/3696140883 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c012fb30 0x7f66c0131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66bffff700 1 --2- 172.21.15.78:0/3696140883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0127eb0 0x7f66c01271f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f66ac009760 tx=0x7f66ac009060).ready entity=mon.0 client_cookie=ae8bd947849f2566 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66bf7fe700 1 -- 172.21.15.78:0/3696140883 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac00f510 con 0x7f66c0127eb0 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66bf7fe700 1 -- 172.21.15.78:0/3696140883 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac00f670 con 0x7f66c0127eb0 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66bf7fe700 1 -- 172.21.15.78:0/3696140883 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac00f9f0 con 0x7f66c0127eb0 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66c6a9e700 1 -- 172.21.15.78:0/3696140883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0127eb0 msgr2=0x7f66c01271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66c6a9e700 1 --2- 172.21.15.78:0/3696140883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0127eb0 0x7f66c01271f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f66ac009760 tx=0x7f66ac009060).stop 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66c6a9e700 1 -- 172.21.15.78:0/3696140883 shutdown_connections 2024-04-25T02:18:58.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66c6a9e700 1 --2- 172.21.15.78:0/3696140883 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c012fb30 0x7f66c0131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66c6a9e700 1 --2- 172.21.15.78:0/3696140883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0127eb0 0x7f66c01271f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66c6a9e700 1 -- 172.21.15.78:0/3696140883 >> 172.21.15.78:0/3696140883 conn(0x7f66c0097450 msgr2=0x7f66c0097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:58.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66c6a9e700 1 -- 172.21.15.78:0/3696140883 shutdown_connections 2024-04-25T02:18:58.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.320+0000 7f66c6a9e700 1 -- 172.21.15.78:0/3696140883 wait complete. 2024-04-25T02:18:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.321+0000 7f66c6a9e700 1 Processor -- start 2024-04-25T02:18:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.321+0000 7f66c6a9e700 1 -- start start 2024-04-25T02:18:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c6a9e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0062860 0x7f66c0110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c6a9e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c0127eb0 0x7f66c012bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c6a9e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f66c012fb30 0x7f66c012c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c6a9e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c012d060 con 0x7f66c0062860 2024-04-25T02:18:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c6a9e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c012efb0 con 0x7f66c0127eb0 2024-04-25T02:18:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c6a9e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66c012ebe0 con 0x7f66c012fb30 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c483a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0062860 0x7f66c0110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66bffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c0127eb0 0x7f66c012bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c483a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0062860 0x7f66c0110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41286/0 (socket says 172.21.15.78:41286) 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66bffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c0127eb0 0x7f66c012bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39174/0 (socket says 172.21.15.78:39174) 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c483a700 1 -- 172.21.15.78:0/4001501747 learned_addr learned my addr 172.21.15.78:0/4001501747 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c503b700 1 --2- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f66c012fb30 0x7f66c012c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c483a700 1 -- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f66c012fb30 msgr2=0x7f66c012c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c483a700 1 --2- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f66c012fb30 0x7f66c012c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c483a700 1 -- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c0127eb0 msgr2=0x7f66c012bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c483a700 1 --2- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c0127eb0 0x7f66c012bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c483a700 1 -- 172.21.15.78:0/4001501747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b8009a20 con 0x7f66c0062860 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66bffff700 1 --2- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c0127eb0 0x7f66c012bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:58.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c483a700 1 --2- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0062860 0x7f66c0110df0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f66b400c4c0 tx=0x7f66b4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66bd775700 1 -- 172.21.15.78:0/4001501747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b40072e0 con 0x7f66c0062860 2024-04-25T02:18:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66bd775700 1 -- 172.21.15.78:0/4001501747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4007440 con 0x7f66c0062860 2024-04-25T02:18:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.322+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac0092a0 con 0x7f66c0062860 2024-04-25T02:18:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.323+0000 7f66bd775700 1 -- 172.21.15.78:0/4001501747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b40057a0 con 0x7f66c0062860 2024-04-25T02:18:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.323+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c012d640 con 0x7f66c0062860 2024-04-25T02:18:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.323+0000 7f66bd775700 1 -- 172.21.15.78:0/4001501747 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f66b4005bd0 con 0x7f66c0062860 2024-04-25T02:18:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.323+0000 7f66bd775700 1 -- 172.21.15.78:0/4001501747 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f66b403a980 con 0x7f66c0062860 2024-04-25T02:18:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.324+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c0097f70 con 0x7f66c0062860 2024-04-25T02:18:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.328+0000 7f66bd775700 1 -- 172.21.15.78:0/4001501747 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f66b401d3f0 con 0x7f66c0062860 2024-04-25T02:18:58.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.487+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66c012f4b0 con 0x7f66a402bd00 2024-04-25T02:18:58.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.493+0000 7f66bd775700 1 -- 172.21.15.78:0/4001501747 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256384 (unknown 2965378022 0 1532867347) 0x7f66ac00fdb0 con 0x7f66a402bd00 2024-04-25T02:18:58.501 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:18:58.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 >> v1:172.21.15.78:6816/46507 conn(0x7f66a402bd00 legacy=0x7f66a402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0062860 msgr2=0x7f66c0110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 --2- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0062860 0x7f66c0110df0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f66b400c4c0 tx=0x7f66b4007c10).stop 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 shutdown_connections 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 --2- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f66c012fb30 0x7f66c012c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 --2- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66c0062860 0x7f66c0110df0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 --2- 172.21.15.78:0/4001501747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66c0127eb0 0x7f66c012bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 >> 172.21.15.78:0/4001501747 conn(0x7f66c0097450 msgr2=0x7f66c0092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 shutdown_connections 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.496+0000 7f66c6a9e700 1 -- 172.21.15.78:0/4001501747 wait complete. 2024-04-25T02:18:58.503 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:18:58.511 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-04-25T02:18:58.303973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":27629,"num_write_kb":366886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27102,"ondisk_log_size":27102,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1511048,"kb_used_data":309864,"kb_used_omap":0,"kb_used_meta":1201152,"kb_avail":375976312,"statfs":{"total":386547056640,"available":384999743488,"internally_reserved":0,"allocated":317300736,"data_stored":316815546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1229979648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-83264835,"num_objects":-2905,"num_object_clones":0,"num_object_copies":-5810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2905,"num_whiteouts":0,"num_read":22,"num_read_kb":304,"num_write":3278,"num_write_kb":7670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002819"},"pg_stats":[{"pgid":"4.3f","version":"19'354","reported_seq":366,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275043+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:18:51.275043+0000","last_peered":"2024-04-25T02:18:51.275043+0000","last_clean":"2024-04-25T02:18:51.275043+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:18:51.275043+0000","last_undegraded":"2024-04-25T02:18:51.275043+0000","last_fullsized":"2024-04-25T02:18:51.275043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277671+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:18:51.277671+0000","last_peered":"2024-04-25T02:18:51.277671+0000","last_clean":"2024-04-25T02:18:51.277671+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:18:51.277671+0000","last_undegraded":"2024-04-25T02:18:51.277671+0000","last_fullsized":"2024-04-25T02:18:51.277671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267056+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:18:51.267056+0000","last_peered":"2024-04-25T02:18:51.267056+0000","last_clean":"2024-04-25T02:18:51.267056+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:18:51.267056+0000","last_undegraded":"2024-04-25T02:18:51.267056+0000","last_fullsized":"2024-04-25T02:18:51.267056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267040+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:18:51.267040+0000","last_peered":"2024-04-25T02:18:51.267040+0000","last_clean":"2024-04-25T02:18:51.267040+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:18:51.267040+0000","last_undegraded":"2024-04-25T02:18:51.267040+0000","last_fullsized":"2024-04-25T02:18:51.267040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269216+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:18:51.269216+0000","last_peered":"2024-04-25T02:18:51.269216+0000","last_clean":"2024-04-25T02:18:51.269216+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:18:51.269216+0000","last_undegraded":"2024-04-25T02:18:51.269216+0000","last_fullsized":"2024-04-25T02:18:51.269216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278782+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:18:51.278782+0000","last_peered":"2024-04-25T02:18:51.278782+0000","last_clean":"2024-04-25T02:18:51.278782+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:18:51.278782+0000","last_undegraded":"2024-04-25T02:18:51.278782+0000","last_fullsized":"2024-04-25T02:18:51.278782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'376","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272984+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:18:51.272984+0000","last_peered":"2024-04-25T02:18:51.272984+0000","last_clean":"2024-04-25T02:18:51.272984+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:18:51.272984+0000","last_undegraded":"2024-04-25T02:18:51.272984+0000","last_fullsized":"2024-04-25T02:18:51.272984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":376,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":3216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'297","reported_seq":309,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272124+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:18:51.272124+0000","last_peered":"2024-04-25T02:18:51.272124+0000","last_clean":"2024-04-25T02:18:51.272124+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:18:51.272124+0000","last_undegraded":"2024-04-25T02:18:51.272124+0000","last_fullsized":"2024-04-25T02:18:51.272124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":297,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":2172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269598+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:18:51.269598+0000","last_peered":"2024-04-25T02:18:51.269598+0000","last_clean":"2024-04-25T02:18:51.269598+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:18:51.269598+0000","last_undegraded":"2024-04-25T02:18:51.269598+0000","last_fullsized":"2024-04-25T02:18:51.269598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'351","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267201+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:18:51.267201+0000","last_peered":"2024-04-25T02:18:51.267201+0000","last_clean":"2024-04-25T02:18:51.267201+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:18:51.267201+0000","last_undegraded":"2024-04-25T02:18:51.267201+0000","last_fullsized":"2024-04-25T02:18:51.267201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.256733+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:18:51.256733+0000","last_peered":"2024-04-25T02:18:51.256733+0000","last_clean":"2024-04-25T02:18:51.256733+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:18:51.256733+0000","last_undegraded":"2024-04-25T02:18:51.256733+0000","last_fullsized":"2024-04-25T02:18:51.256733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":2530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'322","reported_seq":334,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277216+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:18:51.277216+0000","last_peered":"2024-04-25T02:18:51.277216+0000","last_clean":"2024-04-25T02:18:51.277216+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:18:51.277216+0000","last_undegraded":"2024-04-25T02:18:51.277216+0000","last_fullsized":"2024-04-25T02:18:51.277216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":322,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'359","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277681+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:18:51.277681+0000","last_peered":"2024-04-25T02:18:51.277681+0000","last_clean":"2024-04-25T02:18:51.277681+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:18:51.277681+0000","last_undegraded":"2024-04-25T02:18:51.277681+0000","last_fullsized":"2024-04-25T02:18:51.277681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":359,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":2645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278233+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:18:51.278233+0000","last_peered":"2024-04-25T02:18:51.278233+0000","last_clean":"2024-04-25T02:18:51.278233+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:18:51.278233+0000","last_undegraded":"2024-04-25T02:18:51.278233+0000","last_fullsized":"2024-04-25T02:18:51.278233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253088+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:18:51.253088+0000","last_peered":"2024-04-25T02:18:51.253088+0000","last_clean":"2024-04-25T02:18:51.253088+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:18:51.253088+0000","last_undegraded":"2024-04-25T02:18:51.253088+0000","last_fullsized":"2024-04-25T02:18:51.253088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'380","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271052+0000","last_change":"2024-04-25T02:10:53.852512+0000","last_active":"2024-04-25T02:18:51.271052+0000","last_peered":"2024-04-25T02:18:51.271052+0000","last_clean":"2024-04-25T02:18:51.271052+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:18:51.271052+0000","last_undegraded":"2024-04-25T02:18:51.271052+0000","last_fullsized":"2024-04-25T02:18:51.271052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":380,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.264403+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:18:51.264403+0000","last_peered":"2024-04-25T02:18:51.264403+0000","last_clean":"2024-04-25T02:18:51.264403+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:18:51.264403+0000","last_undegraded":"2024-04-25T02:18:51.264403+0000","last_fullsized":"2024-04-25T02:18:51.264403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'340","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253849+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:18:51.253849+0000","last_peered":"2024-04-25T02:18:51.253849+0000","last_clean":"2024-04-25T02:18:51.253849+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:18:51.253849+0000","last_undegraded":"2024-04-25T02:18:51.253849+0000","last_fullsized":"2024-04-25T02:18:51.253849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'356","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276313+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:18:51.276313+0000","last_peered":"2024-04-25T02:18:51.276313+0000","last_clean":"2024-04-25T02:18:51.276313+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:18:51.276313+0000","last_undegraded":"2024-04-25T02:18:51.276313+0000","last_fullsized":"2024-04-25T02:18:51.276313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269721+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:18:51.269721+0000","last_peered":"2024-04-25T02:18:51.269721+0000","last_clean":"2024-04-25T02:18:51.269721+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:18:51.269721+0000","last_undegraded":"2024-04-25T02:18:51.269721+0000","last_fullsized":"2024-04-25T02:18:51.269721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'344","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273747+0000","last_change":"2024-04-25T02:10:53.852792+0000","last_active":"2024-04-25T02:18:51.273747+0000","last_peered":"2024-04-25T02:18:51.273747+0000","last_clean":"2024-04-25T02:18:51.273747+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:18:51.273747+0000","last_undegraded":"2024-04-25T02:18:51.273747+0000","last_fullsized":"2024-04-25T02:18:51.273747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'383","reported_seq":395,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267045+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:18:51.267045+0000","last_peered":"2024-04-25T02:18:51.267045+0000","last_clean":"2024-04-25T02:18:51.267045+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:18:51.267045+0000","last_undegraded":"2024-04-25T02:18:51.267045+0000","last_fullsized":"2024-04-25T02:18:51.267045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":2481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'350","reported_seq":362,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273435+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:18:51.273435+0000","last_peered":"2024-04-25T02:18:51.273435+0000","last_clean":"2024-04-25T02:18:51.273435+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:18:51.273435+0000","last_undegraded":"2024-04-25T02:18:51.273435+0000","last_fullsized":"2024-04-25T02:18:51.273435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":350,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271458+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:18:51.271458+0000","last_peered":"2024-04-25T02:18:51.271458+0000","last_clean":"2024-04-25T02:18:51.271458+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:18:51.271458+0000","last_undegraded":"2024-04-25T02:18:51.271458+0000","last_fullsized":"2024-04-25T02:18:51.271458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'386","reported_seq":398,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.250133+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:18:51.250133+0000","last_peered":"2024-04-25T02:18:51.250133+0000","last_clean":"2024-04-25T02:18:51.250133+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:18:51.250133+0000","last_undegraded":"2024-04-25T02:18:51.250133+0000","last_fullsized":"2024-04-25T02:18:51.250133+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281870+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:18:51.281870+0000","last_peered":"2024-04-25T02:18:51.281870+0000","last_clean":"2024-04-25T02:18:51.281870+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:18:51.281870+0000","last_undegraded":"2024-04-25T02:18:51.281870+0000","last_fullsized":"2024-04-25T02:18:51.281870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":421,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268411+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:18:51.268411+0000","last_peered":"2024-04-25T02:18:51.268411+0000","last_clean":"2024-04-25T02:18:51.268411+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:18:51.268411+0000","last_undegraded":"2024-04-25T02:18:51.268411+0000","last_fullsized":"2024-04-25T02:18:51.268411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'154","reported_seq":167,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.381581+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:18:45.381581+0000","last_peered":"2024-04-25T02:18:45.381581+0000","last_clean":"2024-04-25T02:18:45.381581+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:18:45.381581+0000","last_undegraded":"2024-04-25T02:18:45.381581+0000","last_fullsized":"2024-04-25T02:18:45.381581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":154,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":16455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'334","reported_seq":346,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272426+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:18:51.272426+0000","last_peered":"2024-04-25T02:18:51.272426+0000","last_clean":"2024-04-25T02:18:51.272426+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:18:51.272426+0000","last_undegraded":"2024-04-25T02:18:51.272426+0000","last_fullsized":"2024-04-25T02:18:51.272426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":334,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'76","reported_seq":89,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:44.365713+0000","last_change":"2024-04-25T02:10:02.370405+0000","last_active":"2024-04-25T02:18:44.365713+0000","last_peered":"2024-04-25T02:18:44.365713+0000","last_clean":"2024-04-25T02:18:44.365713+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:18:44.365713+0000","last_undegraded":"2024-04-25T02:18:44.365713+0000","last_fullsized":"2024-04-25T02:18:44.365713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":76,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'347","reported_seq":359,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263176+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:18:51.263176+0000","last_peered":"2024-04-25T02:18:51.263176+0000","last_clean":"2024-04-25T02:18:51.263176+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:18:51.263176+0000","last_undegraded":"2024-04-25T02:18:51.263176+0000","last_fullsized":"2024-04-25T02:18:51.263176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":347,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'243","reported_seq":256,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:31.210530+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:18:31.210530+0000","last_peered":"2024-04-25T02:18:31.210530+0000","last_clean":"2024-04-25T02:18:31.210530+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:18:31.210530+0000","last_undegraded":"2024-04-25T02:18:31.210530+0000","last_fullsized":"2024-04-25T02:18:31.210530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270570+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:18:51.270570+0000","last_peered":"2024-04-25T02:18:51.270570+0000","last_clean":"2024-04-25T02:18:51.270570+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:18:51.270570+0000","last_undegraded":"2024-04-25T02:18:51.270570+0000","last_fullsized":"2024-04-25T02:18:51.270570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'6","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.386829+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:18:39.386829+0000","last_peered":"2024-04-25T02:18:39.386829+0000","last_clean":"2024-04-25T02:18:39.386829+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:18:39.386829+0000","last_undegraded":"2024-04-25T02:18:39.386829+0000","last_fullsized":"2024-04-25T02:18:39.386829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'377","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273185+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:18:51.273185+0000","last_peered":"2024-04-25T02:18:51.273185+0000","last_clean":"2024-04-25T02:18:51.273185+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:18:51.273185+0000","last_undegraded":"2024-04-25T02:18:51.273185+0000","last_fullsized":"2024-04-25T02:18:51.273185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":377,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":2757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'80","reported_seq":93,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:53.336567+0000","last_change":"2024-04-25T02:10:02.367526+0000","last_active":"2024-04-25T02:18:53.336567+0000","last_peered":"2024-04-25T02:18:53.336567+0000","last_clean":"2024-04-25T02:18:53.336567+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:18:53.336567+0000","last_undegraded":"2024-04-25T02:18:53.336567+0000","last_fullsized":"2024-04-25T02:18:53.336567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":80,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6184361,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'412","reported_seq":424,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273256+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:18:51.273256+0000","last_peered":"2024-04-25T02:18:51.273256+0000","last_clean":"2024-04-25T02:18:51.273256+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:18:51.273256+0000","last_undegraded":"2024-04-25T02:18:51.273256+0000","last_fullsized":"2024-04-25T02:18:51.273256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":412,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'361","reported_seq":374,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.493452+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:18:48.493452+0000","last_peered":"2024-04-25T02:18:48.493452+0000","last_clean":"2024-04-25T02:18:48.493452+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:18:48.493452+0000","last_undegraded":"2024-04-25T02:18:48.493452+0000","last_fullsized":"2024-04-25T02:18:48.493452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":361,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270896+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:18:51.270896+0000","last_peered":"2024-04-25T02:18:51.270896+0000","last_clean":"2024-04-25T02:18:51.270896+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:18:51.270896+0000","last_undegraded":"2024-04-25T02:18:51.270896+0000","last_fullsized":"2024-04-25T02:18:51.270896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'305","reported_seq":318,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:47.440007+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:18:47.440007+0000","last_peered":"2024-04-25T02:18:47.440007+0000","last_clean":"2024-04-25T02:18:47.440007+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:18:47.440007+0000","last_undegraded":"2024-04-25T02:18:47.440007+0000","last_fullsized":"2024-04-25T02:18:47.440007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":305,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8389252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":12434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'364","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276850+0000","last_change":"2024-04-25T02:10:53.855075+0000","last_active":"2024-04-25T02:18:51.276850+0000","last_peered":"2024-04-25T02:18:51.276850+0000","last_clean":"2024-04-25T02:18:51.276850+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:18:51.276850+0000","last_undegraded":"2024-04-25T02:18:51.276850+0000","last_fullsized":"2024-04-25T02:18:51.276850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'126","reported_seq":139,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.464847+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:18:28.464847+0000","last_peered":"2024-04-25T02:18:28.464847+0000","last_clean":"2024-04-25T02:18:28.464847+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:18:28.464847+0000","last_undegraded":"2024-04-25T02:18:28.464847+0000","last_fullsized":"2024-04-25T02:18:28.464847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":126,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'333","reported_seq":342,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281255+0000","last_change":"2024-04-25T02:10:53.850733+0000","last_active":"2024-04-25T02:18:51.281255+0000","last_peered":"2024-04-25T02:18:51.281255+0000","last_clean":"2024-04-25T02:18:51.281255+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:18:51.281255+0000","last_undegraded":"2024-04-25T02:18:51.281255+0000","last_fullsized":"2024-04-25T02:18:51.281255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835508+0000","last_change":"2024-04-25T02:10:02.370169+0000","last_active":"2024-04-25T02:10:52.835508+0000","last_peered":"2024-04-25T02:10:52.835508+0000","last_clean":"2024-04-25T02:10:52.835508+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:10:52.835508+0000","last_undegraded":"2024-04-25T02:10:52.835508+0000","last_fullsized":"2024-04-25T02:10:52.835508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'353","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268219+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:18:51.268219+0000","last_peered":"2024-04-25T02:18:51.268219+0000","last_clean":"2024-04-25T02:18:51.268219+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:18:51.268219+0000","last_undegraded":"2024-04-25T02:18:51.268219+0000","last_fullsized":"2024-04-25T02:18:51.268219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":353,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'3","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.466944+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:18:28.466944+0000","last_peered":"2024-04-25T02:18:28.466944+0000","last_clean":"2024-04-25T02:18:28.466944+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:18:28.466944+0000","last_undegraded":"2024-04-25T02:18:28.466944+0000","last_fullsized":"2024-04-25T02:18:28.466944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'406","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253893+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:18:51.253893+0000","last_peered":"2024-04-25T02:18:51.253893+0000","last_clean":"2024-04-25T02:18:51.253893+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:18:51.253893+0000","last_undegraded":"2024-04-25T02:18:51.253893+0000","last_fullsized":"2024-04-25T02:18:51.253893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":2547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'135","reported_seq":148,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:43.341218+0000","last_change":"2024-04-25T02:10:02.360557+0000","last_active":"2024-04-25T02:18:43.341218+0000","last_peered":"2024-04-25T02:18:43.341218+0000","last_clean":"2024-04-25T02:18:43.341218+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:18:43.341218+0000","last_undegraded":"2024-04-25T02:18:43.341218+0000","last_fullsized":"2024-04-25T02:18:43.341218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":135,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'351","reported_seq":360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279851+0000","last_change":"2024-04-25T02:10:53.853097+0000","last_active":"2024-04-25T02:18:51.279851+0000","last_peered":"2024-04-25T02:18:51.279851+0000","last_clean":"2024-04-25T02:18:51.279851+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:18:51.279851+0000","last_undegraded":"2024-04-25T02:18:51.279851+0000","last_fullsized":"2024-04-25T02:18:51.279851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'46","reported_seq":59,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:16:36.265281+0000","last_change":"2024-04-25T02:10:02.370637+0000","last_active":"2024-04-25T02:16:36.265281+0000","last_peered":"2024-04-25T02:16:36.265281+0000","last_clean":"2024-04-25T02:16:36.265281+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:16:36.265281+0000","last_undegraded":"2024-04-25T02:16:36.265281+0000","last_fullsized":"2024-04-25T02:16:36.265281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'375","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273633+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:18:51.273633+0000","last_peered":"2024-04-25T02:18:51.273633+0000","last_clean":"2024-04-25T02:18:51.273633+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:18:51.273633+0000","last_undegraded":"2024-04-25T02:18:51.273633+0000","last_fullsized":"2024-04-25T02:18:51.273633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":375,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'107","reported_seq":120,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.406993+0000","last_change":"2024-04-25T02:10:02.358829+0000","last_active":"2024-04-25T02:18:45.406993+0000","last_peered":"2024-04-25T02:18:45.406993+0000","last_clean":"2024-04-25T02:18:45.406993+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:18:45.406993+0000","last_undegraded":"2024-04-25T02:18:45.406993+0000","last_fullsized":"2024-04-25T02:18:45.406993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":107,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'396","reported_seq":408,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.225239+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:18:51.225239+0000","last_peered":"2024-04-25T02:18:51.225239+0000","last_clean":"2024-04-25T02:18:51.225239+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:18:51.225239+0000","last_undegraded":"2024-04-25T02:18:51.225239+0000","last_fullsized":"2024-04-25T02:18:51.225239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":396,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'82","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:42.341444+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:18:42.341444+0000","last_peered":"2024-04-25T02:18:42.341444+0000","last_clean":"2024-04-25T02:18:42.341444+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:18:42.341444+0000","last_undegraded":"2024-04-25T02:18:42.341444+0000","last_fullsized":"2024-04-25T02:18:42.341444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":82,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'356","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280670+0000","last_change":"2024-04-25T02:10:02.744548+0000","last_active":"2024-04-25T02:18:51.280670+0000","last_peered":"2024-04-25T02:18:51.280670+0000","last_clean":"2024-04-25T02:18:51.280670+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:18:51.280670+0000","last_undegraded":"2024-04-25T02:18:51.280670+0000","last_fullsized":"2024-04-25T02:18:51.280670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'32","reported_seq":45,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.375524+0000","last_change":"2024-04-25T02:10:02.371223+0000","last_active":"2024-04-25T02:18:38.375524+0000","last_peered":"2024-04-25T02:18:38.375524+0000","last_clean":"2024-04-25T02:18:38.375524+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:18:38.375524+0000","last_undegraded":"2024-04-25T02:18:38.375524+0000","last_fullsized":"2024-04-25T02:18:38.375524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'398","reported_seq":410,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267105+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:18:51.267105+0000","last_peered":"2024-04-25T02:18:51.267105+0000","last_clean":"2024-04-25T02:18:51.267105+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:18:51.267105+0000","last_undegraded":"2024-04-25T02:18:51.267105+0000","last_fullsized":"2024-04-25T02:18:51.267105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":398,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'114","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:40.356060+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:18:40.356060+0000","last_peered":"2024-04-25T02:18:40.356060+0000","last_clean":"2024-04-25T02:18:40.356060+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:18:40.356060+0000","last_undegraded":"2024-04-25T02:18:40.356060+0000","last_fullsized":"2024-04-25T02:18:40.356060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":114,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":12332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'459","reported_seq":471,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.248908+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:18:51.248908+0000","last_peered":"2024-04-25T02:18:51.248908+0000","last_clean":"2024-04-25T02:18:51.248908+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:18:51.248908+0000","last_undegraded":"2024-04-25T02:18:51.248908+0000","last_fullsized":"2024-04-25T02:18:51.248908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":459,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'74","reported_seq":87,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:40.059312+0000","last_change":"2024-04-25T02:10:02.367348+0000","last_active":"2024-04-25T02:18:40.059312+0000","last_peered":"2024-04-25T02:18:40.059312+0000","last_clean":"2024-04-25T02:18:40.059312+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:18:40.059312+0000","last_undegraded":"2024-04-25T02:18:40.059312+0000","last_fullsized":"2024-04-25T02:18:40.059312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":74,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'354","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279792+0000","last_change":"2024-04-25T02:10:53.851188+0000","last_active":"2024-04-25T02:18:51.279792+0000","last_peered":"2024-04-25T02:18:51.279792+0000","last_clean":"2024-04-25T02:18:51.279792+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:18:51.279792+0000","last_undegraded":"2024-04-25T02:18:51.279792+0000","last_fullsized":"2024-04-25T02:18:51.279792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"19'31","reported_seq":44,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:37.320752+0000","last_change":"2024-04-25T02:10:02.360699+0000","last_active":"2024-04-25T02:18:37.320752+0000","last_peered":"2024-04-25T02:18:37.320752+0000","last_clean":"2024-04-25T02:18:37.320752+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:18:37.320752+0000","last_undegraded":"2024-04-25T02:18:37.320752+0000","last_fullsized":"2024-04-25T02:18:37.320752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'332","reported_seq":344,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275215+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:18:51.275215+0000","last_peered":"2024-04-25T02:18:51.275215+0000","last_clean":"2024-04-25T02:18:51.275215+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:18:51.275215+0000","last_undegraded":"2024-04-25T02:18:51.275215+0000","last_fullsized":"2024-04-25T02:18:51.275215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":332,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'112","reported_seq":125,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:15:40.889041+0000","last_change":"2024-04-25T02:10:02.365974+0000","last_active":"2024-04-25T02:15:40.889041+0000","last_peered":"2024-04-25T02:15:40.889041+0000","last_clean":"2024-04-25T02:15:40.889041+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:15:40.889041+0000","last_undegraded":"2024-04-25T02:15:40.889041+0000","last_fullsized":"2024-04-25T02:15:40.889041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":112,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'328","reported_seq":340,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270459+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:18:51.270459+0000","last_peered":"2024-04-25T02:18:51.270459+0000","last_clean":"2024-04-25T02:18:51.270459+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:18:51.270459+0000","last_undegraded":"2024-04-25T02:18:51.270459+0000","last_fullsized":"2024-04-25T02:18:51.270459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838364+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:10:52.838364+0000","last_peered":"2024-04-25T02:10:52.838364+0000","last_clean":"2024-04-25T02:10:52.838364+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:10:52.838364+0000","last_undegraded":"2024-04-25T02:10:52.838364+0000","last_fullsized":"2024-04-25T02:10:52.838364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'93","reported_seq":106,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.313037+0000","last_change":"2024-04-25T02:10:02.367538+0000","last_active":"2024-04-25T02:18:38.313037+0000","last_peered":"2024-04-25T02:18:38.313037+0000","last_clean":"2024-04-25T02:18:38.313037+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:18:38.313037+0000","last_undegraded":"2024-04-25T02:18:38.313037+0000","last_fullsized":"2024-04-25T02:18:38.313037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":93,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270717+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:18:51.270717+0000","last_peered":"2024-04-25T02:18:51.270717+0000","last_clean":"2024-04-25T02:18:51.270717+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:18:51.270717+0000","last_undegraded":"2024-04-25T02:18:51.270717+0000","last_fullsized":"2024-04-25T02:18:51.270717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839925+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:52.839925+0000","last_peered":"2024-04-25T02:10:52.839925+0000","last_clean":"2024-04-25T02:10:52.839925+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:52.839925+0000","last_undegraded":"2024-04-25T02:10:52.839925+0000","last_fullsized":"2024-04-25T02:10:52.839925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'15","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:43.756248+0000","last_change":"2024-04-25T02:10:02.360464+0000","last_active":"2024-04-25T02:18:43.756248+0000","last_peered":"2024-04-25T02:18:43.756248+0000","last_clean":"2024-04-25T02:18:43.756248+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:18:43.756248+0000","last_undegraded":"2024-04-25T02:18:43.756248+0000","last_fullsized":"2024-04-25T02:18:43.756248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'326","reported_seq":338,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279087+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:18:51.279087+0000","last_peered":"2024-04-25T02:18:51.279087+0000","last_clean":"2024-04-25T02:18:51.279087+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:18:51.279087+0000","last_undegraded":"2024-04-25T02:18:51.279087+0000","last_fullsized":"2024-04-25T02:18:51.279087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":326,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834714+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:10:52.834714+0000","last_peered":"2024-04-25T02:10:52.834714+0000","last_clean":"2024-04-25T02:10:52.834714+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:10:52.834714+0000","last_undegraded":"2024-04-25T02:10:52.834714+0000","last_fullsized":"2024-04-25T02:10:52.834714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'241","reported_seq":254,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:08.991600+0000","last_change":"2024-04-25T02:10:02.361010+0000","last_active":"2024-04-25T02:18:08.991600+0000","last_peered":"2024-04-25T02:18:08.991600+0000","last_clean":"2024-04-25T02:18:08.991600+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:18:08.991600+0000","last_undegraded":"2024-04-25T02:18:08.991600+0000","last_fullsized":"2024-04-25T02:18:08.991600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":241,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":12388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'331","reported_seq":343,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.266717+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:18:51.266717+0000","last_peered":"2024-04-25T02:18:51.266717+0000","last_clean":"2024-04-25T02:18:51.266717+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:18:51.266717+0000","last_undegraded":"2024-04-25T02:18:51.266717+0000","last_fullsized":"2024-04-25T02:18:51.266717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":331,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":2335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842499+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:52.842499+0000","last_peered":"2024-04-25T02:10:52.842499+0000","last_clean":"2024-04-25T02:10:52.842499+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:52.842499+0000","last_undegraded":"2024-04-25T02:10:52.842499+0000","last_fullsized":"2024-04-25T02:10:52.842499+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837741+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:10:52.837741+0000","last_peered":"2024-04-25T02:10:52.837741+0000","last_clean":"2024-04-25T02:10:52.837741+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:10:52.837741+0000","last_undegraded":"2024-04-25T02:10:52.837741+0000","last_fullsized":"2024-04-25T02:10:52.837741+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'160","reported_seq":173,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:32.342332+0000","last_change":"2024-04-25T02:10:02.364629+0000","last_active":"2024-04-25T02:18:32.342332+0000","last_peered":"2024-04-25T02:18:32.342332+0000","last_clean":"2024-04-25T02:18:32.342332+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:18:32.342332+0000","last_undegraded":"2024-04-25T02:18:32.342332+0000","last_fullsized":"2024-04-25T02:18:32.342332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":160,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'344","reported_seq":356,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268567+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:18:51.268567+0000","last_peered":"2024-04-25T02:18:51.268567+0000","last_clean":"2024-04-25T02:18:51.268567+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:18:51.268567+0000","last_undegraded":"2024-04-25T02:18:51.268567+0000","last_fullsized":"2024-04-25T02:18:51.268567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838954+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:52.838954+0000","last_peered":"2024-04-25T02:10:52.838954+0000","last_clean":"2024-04-25T02:10:52.838954+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:52.838954+0000","last_undegraded":"2024-04-25T02:10:52.838954+0000","last_fullsized":"2024-04-25T02:10:52.838954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'626","reported_seq":1261,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:50.371325+0000","last_change":"2024-04-25T02:10:02.356105+0000","last_active":"2024-04-25T02:18:50.371325+0000","last_peered":"2024-04-25T02:18:50.371325+0000","last_clean":"2024-04-25T02:18:50.371325+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:18:50.371325+0000","last_undegraded":"2024-04-25T02:18:50.371325+0000","last_fullsized":"2024-04-25T02:18:50.371325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":626,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1113626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":622,"num_write_kb":1507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'415","reported_seq":427,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263065+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:18:51.263065+0000","last_peered":"2024-04-25T02:18:51.263065+0000","last_clean":"2024-04-25T02:18:51.263065+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:18:51.263065+0000","last_undegraded":"2024-04-25T02:18:51.263065+0000","last_fullsized":"2024-04-25T02:18:51.263065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841699+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:52.841699+0000","last_peered":"2024-04-25T02:10:52.841699+0000","last_clean":"2024-04-25T02:10:52.841699+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:52.841699+0000","last_undegraded":"2024-04-25T02:10:52.841699+0000","last_fullsized":"2024-04-25T02:10:52.841699+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'44","reported_seq":57,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:23.925413+0000","last_change":"2024-04-25T02:10:02.360478+0000","last_active":"2024-04-25T02:18:23.925413+0000","last_peered":"2024-04-25T02:18:23.925413+0000","last_clean":"2024-04-25T02:18:23.925413+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:18:23.925413+0000","last_undegraded":"2024-04-25T02:18:23.925413+0000","last_fullsized":"2024-04-25T02:18:23.925413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'343","reported_seq":355,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271627+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:18:51.271627+0000","last_peered":"2024-04-25T02:18:51.271627+0000","last_clean":"2024-04-25T02:18:51.271627+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:18:51.271627+0000","last_undegraded":"2024-04-25T02:18:51.271627+0000","last_fullsized":"2024-04-25T02:18:51.271627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'63","reported_seq":76,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.385067+0000","last_change":"2024-04-25T02:10:02.370193+0000","last_active":"2024-04-25T02:18:48.385067+0000","last_peered":"2024-04-25T02:18:48.385067+0000","last_clean":"2024-04-25T02:18:48.385067+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:18:48.385067+0000","last_undegraded":"2024-04-25T02:18:48.385067+0000","last_fullsized":"2024-04-25T02:18:48.385067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839006+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:10:52.839006+0000","last_peered":"2024-04-25T02:10:52.839006+0000","last_clean":"2024-04-25T02:10:52.839006+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:10:52.839006+0000","last_undegraded":"2024-04-25T02:10:52.839006+0000","last_fullsized":"2024-04-25T02:10:52.839006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273457+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:18:51.273457+0000","last_peered":"2024-04-25T02:18:51.273457+0000","last_clean":"2024-04-25T02:18:51.273457+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:18:51.273457+0000","last_undegraded":"2024-04-25T02:18:51.273457+0000","last_fullsized":"2024-04-25T02:18:51.273457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841219+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:52.841219+0000","last_peered":"2024-04-25T02:10:52.841219+0000","last_clean":"2024-04-25T02:10:52.841219+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:52.841219+0000","last_undegraded":"2024-04-25T02:10:52.841219+0000","last_fullsized":"2024-04-25T02:10:52.841219+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'72","reported_seq":85,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.339279+0000","last_change":"2024-04-25T02:10:02.370537+0000","last_active":"2024-04-25T02:18:48.339279+0000","last_peered":"2024-04-25T02:18:48.339279+0000","last_clean":"2024-04-25T02:18:48.339279+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:18:48.339279+0000","last_undegraded":"2024-04-25T02:18:48.339279+0000","last_fullsized":"2024-04-25T02:18:48.339279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":72,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'336","reported_seq":348,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277539+0000","last_change":"2024-04-25T02:10:02.748709+0000","last_active":"2024-04-25T02:18:51.277539+0000","last_peered":"2024-04-25T02:18:51.277539+0000","last_clean":"2024-04-25T02:18:51.277539+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:18:51.277539+0000","last_undegraded":"2024-04-25T02:18:51.277539+0000","last_fullsized":"2024-04-25T02:18:51.277539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":336,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'30","reported_seq":43,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.535566+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:18:38.535566+0000","last_peered":"2024-04-25T02:18:38.535566+0000","last_clean":"2024-04-25T02:18:38.535566+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:18:38.535566+0000","last_undegraded":"2024-04-25T02:18:38.535566+0000","last_fullsized":"2024-04-25T02:18:38.535566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281228+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:18:51.281228+0000","last_peered":"2024-04-25T02:18:51.281228+0000","last_clean":"2024-04-25T02:18:51.281228+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:18:51.281228+0000","last_undegraded":"2024-04-25T02:18:51.281228+0000","last_fullsized":"2024-04-25T02:18:51.281228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'46","reported_seq":59,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.361965+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:18:39.361965+0000","last_peered":"2024-04-25T02:18:39.361965+0000","last_clean":"2024-04-25T02:18:39.361965+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:18:39.361965+0000","last_undegraded":"2024-04-25T02:18:39.361965+0000","last_fullsized":"2024-04-25T02:18:39.361965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277504+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:18:51.277504+0000","last_peered":"2024-04-25T02:18:51.277504+0000","last_clean":"2024-04-25T02:18:51.277504+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:18:51.277504+0000","last_undegraded":"2024-04-25T02:18:51.277504+0000","last_fullsized":"2024-04-25T02:18:51.277504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":2199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'244","reported_seq":257,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.342289+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:18:48.342289+0000","last_peered":"2024-04-25T02:18:48.342289+0000","last_clean":"2024-04-25T02:18:48.342289+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:18:48.342289+0000","last_undegraded":"2024-04-25T02:18:48.342289+0000","last_fullsized":"2024-04-25T02:18:48.342289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":244,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277080+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:18:51.277080+0000","last_peered":"2024-04-25T02:18:51.277080+0000","last_clean":"2024-04-25T02:18:51.277080+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:18:51.277080+0000","last_undegraded":"2024-04-25T02:18:51.277080+0000","last_fullsized":"2024-04-25T02:18:51.277080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'110","reported_seq":123,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.799634+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:18:45.799634+0000","last_peered":"2024-04-25T02:18:45.799634+0000","last_clean":"2024-04-25T02:18:45.799634+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:18:45.799634+0000","last_undegraded":"2024-04-25T02:18:45.799634+0000","last_fullsized":"2024-04-25T02:18:45.799634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":110,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'370","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280559+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:18:51.280559+0000","last_peered":"2024-04-25T02:18:51.280559+0000","last_clean":"2024-04-25T02:18:51.280559+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:18:51.280559+0000","last_undegraded":"2024-04-25T02:18:51.280559+0000","last_fullsized":"2024-04-25T02:18:51.280559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":370,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'55","reported_seq":68,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:41.302148+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:18:41.302148+0000","last_peered":"2024-04-25T02:18:41.302148+0000","last_clean":"2024-04-25T02:18:41.302148+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:18:41.302148+0000","last_undegraded":"2024-04-25T02:18:41.302148+0000","last_fullsized":"2024-04-25T02:18:41.302148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":55,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'414","reported_seq":426,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280055+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:18:51.280055+0000","last_peered":"2024-04-25T02:18:51.280055+0000","last_clean":"2024-04-25T02:18:51.280055+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:18:51.280055+0000","last_undegraded":"2024-04-25T02:18:51.280055+0000","last_fullsized":"2024-04-25T02:18:51.280055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":414,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'413","reported_seq":425,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281808+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:18:51.281808+0000","last_peered":"2024-04-25T02:18:51.281808+0000","last_clean":"2024-04-25T02:18:51.281808+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:18:51.281808+0000","last_undegraded":"2024-04-25T02:18:51.281808+0000","last_fullsized":"2024-04-25T02:18:51.281808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":413,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":2919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276676+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:18:51.276676+0000","last_peered":"2024-04-25T02:18:51.276676+0000","last_clean":"2024-04-25T02:18:51.276676+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:18:51.276676+0000","last_undegraded":"2024-04-25T02:18:51.276676+0000","last_fullsized":"2024-04-25T02:18:51.276676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":3172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'394","reported_seq":406,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.251643+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:18:51.251643+0000","last_peered":"2024-04-25T02:18:51.251643+0000","last_clean":"2024-04-25T02:18:51.251643+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:18:51.251643+0000","last_undegraded":"2024-04-25T02:18:51.251643+0000","last_fullsized":"2024-04-25T02:18:51.251643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":394,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.259897+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:18:51.259897+0000","last_peered":"2024-04-25T02:18:51.259897+0000","last_clean":"2024-04-25T02:18:51.259897+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:18:51.259897+0000","last_undegraded":"2024-04-25T02:18:51.259897+0000","last_fullsized":"2024-04-25T02:18:51.259897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281654+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:18:51.281654+0000","last_peered":"2024-04-25T02:18:51.281654+0000","last_clean":"2024-04-25T02:18:51.281654+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:18:51.281654+0000","last_undegraded":"2024-04-25T02:18:51.281654+0000","last_fullsized":"2024-04-25T02:18:51.281654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":167505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23216,"ondisk_log_size":23216,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":3994,"num_write_kb":199381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316645376,"data_stored":316588690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3886,"ondisk_log_size":3886,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705776,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370056,"kb_used_data":72832,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94001784,"statfs":{"total":96636764160,"available":96257826816,"internally_reserved":0,"allocated":74579968,"data_stored":74464209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.22600000000000001,"15min":0.26800000000000002},"min":{"1min":0.16700000000000001,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.36199999999999999,"5min":0.437,"15min":0.44},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.248,"15min":0.29499999999999998},"min":{"1min":0.17999999999999999,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.40899999999999997,"5min":0.50900000000000001,"15min":0.53400000000000003},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.255,"5min":0.26400000000000001,"15min":0.30199999999999999},"min":{"1min":0.191,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39100000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.252,"5min":0.25800000000000001,"15min":0.30199999999999999},"min":{"1min":0.21099999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.373,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.441}]},{"osd":3,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.28399999999999997,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.192,"15min":0.192},"max":{"1min":0.36799999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.28100000000000003,"15min":0.32500000000000001},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":0.39900000000000002,"5min":0.628,"15min":0.628},"last":0.47899999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705775,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405844,"kb_used_data":100428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93965996,"statfs":{"total":96636764160,"available":96221179904,"internally_reserved":0,"allocated":102838272,"data_stored":102710905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.22600000000000001,"5min":0.23599999999999999,"15min":0.28899999999999998},"min":{"1min":0.17000000000000001,"5min":0.13200000000000001,"15min":0.13200000000000001},"max":{"1min":0.308,"5min":0.43099999999999999,"15min":0.49299999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.25,"15min":0.29699999999999999},"min":{"1min":0.17399999999999999,"5min":0.155,"15min":0.155},"max":{"1min":0.36599999999999999,"5min":0.44900000000000001,"15min":0.46700000000000003},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26700000000000002,"15min":0.318},"min":{"1min":0.20499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.316,"5min":0.47099999999999997,"15min":0.48299999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.27000000000000002,"15min":0.316},"min":{"1min":0.20599999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.45200000000000001,"5min":0.46500000000000002,"15min":0.53400000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27700000000000002,"15min":0.33000000000000002},"min":{"1min":0.219,"5min":0.186,"15min":0.186},"max":{"1min":0.41999999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.255,"5min":0.28399999999999997,"15min":0.32900000000000001},"min":{"1min":0.222,"5min":0.193,"15min":0.193},"max":{"1min":0.41199999999999998,"5min":0.49099999999999999,"15min":0.51900000000000002},"last":0.496}]}]},{"osd":0,"up_from":9,"seq":38654705775,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364024,"kb_used_data":66800,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94007816,"statfs":{"total":96636764160,"available":96264003584,"internally_reserved":0,"allocated":68403200,"data_stored":68279904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.222,"15min":0.28899999999999998},"min":{"1min":0.156,"5min":0.156,"15min":0.14399999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.54900000000000004},"last":0.309},{"interface":"front","average":{"1min":0.246,"5min":0.246,"15min":0.29999999999999999},"min":{"1min":0.17000000000000001,"5min":0.16700000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.48799999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.253,"15min":0.316},"min":{"1min":0.19400000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.42399999999999999,"5min":0.42599999999999999,"15min":0.53400000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.317},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.47799999999999998,"5min":0.49399999999999999,"15min":0.52200000000000002},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.33400000000000002},"min":{"1min":0.215,"5min":0.182,"15min":0.182},"max":{"1min":0.42999999999999999,"5min":0.49299999999999999,"15min":0.56899999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.309,"5min":0.27400000000000002,"15min":0.32700000000000001},"min":{"1min":0.23200000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705776,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371124,"kb_used_data":69804,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94000716,"statfs":{"total":96636764160,"available":96256733184,"internally_reserved":0,"allocated":71479296,"data_stored":71360528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.218,"15min":0.27300000000000002},"min":{"1min":0.161,"5min":0.154,"15min":0.154},"max":{"1min":0.30099999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23699999999999999,"15min":0.28799999999999998},"min":{"1min":0.16900000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.34799999999999998,"5min":0.46700000000000003,"15min":0.5},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.255,"15min":0.312},"min":{"1min":0.19400000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.318,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.27500000000000002,"15min":0.33300000000000002},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.313,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.502}]},{"osd":3,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.26000000000000001,"15min":0.308},"min":{"1min":0.20899999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.32500000000000001,"5min":0.46000000000000002,"15min":0.48399999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.377,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68239360,"data_stored":68223190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74416128,"data_stored":74407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102674432,"data_stored":102654191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:18:58.515 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:18:58.515 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:18:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.662+0000 7f72af6af700 1 Processor -- start 2024-04-25T02:18:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72af6af700 1 -- start start 2024-04-25T02:18:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72af6af700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f72a8127eb0 0x7f72a81271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72af6af700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a812fb30 0x7f72a8131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72af6af700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a8096490 con 0x7f72a8062860 2024-04-25T02:18:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72af6af700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a8062c40 con 0x7f72a8127eb0 2024-04-25T02:18:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72af6af700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8091b90 con 0x7f72a812fb30 2024-04-25T02:18:58.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72adc4c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a812fb30 0x7f72a8131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72acc4a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f72a8127eb0 0x7f72a81271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72adc4c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a812fb30 0x7f72a8131f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33272/0 (socket says 172.21.15.78:33272) 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72adc4c700 1 -- 172.21.15.78:0/673170013 learned_addr learned my addr 172.21.15.78:0/673170013 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72ad44b700 1 --1- 172.21.15.78:0/673170013 >> v1:172.21.15.78:6789/0 conn(0x7f72a8062860 0x7f72a81277a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33050/0 (socket says 172.21.15.78:33050) 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72acc4a700 1 -- 172.21.15.78:0/673170013 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a812fb30 msgr2=0x7f72a8131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72acc4a700 1 --2- 172.21.15.78:0/673170013 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a812fb30 0x7f72a8131f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72acc4a700 1 -- 172.21.15.78:0/673170013 >> v1:172.21.15.78:6789/0 conn(0x7f72a8062860 legacy=0x7f72a81277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72acc4a700 1 -- 172.21.15.78:0/673170013 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8091e50 con 0x7f72a8127eb0 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f729ffff700 1 -- 172.21.15.78:0/673170013 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640127867 0 0) 0x7f72a8096490 con 0x7f72a8062860 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.663+0000 7f72adc4c700 1 --2- 172.21.15.78:0/673170013 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a812fb30 0x7f72a8131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f72acc4a700 1 --2- 172.21.15.78:0/673170013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a8127eb0 0x7f72a81271f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f72a4009760 tx=0x7f72a4009060).ready entity=mon.0 client_cookie=37c45a3318eae83e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f729ffff700 1 -- 172.21.15.78:0/673170013 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a400f510 con 0x7f72a8127eb0 2024-04-25T02:18:58.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f729ffff700 1 -- 172.21.15.78:0/673170013 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a400f670 con 0x7f72a8127eb0 2024-04-25T02:18:58.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f729ffff700 1 -- 172.21.15.78:0/673170013 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a400f9f0 con 0x7f72a8127eb0 2024-04-25T02:18:58.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f72af6af700 1 -- 172.21.15.78:0/673170013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a8127eb0 msgr2=0x7f72a81271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f72af6af700 1 --2- 172.21.15.78:0/673170013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a8127eb0 0x7f72a81271f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f72a4009760 tx=0x7f72a4009060).stop 2024-04-25T02:18:58.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f72af6af700 1 -- 172.21.15.78:0/673170013 shutdown_connections 2024-04-25T02:18:58.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f72af6af700 1 --2- 172.21.15.78:0/673170013 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a812fb30 0x7f72a8131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f72af6af700 1 --2- 172.21.15.78:0/673170013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a8127eb0 0x7f72a81271f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f72af6af700 1 -- 172.21.15.78:0/673170013 >> 172.21.15.78:0/673170013 conn(0x7f72a8097450 msgr2=0x7f72a8097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:58.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f72af6af700 1 -- 172.21.15.78:0/673170013 shutdown_connections 2024-04-25T02:18:58.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.664+0000 7f72af6af700 1 -- 172.21.15.78:0/673170013 wait complete. 2024-04-25T02:18:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.665+0000 7f72af6af700 1 Processor -- start 2024-04-25T02:18:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.665+0000 7f72af6af700 1 -- start start 2024-04-25T02:18:58.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72af6af700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f72a8062860 0x7f72a8110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72af6af700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a8127eb0 0x7f72a812bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72af6af700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a812fb30 0x7f72a812c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72af6af700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a812d060 con 0x7f72a812fb30 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72af6af700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a812efb0 con 0x7f72a8062860 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72af6af700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72a812ebe0 con 0x7f72a8127eb0 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72ad44b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f72a8062860 0x7f72a8110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72adc4c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a812fb30 0x7f72a812c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72adc4c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a812fb30 0x7f72a812c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41300/0 (socket says 172.21.15.78:41300) 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72ad44b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f72a8062860 0x7f72a8110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39182/0 (socket says 172.21.15.78:39182) 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72adc4c700 1 -- 172.21.15.78:0/18997682 learned_addr learned my addr 172.21.15.78:0/18997682 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72acc4a700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a8127eb0 0x7f72a812bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72adc4c700 1 -- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a8127eb0 msgr2=0x7f72a812bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72adc4c700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a8127eb0 0x7f72a812bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72adc4c700 1 -- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f72a8062860 msgr2=0x7f72a8110df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72adc4c700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f72a8062860 0x7f72a8110df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72adc4c700 1 -- 172.21.15.78:0/18997682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0009ae0 con 0x7f72a812fb30 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72acc4a700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a8127eb0 0x7f72a812bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72ad44b700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f72a8062860 0x7f72a8110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72adc4c700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a812fb30 0x7f72a812c0b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f72a0009fa0 tx=0x7f72a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f729dffb700 1 -- 172.21.15.78:0/18997682 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a000c990 con 0x7f72a812fb30 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f729dffb700 1 -- 172.21.15.78:0/18997682 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a000f040 con 0x7f72a812fb30 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f729dffb700 1 -- 172.21.15.78:0/18997682 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a000cd00 con 0x7f72a812fb30 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.666+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a40092a0 con 0x7f72a812fb30 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.667+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a812d640 con 0x7f72a812fb30 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.667+0000 7f729dffb700 1 -- 172.21.15.78:0/18997682 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f72a0007400 con 0x7f72a812fb30 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.667+0000 7f729dffb700 1 -- 172.21.15.78:0/18997682 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f72a003b320 con 0x7f72a812fb30 2024-04-25T02:18:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.668+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a8097f70 con 0x7f72a812fb30 2024-04-25T02:18:58.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.672+0000 7f729dffb700 1 -- 172.21.15.78:0/18997682 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f72a00076b0 con 0x7f72a812fb30 2024-04-25T02:18:58.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.831+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72a812f4b0 con 0x7f728c02bd00 2024-04-25T02:18:58.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.838+0000 7f729dffb700 1 -- 172.21.15.78:0/18997682 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256384 (unknown 2965378022 0 1532867347) 0x7f7298001670 con 0x7f728c02bd00 2024-04-25T02:18:58.845 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 >> v1:172.21.15.78:6816/46507 conn(0x7f728c02bd00 legacy=0x7f728c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a812fb30 msgr2=0x7f72a812c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a812fb30 0x7f72a812c0b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f72a0009fa0 tx=0x7f72a000b040).stop 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 shutdown_connections 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72a812fb30 0x7f72a812c0b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f72a8062860 0x7f72a8110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 --2- 172.21.15.78:0/18997682 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f72a8127eb0 0x7f72a812bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 >> 172.21.15.78:0/18997682 conn(0x7f72a8097450 msgr2=0x7f72a8092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 shutdown_connections 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:58.841+0000 7f72af6af700 1 -- 172.21.15.78:0/18997682 wait complete. 2024-04-25T02:18:58.847 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:18:58.856 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-04-25T02:18:58.303973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":27629,"num_write_kb":366886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27102,"ondisk_log_size":27102,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1511048,"kb_used_data":309864,"kb_used_omap":0,"kb_used_meta":1201152,"kb_avail":375976312,"statfs":{"total":386547056640,"available":384999743488,"internally_reserved":0,"allocated":317300736,"data_stored":316815546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1229979648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-83264835,"num_objects":-2905,"num_object_clones":0,"num_object_copies":-5810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2905,"num_whiteouts":0,"num_read":22,"num_read_kb":304,"num_write":3278,"num_write_kb":7670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002819"},"pg_stats":[{"pgid":"4.3f","version":"19'354","reported_seq":366,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275043+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:18:51.275043+0000","last_peered":"2024-04-25T02:18:51.275043+0000","last_clean":"2024-04-25T02:18:51.275043+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:18:51.275043+0000","last_undegraded":"2024-04-25T02:18:51.275043+0000","last_fullsized":"2024-04-25T02:18:51.275043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277671+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:18:51.277671+0000","last_peered":"2024-04-25T02:18:51.277671+0000","last_clean":"2024-04-25T02:18:51.277671+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:18:51.277671+0000","last_undegraded":"2024-04-25T02:18:51.277671+0000","last_fullsized":"2024-04-25T02:18:51.277671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267056+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:18:51.267056+0000","last_peered":"2024-04-25T02:18:51.267056+0000","last_clean":"2024-04-25T02:18:51.267056+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:18:51.267056+0000","last_undegraded":"2024-04-25T02:18:51.267056+0000","last_fullsized":"2024-04-25T02:18:51.267056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267040+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:18:51.267040+0000","last_peered":"2024-04-25T02:18:51.267040+0000","last_clean":"2024-04-25T02:18:51.267040+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:18:51.267040+0000","last_undegraded":"2024-04-25T02:18:51.267040+0000","last_fullsized":"2024-04-25T02:18:51.267040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269216+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:18:51.269216+0000","last_peered":"2024-04-25T02:18:51.269216+0000","last_clean":"2024-04-25T02:18:51.269216+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:18:51.269216+0000","last_undegraded":"2024-04-25T02:18:51.269216+0000","last_fullsized":"2024-04-25T02:18:51.269216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278782+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:18:51.278782+0000","last_peered":"2024-04-25T02:18:51.278782+0000","last_clean":"2024-04-25T02:18:51.278782+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:18:51.278782+0000","last_undegraded":"2024-04-25T02:18:51.278782+0000","last_fullsized":"2024-04-25T02:18:51.278782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'376","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272984+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:18:51.272984+0000","last_peered":"2024-04-25T02:18:51.272984+0000","last_clean":"2024-04-25T02:18:51.272984+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:18:51.272984+0000","last_undegraded":"2024-04-25T02:18:51.272984+0000","last_fullsized":"2024-04-25T02:18:51.272984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":376,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":3216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'297","reported_seq":309,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272124+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:18:51.272124+0000","last_peered":"2024-04-25T02:18:51.272124+0000","last_clean":"2024-04-25T02:18:51.272124+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:18:51.272124+0000","last_undegraded":"2024-04-25T02:18:51.272124+0000","last_fullsized":"2024-04-25T02:18:51.272124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":297,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":2172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269598+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:18:51.269598+0000","last_peered":"2024-04-25T02:18:51.269598+0000","last_clean":"2024-04-25T02:18:51.269598+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:18:51.269598+0000","last_undegraded":"2024-04-25T02:18:51.269598+0000","last_fullsized":"2024-04-25T02:18:51.269598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'351","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267201+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:18:51.267201+0000","last_peered":"2024-04-25T02:18:51.267201+0000","last_clean":"2024-04-25T02:18:51.267201+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:18:51.267201+0000","last_undegraded":"2024-04-25T02:18:51.267201+0000","last_fullsized":"2024-04-25T02:18:51.267201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.256733+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:18:51.256733+0000","last_peered":"2024-04-25T02:18:51.256733+0000","last_clean":"2024-04-25T02:18:51.256733+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:18:51.256733+0000","last_undegraded":"2024-04-25T02:18:51.256733+0000","last_fullsized":"2024-04-25T02:18:51.256733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":2530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'322","reported_seq":334,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277216+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:18:51.277216+0000","last_peered":"2024-04-25T02:18:51.277216+0000","last_clean":"2024-04-25T02:18:51.277216+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:18:51.277216+0000","last_undegraded":"2024-04-25T02:18:51.277216+0000","last_fullsized":"2024-04-25T02:18:51.277216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":322,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'359","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277681+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:18:51.277681+0000","last_peered":"2024-04-25T02:18:51.277681+0000","last_clean":"2024-04-25T02:18:51.277681+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:18:51.277681+0000","last_undegraded":"2024-04-25T02:18:51.277681+0000","last_fullsized":"2024-04-25T02:18:51.277681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":359,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":2645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278233+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:18:51.278233+0000","last_peered":"2024-04-25T02:18:51.278233+0000","last_clean":"2024-04-25T02:18:51.278233+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:18:51.278233+0000","last_undegraded":"2024-04-25T02:18:51.278233+0000","last_fullsized":"2024-04-25T02:18:51.278233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253088+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:18:51.253088+0000","last_peered":"2024-04-25T02:18:51.253088+0000","last_clean":"2024-04-25T02:18:51.253088+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:18:51.253088+0000","last_undegraded":"2024-04-25T02:18:51.253088+0000","last_fullsized":"2024-04-25T02:18:51.253088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'380","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271052+0000","last_change":"2024-04-25T02:10:53.852512+0000","last_active":"2024-04-25T02:18:51.271052+0000","last_peered":"2024-04-25T02:18:51.271052+0000","last_clean":"2024-04-25T02:18:51.271052+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:18:51.271052+0000","last_undegraded":"2024-04-25T02:18:51.271052+0000","last_fullsized":"2024-04-25T02:18:51.271052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":380,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.264403+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:18:51.264403+0000","last_peered":"2024-04-25T02:18:51.264403+0000","last_clean":"2024-04-25T02:18:51.264403+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:18:51.264403+0000","last_undegraded":"2024-04-25T02:18:51.264403+0000","last_fullsized":"2024-04-25T02:18:51.264403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'340","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253849+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:18:51.253849+0000","last_peered":"2024-04-25T02:18:51.253849+0000","last_clean":"2024-04-25T02:18:51.253849+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:18:51.253849+0000","last_undegraded":"2024-04-25T02:18:51.253849+0000","last_fullsized":"2024-04-25T02:18:51.253849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'356","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276313+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:18:51.276313+0000","last_peered":"2024-04-25T02:18:51.276313+0000","last_clean":"2024-04-25T02:18:51.276313+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:18:51.276313+0000","last_undegraded":"2024-04-25T02:18:51.276313+0000","last_fullsized":"2024-04-25T02:18:51.276313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269721+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:18:51.269721+0000","last_peered":"2024-04-25T02:18:51.269721+0000","last_clean":"2024-04-25T02:18:51.269721+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:18:51.269721+0000","last_undegraded":"2024-04-25T02:18:51.269721+0000","last_fullsized":"2024-04-25T02:18:51.269721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'344","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273747+0000","last_change":"2024-04-25T02:10:53.852792+0000","last_active":"2024-04-25T02:18:51.273747+0000","last_peered":"2024-04-25T02:18:51.273747+0000","last_clean":"2024-04-25T02:18:51.273747+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:18:51.273747+0000","last_undegraded":"2024-04-25T02:18:51.273747+0000","last_fullsized":"2024-04-25T02:18:51.273747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'383","reported_seq":395,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267045+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:18:51.267045+0000","last_peered":"2024-04-25T02:18:51.267045+0000","last_clean":"2024-04-25T02:18:51.267045+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:18:51.267045+0000","last_undegraded":"2024-04-25T02:18:51.267045+0000","last_fullsized":"2024-04-25T02:18:51.267045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":2481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'350","reported_seq":362,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273435+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:18:51.273435+0000","last_peered":"2024-04-25T02:18:51.273435+0000","last_clean":"2024-04-25T02:18:51.273435+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:18:51.273435+0000","last_undegraded":"2024-04-25T02:18:51.273435+0000","last_fullsized":"2024-04-25T02:18:51.273435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":350,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271458+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:18:51.271458+0000","last_peered":"2024-04-25T02:18:51.271458+0000","last_clean":"2024-04-25T02:18:51.271458+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:18:51.271458+0000","last_undegraded":"2024-04-25T02:18:51.271458+0000","last_fullsized":"2024-04-25T02:18:51.271458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'386","reported_seq":398,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.250133+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:18:51.250133+0000","last_peered":"2024-04-25T02:18:51.250133+0000","last_clean":"2024-04-25T02:18:51.250133+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:18:51.250133+0000","last_undegraded":"2024-04-25T02:18:51.250133+0000","last_fullsized":"2024-04-25T02:18:51.250133+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281870+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:18:51.281870+0000","last_peered":"2024-04-25T02:18:51.281870+0000","last_clean":"2024-04-25T02:18:51.281870+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:18:51.281870+0000","last_undegraded":"2024-04-25T02:18:51.281870+0000","last_fullsized":"2024-04-25T02:18:51.281870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":421,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268411+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:18:51.268411+0000","last_peered":"2024-04-25T02:18:51.268411+0000","last_clean":"2024-04-25T02:18:51.268411+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:18:51.268411+0000","last_undegraded":"2024-04-25T02:18:51.268411+0000","last_fullsized":"2024-04-25T02:18:51.268411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'154","reported_seq":167,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.381581+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:18:45.381581+0000","last_peered":"2024-04-25T02:18:45.381581+0000","last_clean":"2024-04-25T02:18:45.381581+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:18:45.381581+0000","last_undegraded":"2024-04-25T02:18:45.381581+0000","last_fullsized":"2024-04-25T02:18:45.381581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":154,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":16455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'334","reported_seq":346,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272426+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:18:51.272426+0000","last_peered":"2024-04-25T02:18:51.272426+0000","last_clean":"2024-04-25T02:18:51.272426+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:18:51.272426+0000","last_undegraded":"2024-04-25T02:18:51.272426+0000","last_fullsized":"2024-04-25T02:18:51.272426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":334,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'76","reported_seq":89,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:44.365713+0000","last_change":"2024-04-25T02:10:02.370405+0000","last_active":"2024-04-25T02:18:44.365713+0000","last_peered":"2024-04-25T02:18:44.365713+0000","last_clean":"2024-04-25T02:18:44.365713+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:18:44.365713+0000","last_undegraded":"2024-04-25T02:18:44.365713+0000","last_fullsized":"2024-04-25T02:18:44.365713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":76,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'347","reported_seq":359,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263176+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:18:51.263176+0000","last_peered":"2024-04-25T02:18:51.263176+0000","last_clean":"2024-04-25T02:18:51.263176+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:18:51.263176+0000","last_undegraded":"2024-04-25T02:18:51.263176+0000","last_fullsized":"2024-04-25T02:18:51.263176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":347,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'243","reported_seq":256,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:31.210530+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:18:31.210530+0000","last_peered":"2024-04-25T02:18:31.210530+0000","last_clean":"2024-04-25T02:18:31.210530+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:18:31.210530+0000","last_undegraded":"2024-04-25T02:18:31.210530+0000","last_fullsized":"2024-04-25T02:18:31.210530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270570+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:18:51.270570+0000","last_peered":"2024-04-25T02:18:51.270570+0000","last_clean":"2024-04-25T02:18:51.270570+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:18:51.270570+0000","last_undegraded":"2024-04-25T02:18:51.270570+0000","last_fullsized":"2024-04-25T02:18:51.270570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'6","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.386829+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:18:39.386829+0000","last_peered":"2024-04-25T02:18:39.386829+0000","last_clean":"2024-04-25T02:18:39.386829+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:18:39.386829+0000","last_undegraded":"2024-04-25T02:18:39.386829+0000","last_fullsized":"2024-04-25T02:18:39.386829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'377","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273185+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:18:51.273185+0000","last_peered":"2024-04-25T02:18:51.273185+0000","last_clean":"2024-04-25T02:18:51.273185+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:18:51.273185+0000","last_undegraded":"2024-04-25T02:18:51.273185+0000","last_fullsized":"2024-04-25T02:18:51.273185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":377,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":2757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'80","reported_seq":93,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:53.336567+0000","last_change":"2024-04-25T02:10:02.367526+0000","last_active":"2024-04-25T02:18:53.336567+0000","last_peered":"2024-04-25T02:18:53.336567+0000","last_clean":"2024-04-25T02:18:53.336567+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:18:53.336567+0000","last_undegraded":"2024-04-25T02:18:53.336567+0000","last_fullsized":"2024-04-25T02:18:53.336567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":80,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6184361,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'412","reported_seq":424,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273256+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:18:51.273256+0000","last_peered":"2024-04-25T02:18:51.273256+0000","last_clean":"2024-04-25T02:18:51.273256+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:18:51.273256+0000","last_undegraded":"2024-04-25T02:18:51.273256+0000","last_fullsized":"2024-04-25T02:18:51.273256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":412,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'361","reported_seq":374,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.493452+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:18:48.493452+0000","last_peered":"2024-04-25T02:18:48.493452+0000","last_clean":"2024-04-25T02:18:48.493452+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:18:48.493452+0000","last_undegraded":"2024-04-25T02:18:48.493452+0000","last_fullsized":"2024-04-25T02:18:48.493452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":361,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270896+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:18:51.270896+0000","last_peered":"2024-04-25T02:18:51.270896+0000","last_clean":"2024-04-25T02:18:51.270896+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:18:51.270896+0000","last_undegraded":"2024-04-25T02:18:51.270896+0000","last_fullsized":"2024-04-25T02:18:51.270896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'305","reported_seq":318,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:47.440007+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:18:47.440007+0000","last_peered":"2024-04-25T02:18:47.440007+0000","last_clean":"2024-04-25T02:18:47.440007+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:18:47.440007+0000","last_undegraded":"2024-04-25T02:18:47.440007+0000","last_fullsized":"2024-04-25T02:18:47.440007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":305,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8389252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":12434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'364","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276850+0000","last_change":"2024-04-25T02:10:53.855075+0000","last_active":"2024-04-25T02:18:51.276850+0000","last_peered":"2024-04-25T02:18:51.276850+0000","last_clean":"2024-04-25T02:18:51.276850+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:18:51.276850+0000","last_undegraded":"2024-04-25T02:18:51.276850+0000","last_fullsized":"2024-04-25T02:18:51.276850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'126","reported_seq":139,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.464847+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:18:28.464847+0000","last_peered":"2024-04-25T02:18:28.464847+0000","last_clean":"2024-04-25T02:18:28.464847+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:18:28.464847+0000","last_undegraded":"2024-04-25T02:18:28.464847+0000","last_fullsized":"2024-04-25T02:18:28.464847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":126,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'333","reported_seq":342,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281255+0000","last_change":"2024-04-25T02:10:53.850733+0000","last_active":"2024-04-25T02:18:51.281255+0000","last_peered":"2024-04-25T02:18:51.281255+0000","last_clean":"2024-04-25T02:18:51.281255+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:18:51.281255+0000","last_undegraded":"2024-04-25T02:18:51.281255+0000","last_fullsized":"2024-04-25T02:18:51.281255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835508+0000","last_change":"2024-04-25T02:10:02.370169+0000","last_active":"2024-04-25T02:10:52.835508+0000","last_peered":"2024-04-25T02:10:52.835508+0000","last_clean":"2024-04-25T02:10:52.835508+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:10:52.835508+0000","last_undegraded":"2024-04-25T02:10:52.835508+0000","last_fullsized":"2024-04-25T02:10:52.835508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'353","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268219+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:18:51.268219+0000","last_peered":"2024-04-25T02:18:51.268219+0000","last_clean":"2024-04-25T02:18:51.268219+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:18:51.268219+0000","last_undegraded":"2024-04-25T02:18:51.268219+0000","last_fullsized":"2024-04-25T02:18:51.268219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":353,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'3","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.466944+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:18:28.466944+0000","last_peered":"2024-04-25T02:18:28.466944+0000","last_clean":"2024-04-25T02:18:28.466944+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:18:28.466944+0000","last_undegraded":"2024-04-25T02:18:28.466944+0000","last_fullsized":"2024-04-25T02:18:28.466944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'406","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253893+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:18:51.253893+0000","last_peered":"2024-04-25T02:18:51.253893+0000","last_clean":"2024-04-25T02:18:51.253893+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:18:51.253893+0000","last_undegraded":"2024-04-25T02:18:51.253893+0000","last_fullsized":"2024-04-25T02:18:51.253893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":2547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'135","reported_seq":148,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:43.341218+0000","last_change":"2024-04-25T02:10:02.360557+0000","last_active":"2024-04-25T02:18:43.341218+0000","last_peered":"2024-04-25T02:18:43.341218+0000","last_clean":"2024-04-25T02:18:43.341218+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:18:43.341218+0000","last_undegraded":"2024-04-25T02:18:43.341218+0000","last_fullsized":"2024-04-25T02:18:43.341218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":135,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'351","reported_seq":360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279851+0000","last_change":"2024-04-25T02:10:53.853097+0000","last_active":"2024-04-25T02:18:51.279851+0000","last_peered":"2024-04-25T02:18:51.279851+0000","last_clean":"2024-04-25T02:18:51.279851+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:18:51.279851+0000","last_undegraded":"2024-04-25T02:18:51.279851+0000","last_fullsized":"2024-04-25T02:18:51.279851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'46","reported_seq":59,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:16:36.265281+0000","last_change":"2024-04-25T02:10:02.370637+0000","last_active":"2024-04-25T02:16:36.265281+0000","last_peered":"2024-04-25T02:16:36.265281+0000","last_clean":"2024-04-25T02:16:36.265281+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:16:36.265281+0000","last_undegraded":"2024-04-25T02:16:36.265281+0000","last_fullsized":"2024-04-25T02:16:36.265281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'375","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273633+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:18:51.273633+0000","last_peered":"2024-04-25T02:18:51.273633+0000","last_clean":"2024-04-25T02:18:51.273633+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:18:51.273633+0000","last_undegraded":"2024-04-25T02:18:51.273633+0000","last_fullsized":"2024-04-25T02:18:51.273633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":375,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'107","reported_seq":120,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.406993+0000","last_change":"2024-04-25T02:10:02.358829+0000","last_active":"2024-04-25T02:18:45.406993+0000","last_peered":"2024-04-25T02:18:45.406993+0000","last_clean":"2024-04-25T02:18:45.406993+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:18:45.406993+0000","last_undegraded":"2024-04-25T02:18:45.406993+0000","last_fullsized":"2024-04-25T02:18:45.406993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":107,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'396","reported_seq":408,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.225239+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:18:51.225239+0000","last_peered":"2024-04-25T02:18:51.225239+0000","last_clean":"2024-04-25T02:18:51.225239+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:18:51.225239+0000","last_undegraded":"2024-04-25T02:18:51.225239+0000","last_fullsized":"2024-04-25T02:18:51.225239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":396,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'82","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:42.341444+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:18:42.341444+0000","last_peered":"2024-04-25T02:18:42.341444+0000","last_clean":"2024-04-25T02:18:42.341444+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:18:42.341444+0000","last_undegraded":"2024-04-25T02:18:42.341444+0000","last_fullsized":"2024-04-25T02:18:42.341444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":82,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'356","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280670+0000","last_change":"2024-04-25T02:10:02.744548+0000","last_active":"2024-04-25T02:18:51.280670+0000","last_peered":"2024-04-25T02:18:51.280670+0000","last_clean":"2024-04-25T02:18:51.280670+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:18:51.280670+0000","last_undegraded":"2024-04-25T02:18:51.280670+0000","last_fullsized":"2024-04-25T02:18:51.280670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'32","reported_seq":45,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.375524+0000","last_change":"2024-04-25T02:10:02.371223+0000","last_active":"2024-04-25T02:18:38.375524+0000","last_peered":"2024-04-25T02:18:38.375524+0000","last_clean":"2024-04-25T02:18:38.375524+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:18:38.375524+0000","last_undegraded":"2024-04-25T02:18:38.375524+0000","last_fullsized":"2024-04-25T02:18:38.375524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'398","reported_seq":410,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267105+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:18:51.267105+0000","last_peered":"2024-04-25T02:18:51.267105+0000","last_clean":"2024-04-25T02:18:51.267105+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:18:51.267105+0000","last_undegraded":"2024-04-25T02:18:51.267105+0000","last_fullsized":"2024-04-25T02:18:51.267105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":398,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'114","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:40.356060+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:18:40.356060+0000","last_peered":"2024-04-25T02:18:40.356060+0000","last_clean":"2024-04-25T02:18:40.356060+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:18:40.356060+0000","last_undegraded":"2024-04-25T02:18:40.356060+0000","last_fullsized":"2024-04-25T02:18:40.356060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":114,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":12332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'459","reported_seq":471,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.248908+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:18:51.248908+0000","last_peered":"2024-04-25T02:18:51.248908+0000","last_clean":"2024-04-25T02:18:51.248908+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:18:51.248908+0000","last_undegraded":"2024-04-25T02:18:51.248908+0000","last_fullsized":"2024-04-25T02:18:51.248908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":459,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'74","reported_seq":87,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:40.059312+0000","last_change":"2024-04-25T02:10:02.367348+0000","last_active":"2024-04-25T02:18:40.059312+0000","last_peered":"2024-04-25T02:18:40.059312+0000","last_clean":"2024-04-25T02:18:40.059312+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:18:40.059312+0000","last_undegraded":"2024-04-25T02:18:40.059312+0000","last_fullsized":"2024-04-25T02:18:40.059312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":74,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'354","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279792+0000","last_change":"2024-04-25T02:10:53.851188+0000","last_active":"2024-04-25T02:18:51.279792+0000","last_peered":"2024-04-25T02:18:51.279792+0000","last_clean":"2024-04-25T02:18:51.279792+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:18:51.279792+0000","last_undegraded":"2024-04-25T02:18:51.279792+0000","last_fullsized":"2024-04-25T02:18:51.279792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"19'31","reported_seq":44,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:37.320752+0000","last_change":"2024-04-25T02:10:02.360699+0000","last_active":"2024-04-25T02:18:37.320752+0000","last_peered":"2024-04-25T02:18:37.320752+0000","last_clean":"2024-04-25T02:18:37.320752+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:18:37.320752+0000","last_undegraded":"2024-04-25T02:18:37.320752+0000","last_fullsized":"2024-04-25T02:18:37.320752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'332","reported_seq":344,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275215+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:18:51.275215+0000","last_peered":"2024-04-25T02:18:51.275215+0000","last_clean":"2024-04-25T02:18:51.275215+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:18:51.275215+0000","last_undegraded":"2024-04-25T02:18:51.275215+0000","last_fullsized":"2024-04-25T02:18:51.275215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":332,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'112","reported_seq":125,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:15:40.889041+0000","last_change":"2024-04-25T02:10:02.365974+0000","last_active":"2024-04-25T02:15:40.889041+0000","last_peered":"2024-04-25T02:15:40.889041+0000","last_clean":"2024-04-25T02:15:40.889041+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:15:40.889041+0000","last_undegraded":"2024-04-25T02:15:40.889041+0000","last_fullsized":"2024-04-25T02:15:40.889041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":112,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'328","reported_seq":340,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270459+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:18:51.270459+0000","last_peered":"2024-04-25T02:18:51.270459+0000","last_clean":"2024-04-25T02:18:51.270459+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:18:51.270459+0000","last_undegraded":"2024-04-25T02:18:51.270459+0000","last_fullsized":"2024-04-25T02:18:51.270459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838364+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:10:52.838364+0000","last_peered":"2024-04-25T02:10:52.838364+0000","last_clean":"2024-04-25T02:10:52.838364+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:10:52.838364+0000","last_undegraded":"2024-04-25T02:10:52.838364+0000","last_fullsized":"2024-04-25T02:10:52.838364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'93","reported_seq":106,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.313037+0000","last_change":"2024-04-25T02:10:02.367538+0000","last_active":"2024-04-25T02:18:38.313037+0000","last_peered":"2024-04-25T02:18:38.313037+0000","last_clean":"2024-04-25T02:18:38.313037+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:18:38.313037+0000","last_undegraded":"2024-04-25T02:18:38.313037+0000","last_fullsized":"2024-04-25T02:18:38.313037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":93,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270717+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:18:51.270717+0000","last_peered":"2024-04-25T02:18:51.270717+0000","last_clean":"2024-04-25T02:18:51.270717+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:18:51.270717+0000","last_undegraded":"2024-04-25T02:18:51.270717+0000","last_fullsized":"2024-04-25T02:18:51.270717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839925+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:52.839925+0000","last_peered":"2024-04-25T02:10:52.839925+0000","last_clean":"2024-04-25T02:10:52.839925+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:52.839925+0000","last_undegraded":"2024-04-25T02:10:52.839925+0000","last_fullsized":"2024-04-25T02:10:52.839925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'15","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:43.756248+0000","last_change":"2024-04-25T02:10:02.360464+0000","last_active":"2024-04-25T02:18:43.756248+0000","last_peered":"2024-04-25T02:18:43.756248+0000","last_clean":"2024-04-25T02:18:43.756248+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:18:43.756248+0000","last_undegraded":"2024-04-25T02:18:43.756248+0000","last_fullsized":"2024-04-25T02:18:43.756248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'326","reported_seq":338,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279087+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:18:51.279087+0000","last_peered":"2024-04-25T02:18:51.279087+0000","last_clean":"2024-04-25T02:18:51.279087+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:18:51.279087+0000","last_undegraded":"2024-04-25T02:18:51.279087+0000","last_fullsized":"2024-04-25T02:18:51.279087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":326,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834714+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:10:52.834714+0000","last_peered":"2024-04-25T02:10:52.834714+0000","last_clean":"2024-04-25T02:10:52.834714+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:10:52.834714+0000","last_undegraded":"2024-04-25T02:10:52.834714+0000","last_fullsized":"2024-04-25T02:10:52.834714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'241","reported_seq":254,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:08.991600+0000","last_change":"2024-04-25T02:10:02.361010+0000","last_active":"2024-04-25T02:18:08.991600+0000","last_peered":"2024-04-25T02:18:08.991600+0000","last_clean":"2024-04-25T02:18:08.991600+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:18:08.991600+0000","last_undegraded":"2024-04-25T02:18:08.991600+0000","last_fullsized":"2024-04-25T02:18:08.991600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":241,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":12388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'331","reported_seq":343,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.266717+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:18:51.266717+0000","last_peered":"2024-04-25T02:18:51.266717+0000","last_clean":"2024-04-25T02:18:51.266717+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:18:51.266717+0000","last_undegraded":"2024-04-25T02:18:51.266717+0000","last_fullsized":"2024-04-25T02:18:51.266717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":331,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":2335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842499+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:52.842499+0000","last_peered":"2024-04-25T02:10:52.842499+0000","last_clean":"2024-04-25T02:10:52.842499+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:52.842499+0000","last_undegraded":"2024-04-25T02:10:52.842499+0000","last_fullsized":"2024-04-25T02:10:52.842499+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837741+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:10:52.837741+0000","last_peered":"2024-04-25T02:10:52.837741+0000","last_clean":"2024-04-25T02:10:52.837741+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:10:52.837741+0000","last_undegraded":"2024-04-25T02:10:52.837741+0000","last_fullsized":"2024-04-25T02:10:52.837741+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'160","reported_seq":173,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:32.342332+0000","last_change":"2024-04-25T02:10:02.364629+0000","last_active":"2024-04-25T02:18:32.342332+0000","last_peered":"2024-04-25T02:18:32.342332+0000","last_clean":"2024-04-25T02:18:32.342332+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:18:32.342332+0000","last_undegraded":"2024-04-25T02:18:32.342332+0000","last_fullsized":"2024-04-25T02:18:32.342332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":160,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'344","reported_seq":356,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268567+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:18:51.268567+0000","last_peered":"2024-04-25T02:18:51.268567+0000","last_clean":"2024-04-25T02:18:51.268567+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:18:51.268567+0000","last_undegraded":"2024-04-25T02:18:51.268567+0000","last_fullsized":"2024-04-25T02:18:51.268567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838954+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:52.838954+0000","last_peered":"2024-04-25T02:10:52.838954+0000","last_clean":"2024-04-25T02:10:52.838954+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:52.838954+0000","last_undegraded":"2024-04-25T02:10:52.838954+0000","last_fullsized":"2024-04-25T02:10:52.838954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'626","reported_seq":1261,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:50.371325+0000","last_change":"2024-04-25T02:10:02.356105+0000","last_active":"2024-04-25T02:18:50.371325+0000","last_peered":"2024-04-25T02:18:50.371325+0000","last_clean":"2024-04-25T02:18:50.371325+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:18:50.371325+0000","last_undegraded":"2024-04-25T02:18:50.371325+0000","last_fullsized":"2024-04-25T02:18:50.371325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":626,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1113626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":622,"num_write_kb":1507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'415","reported_seq":427,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263065+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:18:51.263065+0000","last_peered":"2024-04-25T02:18:51.263065+0000","last_clean":"2024-04-25T02:18:51.263065+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:18:51.263065+0000","last_undegraded":"2024-04-25T02:18:51.263065+0000","last_fullsized":"2024-04-25T02:18:51.263065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841699+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:52.841699+0000","last_peered":"2024-04-25T02:10:52.841699+0000","last_clean":"2024-04-25T02:10:52.841699+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:52.841699+0000","last_undegraded":"2024-04-25T02:10:52.841699+0000","last_fullsized":"2024-04-25T02:10:52.841699+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'44","reported_seq":57,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:23.925413+0000","last_change":"2024-04-25T02:10:02.360478+0000","last_active":"2024-04-25T02:18:23.925413+0000","last_peered":"2024-04-25T02:18:23.925413+0000","last_clean":"2024-04-25T02:18:23.925413+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:18:23.925413+0000","last_undegraded":"2024-04-25T02:18:23.925413+0000","last_fullsized":"2024-04-25T02:18:23.925413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'343","reported_seq":355,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271627+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:18:51.271627+0000","last_peered":"2024-04-25T02:18:51.271627+0000","last_clean":"2024-04-25T02:18:51.271627+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:18:51.271627+0000","last_undegraded":"2024-04-25T02:18:51.271627+0000","last_fullsized":"2024-04-25T02:18:51.271627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'63","reported_seq":76,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.385067+0000","last_change":"2024-04-25T02:10:02.370193+0000","last_active":"2024-04-25T02:18:48.385067+0000","last_peered":"2024-04-25T02:18:48.385067+0000","last_clean":"2024-04-25T02:18:48.385067+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:18:48.385067+0000","last_undegraded":"2024-04-25T02:18:48.385067+0000","last_fullsized":"2024-04-25T02:18:48.385067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839006+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:10:52.839006+0000","last_peered":"2024-04-25T02:10:52.839006+0000","last_clean":"2024-04-25T02:10:52.839006+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:10:52.839006+0000","last_undegraded":"2024-04-25T02:10:52.839006+0000","last_fullsized":"2024-04-25T02:10:52.839006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273457+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:18:51.273457+0000","last_peered":"2024-04-25T02:18:51.273457+0000","last_clean":"2024-04-25T02:18:51.273457+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:18:51.273457+0000","last_undegraded":"2024-04-25T02:18:51.273457+0000","last_fullsized":"2024-04-25T02:18:51.273457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841219+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:52.841219+0000","last_peered":"2024-04-25T02:10:52.841219+0000","last_clean":"2024-04-25T02:10:52.841219+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:52.841219+0000","last_undegraded":"2024-04-25T02:10:52.841219+0000","last_fullsized":"2024-04-25T02:10:52.841219+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'72","reported_seq":85,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.339279+0000","last_change":"2024-04-25T02:10:02.370537+0000","last_active":"2024-04-25T02:18:48.339279+0000","last_peered":"2024-04-25T02:18:48.339279+0000","last_clean":"2024-04-25T02:18:48.339279+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:18:48.339279+0000","last_undegraded":"2024-04-25T02:18:48.339279+0000","last_fullsized":"2024-04-25T02:18:48.339279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":72,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'336","reported_seq":348,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277539+0000","last_change":"2024-04-25T02:10:02.748709+0000","last_active":"2024-04-25T02:18:51.277539+0000","last_peered":"2024-04-25T02:18:51.277539+0000","last_clean":"2024-04-25T02:18:51.277539+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:18:51.277539+0000","last_undegraded":"2024-04-25T02:18:51.277539+0000","last_fullsized":"2024-04-25T02:18:51.277539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":336,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'30","reported_seq":43,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.535566+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:18:38.535566+0000","last_peered":"2024-04-25T02:18:38.535566+0000","last_clean":"2024-04-25T02:18:38.535566+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:18:38.535566+0000","last_undegraded":"2024-04-25T02:18:38.535566+0000","last_fullsized":"2024-04-25T02:18:38.535566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281228+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:18:51.281228+0000","last_peered":"2024-04-25T02:18:51.281228+0000","last_clean":"2024-04-25T02:18:51.281228+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:18:51.281228+0000","last_undegraded":"2024-04-25T02:18:51.281228+0000","last_fullsized":"2024-04-25T02:18:51.281228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'46","reported_seq":59,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.361965+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:18:39.361965+0000","last_peered":"2024-04-25T02:18:39.361965+0000","last_clean":"2024-04-25T02:18:39.361965+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:18:39.361965+0000","last_undegraded":"2024-04-25T02:18:39.361965+0000","last_fullsized":"2024-04-25T02:18:39.361965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277504+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:18:51.277504+0000","last_peered":"2024-04-25T02:18:51.277504+0000","last_clean":"2024-04-25T02:18:51.277504+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:18:51.277504+0000","last_undegraded":"2024-04-25T02:18:51.277504+0000","last_fullsized":"2024-04-25T02:18:51.277504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":2199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'244","reported_seq":257,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.342289+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:18:48.342289+0000","last_peered":"2024-04-25T02:18:48.342289+0000","last_clean":"2024-04-25T02:18:48.342289+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:18:48.342289+0000","last_undegraded":"2024-04-25T02:18:48.342289+0000","last_fullsized":"2024-04-25T02:18:48.342289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":244,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277080+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:18:51.277080+0000","last_peered":"2024-04-25T02:18:51.277080+0000","last_clean":"2024-04-25T02:18:51.277080+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:18:51.277080+0000","last_undegraded":"2024-04-25T02:18:51.277080+0000","last_fullsized":"2024-04-25T02:18:51.277080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'110","reported_seq":123,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.799634+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:18:45.799634+0000","last_peered":"2024-04-25T02:18:45.799634+0000","last_clean":"2024-04-25T02:18:45.799634+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:18:45.799634+0000","last_undegraded":"2024-04-25T02:18:45.799634+0000","last_fullsized":"2024-04-25T02:18:45.799634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":110,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'370","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280559+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:18:51.280559+0000","last_peered":"2024-04-25T02:18:51.280559+0000","last_clean":"2024-04-25T02:18:51.280559+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:18:51.280559+0000","last_undegraded":"2024-04-25T02:18:51.280559+0000","last_fullsized":"2024-04-25T02:18:51.280559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":370,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'55","reported_seq":68,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:41.302148+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:18:41.302148+0000","last_peered":"2024-04-25T02:18:41.302148+0000","last_clean":"2024-04-25T02:18:41.302148+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:18:41.302148+0000","last_undegraded":"2024-04-25T02:18:41.302148+0000","last_fullsized":"2024-04-25T02:18:41.302148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":55,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'414","reported_seq":426,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280055+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:18:51.280055+0000","last_peered":"2024-04-25T02:18:51.280055+0000","last_clean":"2024-04-25T02:18:51.280055+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:18:51.280055+0000","last_undegraded":"2024-04-25T02:18:51.280055+0000","last_fullsized":"2024-04-25T02:18:51.280055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":414,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'413","reported_seq":425,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281808+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:18:51.281808+0000","last_peered":"2024-04-25T02:18:51.281808+0000","last_clean":"2024-04-25T02:18:51.281808+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:18:51.281808+0000","last_undegraded":"2024-04-25T02:18:51.281808+0000","last_fullsized":"2024-04-25T02:18:51.281808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":413,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":2919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276676+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:18:51.276676+0000","last_peered":"2024-04-25T02:18:51.276676+0000","last_clean":"2024-04-25T02:18:51.276676+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:18:51.276676+0000","last_undegraded":"2024-04-25T02:18:51.276676+0000","last_fullsized":"2024-04-25T02:18:51.276676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":3172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'394","reported_seq":406,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.251643+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:18:51.251643+0000","last_peered":"2024-04-25T02:18:51.251643+0000","last_clean":"2024-04-25T02:18:51.251643+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:18:51.251643+0000","last_undegraded":"2024-04-25T02:18:51.251643+0000","last_fullsized":"2024-04-25T02:18:51.251643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":394,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.259897+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:18:51.259897+0000","last_peered":"2024-04-25T02:18:51.259897+0000","last_clean":"2024-04-25T02:18:51.259897+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:18:51.259897+0000","last_undegraded":"2024-04-25T02:18:51.259897+0000","last_fullsized":"2024-04-25T02:18:51.259897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281654+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:18:51.281654+0000","last_peered":"2024-04-25T02:18:51.281654+0000","last_clean":"2024-04-25T02:18:51.281654+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:18:51.281654+0000","last_undegraded":"2024-04-25T02:18:51.281654+0000","last_fullsized":"2024-04-25T02:18:51.281654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":167505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23216,"ondisk_log_size":23216,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":3994,"num_write_kb":199381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316645376,"data_stored":316588690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3886,"ondisk_log_size":3886,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705776,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370056,"kb_used_data":72832,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94001784,"statfs":{"total":96636764160,"available":96257826816,"internally_reserved":0,"allocated":74579968,"data_stored":74464209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.22600000000000001,"15min":0.26800000000000002},"min":{"1min":0.16700000000000001,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.36199999999999999,"5min":0.437,"15min":0.44},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.248,"15min":0.29499999999999998},"min":{"1min":0.17999999999999999,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.40899999999999997,"5min":0.50900000000000001,"15min":0.53400000000000003},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.255,"5min":0.26400000000000001,"15min":0.30199999999999999},"min":{"1min":0.191,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39100000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.252,"5min":0.25800000000000001,"15min":0.30199999999999999},"min":{"1min":0.21099999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.373,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.441}]},{"osd":3,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.28399999999999997,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.192,"15min":0.192},"max":{"1min":0.36799999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.28100000000000003,"15min":0.32500000000000001},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":0.39900000000000002,"5min":0.628,"15min":0.628},"last":0.47899999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705775,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405844,"kb_used_data":100428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93965996,"statfs":{"total":96636764160,"available":96221179904,"internally_reserved":0,"allocated":102838272,"data_stored":102710905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.22600000000000001,"5min":0.23599999999999999,"15min":0.28899999999999998},"min":{"1min":0.17000000000000001,"5min":0.13200000000000001,"15min":0.13200000000000001},"max":{"1min":0.308,"5min":0.43099999999999999,"15min":0.49299999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.25,"15min":0.29699999999999999},"min":{"1min":0.17399999999999999,"5min":0.155,"15min":0.155},"max":{"1min":0.36599999999999999,"5min":0.44900000000000001,"15min":0.46700000000000003},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26700000000000002,"15min":0.318},"min":{"1min":0.20499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.316,"5min":0.47099999999999997,"15min":0.48299999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.27000000000000002,"15min":0.316},"min":{"1min":0.20599999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.45200000000000001,"5min":0.46500000000000002,"15min":0.53400000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27700000000000002,"15min":0.33000000000000002},"min":{"1min":0.219,"5min":0.186,"15min":0.186},"max":{"1min":0.41999999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.255,"5min":0.28399999999999997,"15min":0.32900000000000001},"min":{"1min":0.222,"5min":0.193,"15min":0.193},"max":{"1min":0.41199999999999998,"5min":0.49099999999999999,"15min":0.51900000000000002},"last":0.496}]}]},{"osd":0,"up_from":9,"seq":38654705775,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364024,"kb_used_data":66800,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94007816,"statfs":{"total":96636764160,"available":96264003584,"internally_reserved":0,"allocated":68403200,"data_stored":68279904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.222,"15min":0.28899999999999998},"min":{"1min":0.156,"5min":0.156,"15min":0.14399999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.54900000000000004},"last":0.309},{"interface":"front","average":{"1min":0.246,"5min":0.246,"15min":0.29999999999999999},"min":{"1min":0.17000000000000001,"5min":0.16700000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.48799999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.253,"15min":0.316},"min":{"1min":0.19400000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.42399999999999999,"5min":0.42599999999999999,"15min":0.53400000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.317},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.47799999999999998,"5min":0.49399999999999999,"15min":0.52200000000000002},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.33400000000000002},"min":{"1min":0.215,"5min":0.182,"15min":0.182},"max":{"1min":0.42999999999999999,"5min":0.49299999999999999,"15min":0.56899999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.309,"5min":0.27400000000000002,"15min":0.32700000000000001},"min":{"1min":0.23200000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705776,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371124,"kb_used_data":69804,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94000716,"statfs":{"total":96636764160,"available":96256733184,"internally_reserved":0,"allocated":71479296,"data_stored":71360528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.218,"15min":0.27300000000000002},"min":{"1min":0.161,"5min":0.154,"15min":0.154},"max":{"1min":0.30099999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23699999999999999,"15min":0.28799999999999998},"min":{"1min":0.16900000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.34799999999999998,"5min":0.46700000000000003,"15min":0.5},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.255,"15min":0.312},"min":{"1min":0.19400000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.318,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.27500000000000002,"15min":0.33300000000000002},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.313,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.502}]},{"osd":3,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.26000000000000001,"15min":0.308},"min":{"1min":0.20899999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.32500000000000001,"5min":0.46000000000000002,"15min":0.48399999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.377,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68239360,"data_stored":68223190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74416128,"data_stored":74407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102674432,"data_stored":102654191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:18:58.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:18:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.009+0000 7f8cfc7c4700 1 Processor -- start 2024-04-25T02:18:59.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.009+0000 7f8cfc7c4700 1 -- start start 2024-04-25T02:18:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfc7c4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8cf4062860 0x7f8cf41271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfc7c4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf412fb30 0x7f8cf4131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfc7c4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf4096490 con 0x7f8cf41277a0 2024-04-25T02:18:59.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfc7c4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf4062c40 con 0x7f8cf4062860 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfc7c4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4091b90 con 0x7f8cf412fb30 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfad61700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf412fb30 0x7f8cf4131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfa560700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8cf4062860 0x7f8cf41271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfad61700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf412fb30 0x7f8cf4131f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39190/0 (socket says 172.21.15.78:39190) 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfad61700 1 -- 172.21.15.78:0/23130151 learned_addr learned my addr 172.21.15.78:0/23130151 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfa560700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8cf4062860 0x7f8cf41271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41310/0 (socket says 172.21.15.78:41310) 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cf9d5f700 1 --1- 172.21.15.78:0/23130151 >> v1:172.21.15.78:6789/0 conn(0x7f8cf41277a0 0x7f8cf4127ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33066/0 (socket says 172.21.15.78:33066) 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfa560700 1 -- 172.21.15.78:0/23130151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf412fb30 msgr2=0x7f8cf4131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfa560700 1 --2- 172.21.15.78:0/23130151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf412fb30 0x7f8cf4131f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfa560700 1 -- 172.21.15.78:0/23130151 >> v1:172.21.15.78:6789/0 conn(0x7f8cf41277a0 legacy=0x7f8cf4127ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfa560700 1 -- 172.21.15.78:0/23130151 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4091e50 con 0x7f8cf4062860 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cf955e700 1 -- 172.21.15.78:0/23130151 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538217951 0 0) 0x7f8cf4096490 con 0x7f8cf41277a0 2024-04-25T02:18:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfad61700 1 --2- 172.21.15.78:0/23130151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf412fb30 0x7f8cf4131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cfa560700 1 --2- 172.21.15.78:0/23130151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf4062860 0x7f8cf41271f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f8ce4009760 tx=0x7f8ce4009060).ready entity=mon.0 client_cookie=db872b9da06a77e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cf955e700 1 -- 172.21.15.78:0/23130151 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400f510 con 0x7f8cf4062860 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cf955e700 1 -- 172.21.15.78:0/23130151 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce400f670 con 0x7f8cf4062860 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.010+0000 7f8cf955e700 1 -- 172.21.15.78:0/23130151 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400f9f0 con 0x7f8cf4062860 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.011+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/23130151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf4062860 msgr2=0x7f8cf41271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.011+0000 7f8cfc7c4700 1 --2- 172.21.15.78:0/23130151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf4062860 0x7f8cf41271f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f8ce4009760 tx=0x7f8ce4009060).stop 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.011+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/23130151 shutdown_connections 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.011+0000 7f8cfc7c4700 1 --2- 172.21.15.78:0/23130151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf412fb30 0x7f8cf4131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.011+0000 7f8cfc7c4700 1 --2- 172.21.15.78:0/23130151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf4062860 0x7f8cf41271f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.011+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/23130151 >> 172.21.15.78:0/23130151 conn(0x7f8cf4097450 msgr2=0x7f8cf4097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.011+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/23130151 shutdown_connections 2024-04-25T02:18:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.011+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/23130151 wait complete. 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfc7c4700 1 Processor -- start 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfc7c4700 1 -- start start 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfc7c4700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8cf4062860 0x7f8cf4110f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfc7c4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf41277a0 0x7f8cf412bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfc7c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf412fb30 0x7f8cf412c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfc7c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf412ed10 con 0x7f8cf412fb30 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfc7c4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf412e2d0 con 0x7f8cf41277a0 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfc7c4700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4132060 con 0x7f8cf4062860 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfad61700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf412fb30 0x7f8cf412c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cf9d5f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf41277a0 0x7f8cf412bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfad61700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf412fb30 0x7f8cf412c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41312/0 (socket says 172.21.15.78:41312) 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfad61700 1 -- 172.21.15.78:0/951699156 learned_addr learned my addr 172.21.15.78:0/951699156 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cf9d5f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf41277a0 0x7f8cf412bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39198/0 (socket says 172.21.15.78:39198) 2024-04-25T02:18:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.012+0000 7f8cfa560700 1 --2- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8cf4062860 0x7f8cf4110f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8cf9d5f700 1 -- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8cf4062860 msgr2=0x7f8cf4110f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8cf9d5f700 1 --2- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8cf4062860 0x7f8cf4110f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8cf9d5f700 1 -- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf412fb30 msgr2=0x7f8cf412c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8cf9d5f700 1 --2- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf412fb30 0x7f8cf412c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8cf9d5f700 1 -- 172.21.15.78:0/951699156 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec009ae0 con 0x7f8cf41277a0 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8cfad61700 1 --2- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf412fb30 0x7f8cf412c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8cf9d5f700 1 --2- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf41277a0 0x7f8cf412bd40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8cf0000c00 tx=0x7f8cf0007bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8ceaffd700 1 -- 172.21.15.78:0/951699156 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00070d0 con 0x7f8cf41277a0 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8ceaffd700 1 -- 172.21.15.78:0/951699156 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf0007250 con 0x7f8cf41277a0 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce40092a0 con 0x7f8cf41277a0 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8ceaffd700 1 -- 172.21.15.78:0/951699156 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00056e0 con 0x7f8cf41277a0 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf412d9f0 con 0x7f8cf41277a0 2024-04-25T02:18:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.013+0000 7f8ceaffd700 1 -- 172.21.15.78:0/951699156 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f8cf0005a50 con 0x7f8cf41277a0 2024-04-25T02:18:59.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.014+0000 7f8ceaffd700 1 -- 172.21.15.78:0/951699156 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f8cf003a740 con 0x7f8cf41277a0 2024-04-25T02:18:59.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.014+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf4097f70 con 0x7f8cf41277a0 2024-04-25T02:18:59.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.018+0000 7f8ceaffd700 1 -- 172.21.15.78:0/951699156 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f8cf0010cd0 con 0x7f8cf41277a0 2024-04-25T02:18:59.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.179+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cf412f100 con 0x7f8cf41277a0 2024-04-25T02:18:59.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.179+0000 7f8ceaffd700 1 -- 172.21.15.78:0/951699156 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11609 (secure 0 0 0) 0x7f8cf412f100 con 0x7f8cf41277a0 2024-04-25T02:18:59.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:18:59.184 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:53.832053+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:18:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 >> v1:172.21.15.78:6816/46507 conn(0x7f8cd802bd00 legacy=0x7f8cd802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf41277a0 msgr2=0x7f8cf412bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 --2- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf41277a0 0x7f8cf412bd40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8cf0000c00 tx=0x7f8cf0007bb0).stop 2024-04-25T02:18:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 shutdown_connections 2024-04-25T02:18:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 --2- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cf412fb30 0x7f8cf412c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 --2- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f8cf4062860 0x7f8cf4110f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 --2- 172.21.15.78:0/951699156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8cf41277a0 0x7f8cf412bd40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:18:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 >> 172.21.15.78:0/951699156 conn(0x7f8cf4097450 msgr2=0x7f8cf4092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 shutdown_connections 2024-04-25T02:18:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:18:59.181+0000 7f8cfc7c4700 1 -- 172.21.15.78:0/951699156 wait complete. 2024-04-25T02:19:00.198 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T02:19:00.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:19:00.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc477a700 1 Processor -- start 2024-04-25T02:19:00.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc477a700 1 -- start start 2024-04-25T02:19:00.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc477a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc062860 0x7f4dbc12af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc477a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4dbc12ab00 0x7f4dbc12b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc477a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc095190 0x7f4dbc095640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc477a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc062c40 con 0x7f4dbc12ab00 2024-04-25T02:19:00.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc477a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0922e0 con 0x7f4dbc095190 2024-04-25T02:19:00.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc477a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc091a10 con 0x7f4dbc062860 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc2d17700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc095190 0x7f4dbc095640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc1d15700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4dbc12ab00 0x7f4dbc12b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc2516700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc062860 0x7f4dbc12af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc2d17700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc095190 0x7f4dbc095640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39200/0 (socket says 172.21.15.78:39200) 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc1d15700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4dbc12ab00 0x7f4dbc12b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41314/0 (socket says 172.21.15.78:41314) 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc2d17700 1 -- 172.21.15.78:0/834806506 learned_addr learned my addr 172.21.15.78:0/834806506 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.325+0000 7f4dc2516700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc062860 0x7f4dbc12af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33288/0 (socket says 172.21.15.78:33288) 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc2516700 1 -- 172.21.15.78:0/834806506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc095190 msgr2=0x7f4dbc095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc2516700 1 --2- 172.21.15.78:0/834806506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc095190 0x7f4dbc095640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc2516700 1 -- 172.21.15.78:0/834806506 >> v2:172.21.15.78:3300/0 conn(0x7f4dbc12ab00 msgr2=0x7f4dbc12b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc2516700 1 --2- 172.21.15.78:0/834806506 >> v2:172.21.15.78:3300/0 conn(0x7f4dbc12ab00 0x7f4dbc12b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc2516700 1 -- 172.21.15.78:0/834806506 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc12b970 con 0x7f4dbc062860 2024-04-25T02:19:00.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc2d17700 1 --2- 172.21.15.78:0/834806506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc095190 0x7f4dbc095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc2516700 1 --2- 172.21.15.78:0/834806506 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc062860 0x7f4dbc12af90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4db8009790 tx=0x7f4db8009060).ready entity=mon.2 client_cookie=d4ed582b80bd29f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc1514700 1 -- 172.21.15.78:0/834806506 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800d4a0 con 0x7f4dbc062860 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc1514700 1 -- 172.21.15.78:0/834806506 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800d600 con 0x7f4dbc062860 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.326+0000 7f4dc1514700 1 -- 172.21.15.78:0/834806506 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800d980 con 0x7f4dbc062860 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.327+0000 7f4dc477a700 1 -- 172.21.15.78:0/834806506 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc062860 msgr2=0x7f4dbc12af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.327+0000 7f4dc477a700 1 --2- 172.21.15.78:0/834806506 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc062860 0x7f4dbc12af90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4db8009790 tx=0x7f4db8009060).stop 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.327+0000 7f4dc477a700 1 -- 172.21.15.78:0/834806506 shutdown_connections 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.327+0000 7f4dc477a700 1 --2- 172.21.15.78:0/834806506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc095190 0x7f4dbc095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.327+0000 7f4dc477a700 1 --2- 172.21.15.78:0/834806506 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc062860 0x7f4dbc12af90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.327+0000 7f4dc477a700 1 --2- 172.21.15.78:0/834806506 >> v2:172.21.15.78:3300/0 conn(0x7f4dbc12ab00 0x7f4dbc12b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.327+0000 7f4dc477a700 1 -- 172.21.15.78:0/834806506 >> 172.21.15.78:0/834806506 conn(0x7f4dbc09a970 msgr2=0x7f4dbc09ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.327+0000 7f4dc477a700 1 -- 172.21.15.78:0/834806506 shutdown_connections 2024-04-25T02:19:00.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.327+0000 7f4dc477a700 1 -- 172.21.15.78:0/834806506 wait complete. 2024-04-25T02:19:00.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.328+0000 7f4dc477a700 1 Processor -- start 2024-04-25T02:19:00.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.328+0000 7f4dc477a700 1 -- start start 2024-04-25T02:19:00.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc477a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc062860 0x7f4dbc124ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc477a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dbc095190 0x7f4dbc115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc477a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc115770 0x7f4dbc115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc477a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc1160c0 con 0x7f4dbc095190 2024-04-25T02:19:00.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc477a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc117f60 con 0x7f4dbc062860 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc477a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc116450 con 0x7f4dbc115770 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2516700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc062860 0x7f4dbc124ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc1d15700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dbc095190 0x7f4dbc115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2d17700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc115770 0x7f4dbc115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2516700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc062860 0x7f4dbc124ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39212/0 (socket says 172.21.15.78:39212) 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2516700 1 -- 172.21.15.78:0/3061086103 learned_addr learned my addr 172.21.15.78:0/3061086103 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2516700 1 -- 172.21.15.78:0/3061086103 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc115770 msgr2=0x7f4dbc115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2516700 1 --2- 172.21.15.78:0/3061086103 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f4dbc115770 0x7f4dbc115bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2516700 1 -- 172.21.15.78:0/3061086103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dbc095190 msgr2=0x7f4dbc115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2516700 1 --2- 172.21.15.78:0/3061086103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dbc095190 0x7f4dbc115280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2516700 1 -- 172.21.15.78:0/3061086103 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009ae0 con 0x7f4dbc062860 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc1d15700 1 --2- 172.21.15.78:0/3061086103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dbc095190 0x7f4dbc115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc2516700 1 --2- 172.21.15.78:0/3061086103 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc062860 0x7f4dbc124ec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4dbc091ba0 tx=0x7f4db8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:00.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4db2ffd700 1 -- 172.21.15.78:0/3061086103 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800dd30 con 0x7f4dbc062860 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4db2ffd700 1 -- 172.21.15.78:0/3061086103 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800de90 con 0x7f4dbc062860 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db80092a0 con 0x7f4dbc062860 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4db2ffd700 1 -- 172.21.15.78:0/3061086103 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800d9c0 con 0x7f4dbc062860 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.329+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc096c60 con 0x7f4dbc062860 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.330+0000 7f4db2ffd700 1 -- 172.21.15.78:0/3061086103 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f4db80263b0 con 0x7f4dbc062860 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.330+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4dbc09b490 con 0x7f4dbc062860 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.330+0000 7f4db2ffd700 1 -- 172.21.15.78:0/3061086103 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f4db803c080 con 0x7f4dbc062860 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.330+0000 7f4db2ffd700 1 -- 172.21.15.78:0/3061086103 --> v1:172.21.15.78:6804/47107 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4da0038930 con 0x7f4da0034c20 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.330+0000 7f4db2ffd700 1 -- 172.21.15.78:0/3061086103 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4db8018310 con 0x7f4dbc062860 2024-04-25T02:19:00.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.331+0000 7f4db2ffd700 1 -- 172.21.15.78:0/3061086103 <== osd.0 v1:172.21.15.78:6804/47107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f4da0038930 con 0x7f4da0034c20 2024-04-25T02:19:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.344+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 --> v1:172.21.15.78:6804/47107 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4dbc117520 con 0x7f4da0034c20 2024-04-25T02:19:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.344+0000 7f4db2ffd700 1 -- 172.21.15.78:0/3061086103 <== osd.0 v1:172.21.15.78:6804/47107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f4dbc117520 con 0x7f4da0034c20 2024-04-25T02:19:00.349 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-25T02:19:00.349 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-04-25T02:19:00.349 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-25T02:19:00.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.344+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 >> v1:172.21.15.78:6804/47107 conn(0x7f4da0034c20 legacy=0x7f4da00370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.345+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 >> v1:172.21.15.78:6816/46507 conn(0x7f4da002bd30 legacy=0x7f4da002e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.345+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc062860 msgr2=0x7f4dbc124ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.345+0000 7f4dc477a700 1 --2- 172.21.15.78:0/3061086103 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4dbc062860 0x7f4dbc124ec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4dbc091ba0 tx=0x7f4db8016000).stop 2024-04-25T02:19:00.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.345+0000 7f4dc2d17700 1 -- 172.21.15.78:0/3061086103 reap_dead start 2024-04-25T02:19:00.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.345+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 shutdown_connections 2024-04-25T02:19:00.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.345+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 >> 172.21.15.78:0/3061086103 conn(0x7f4dbc09a970 msgr2=0x7f4dbc099710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:00.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.345+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 shutdown_connections 2024-04-25T02:19:00.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.345+0000 7f4dc477a700 1 -- 172.21.15.78:0/3061086103 wait complete. 2024-04-25T02:19:00.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T02:19:00.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.471+0000 7f8536349700 1 Processor -- start 2024-04-25T02:19:00.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.471+0000 7f8536349700 1 -- start start 2024-04-25T02:19:00.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.471+0000 7f8536349700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012a750 0x7f853012b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f8536349700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f853012fac0 0x7f8530131eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f8536349700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8530065750 con 0x7f8530064ad0 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f8536349700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8530064eb0 con 0x7f853012a750 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f8536349700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8530099930 con 0x7f853012fac0 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f85348e6700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f853012fac0 0x7f8530131eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012a750 0x7f853012b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8530064ad0 0x7f853012abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33068/0 (socket says 172.21.15.78:33068) 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852ffff700 1 -- 172.21.15.78:0/4123004635 learned_addr learned my addr 172.21.15.78:0/4123004635 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852effd700 1 -- 172.21.15.78:0/4123004635 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611651263 0 0) 0x7f8530065750 con 0x7f8530064ad0 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852effd700 1 -- 172.21.15.78:0/4123004635 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f851c0033f0 con 0x7f8530064ad0 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852f7fe700 1 -- 172.21.15.78:0/4123004635 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f853012fac0 msgr2=0x7f8530131eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852f7fe700 1 --2- 172.21.15.78:0/4123004635 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f853012fac0 0x7f8530131eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852f7fe700 1 -- 172.21.15.78:0/4123004635 >> v1:172.21.15.78:6789/0 conn(0x7f8530064ad0 legacy=0x7f853012abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852f7fe700 1 -- 172.21.15.78:0/4123004635 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530065b40 con 0x7f853012a750 2024-04-25T02:19:00.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852f7fe700 1 --2- 172.21.15.78:0/4123004635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012a750 0x7f853012b2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f85180097c0 tx=0x7f8518009060).ready entity=mon.1 client_cookie=a5e7fa1b2a0cd42c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852effd700 1 -- 172.21.15.78:0/4123004635 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180090d0 con 0x7f853012a750 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852effd700 1 -- 172.21.15.78:0/4123004635 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851800d4a0 con 0x7f853012a750 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.472+0000 7f852effd700 1 -- 172.21.15.78:0/4123004635 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851800d820 con 0x7f853012a750 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.473+0000 7f8536349700 1 -- 172.21.15.78:0/4123004635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012a750 msgr2=0x7f853012b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.473+0000 7f8536349700 1 --2- 172.21.15.78:0/4123004635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012a750 0x7f853012b2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f85180097c0 tx=0x7f8518009060).stop 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.473+0000 7f8536349700 1 -- 172.21.15.78:0/4123004635 shutdown_connections 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.473+0000 7f8536349700 1 --2- 172.21.15.78:0/4123004635 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f853012fac0 0x7f8530131eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.473+0000 7f8536349700 1 --2- 172.21.15.78:0/4123004635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012a750 0x7f853012b2f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.473+0000 7f8536349700 1 -- 172.21.15.78:0/4123004635 >> 172.21.15.78:0/4123004635 conn(0x7f853009a630 msgr2=0x7f853009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.473+0000 7f8536349700 1 -- 172.21.15.78:0/4123004635 shutdown_connections 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.473+0000 7f8536349700 1 -- 172.21.15.78:0/4123004635 wait complete. 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f8536349700 1 Processor -- start 2024-04-25T02:19:00.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f8536349700 1 -- start start 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f8536349700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8530064ad0 0x7f85300938e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f8536349700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012fac0 0x7f8530093dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f8536349700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85300942c0 0x7f8530094720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f8536349700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8530097830 con 0x7f8530064ad0 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f8536349700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8530099ab0 con 0x7f853012fac0 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f8536349700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8530094c10 con 0x7f85300942c0 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f852ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8530064ad0 0x7f85300938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f85348e6700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85300942c0 0x7f8530094720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f85348e6700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85300942c0 0x7f8530094720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33316/0 (socket says 172.21.15.78:33316) 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f852ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8530064ad0 0x7f85300938e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41324/0 (socket says 172.21.15.78:41324) 2024-04-25T02:19:00.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f852f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012fac0 0x7f8530093dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.474+0000 7f85348e6700 1 -- 172.21.15.78:0/3496570233 learned_addr learned my addr 172.21.15.78:0/3496570233 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f85348e6700 1 -- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012fac0 msgr2=0x7f8530093dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f85348e6700 1 --2- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012fac0 0x7f8530093dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f85348e6700 1 -- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8530064ad0 msgr2=0x7f85300938e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f85348e6700 1 --2- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8530064ad0 0x7f85300938e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f85348e6700 1 -- 172.21.15.78:0/3496570233 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180092a0 con 0x7f85300942c0 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f85348e6700 1 --2- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85300942c0 0x7f8530094720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8528009ec0 tx=0x7f852800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f852cff9700 1 -- 172.21.15.78:0/3496570233 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852800cb70 con 0x7f85300942c0 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f852cff9700 1 -- 172.21.15.78:0/3496570233 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852800f040 con 0x7f85300942c0 2024-04-25T02:19:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8530132060 con 0x7f85300942c0 2024-04-25T02:19:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f852cff9700 1 -- 172.21.15.78:0/3496570233 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852800cee0 con 0x7f85300942c0 2024-04-25T02:19:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.475+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8530114170 con 0x7f85300942c0 2024-04-25T02:19:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.476+0000 7f852cff9700 1 -- 172.21.15.78:0/3496570233 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f8528013610 con 0x7f85300942c0 2024-04-25T02:19:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.476+0000 7f852cff9700 1 -- 172.21.15.78:0/3496570233 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f852803bb20 con 0x7f85300942c0 2024-04-25T02:19:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.476+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8530130eb0 con 0x7f85300942c0 2024-04-25T02:19:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.481+0000 7f852cff9700 1 -- 172.21.15.78:0/3496570233 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f852801d460 con 0x7f85300942c0 2024-04-25T02:19:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.639+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f853009b150 con 0x7f851002bd00 2024-04-25T02:19:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.639+0000 7f852cff9700 1 -- 172.21.15.78:0/3496570233 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7f853009b150 con 0x7f851002bd00 2024-04-25T02:19:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.641+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 >> v1:172.21.15.78:6816/46507 conn(0x7f851002bd00 legacy=0x7f851002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.641+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85300942c0 msgr2=0x7f8530094720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.641+0000 7f8536349700 1 --2- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85300942c0 0x7f8530094720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8528009ec0 tx=0x7f852800b040).stop 2024-04-25T02:19:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.641+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 shutdown_connections 2024-04-25T02:19:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.641+0000 7f8536349700 1 --2- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f85300942c0 0x7f8530094720 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.641+0000 7f8536349700 1 --2- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8530064ad0 0x7f85300938e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.641+0000 7f8536349700 1 --2- 172.21.15.78:0/3496570233 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f853012fac0 0x7f8530093dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.641+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 >> 172.21.15.78:0/3496570233 conn(0x7f853009a630 msgr2=0x7f85301316e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.642+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 shutdown_connections 2024-04-25T02:19:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.642+0000 7f8536349700 1 -- 172.21.15.78:0/3496570233 wait complete. 2024-04-25T02:19:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T02:19:00.657 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T02:19:00.657 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:19:00.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.771+0000 7f21b99dd700 1 Processor -- start 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.771+0000 7f21b99dd700 1 -- start start 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.771+0000 7f21b99dd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f21b4064b70 0x7f21b4098840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.771+0000 7f21b99dd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 0x7f21b412aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.771+0000 7f21b99dd700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b4091c40 con 0x7f21b4098d30 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.771+0000 7f21b99dd700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b4064f50 con 0x7f21b4064b70 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.771+0000 7f21b99dd700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4065930 con 0x7f21b4099130 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b37fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 0x7f21b412aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b2ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f21b4064b70 0x7f21b4098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b27fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f21b4098d30 0x7f21b412a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33070/0 (socket says 172.21.15.78:33070) 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b27fc700 1 -- 172.21.15.78:0/3082804699 learned_addr learned my addr 172.21.15.78:0/3082804699 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b37fe700 1 -- 172.21.15.78:0/3082804699 >> v2:172.21.15.78:3300/0 conn(0x7f21b4064b70 msgr2=0x7f21b4098840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b37fe700 1 --2- 172.21.15.78:0/3082804699 >> v2:172.21.15.78:3300/0 conn(0x7f21b4064b70 0x7f21b4098840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b37fe700 1 -- 172.21.15.78:0/3082804699 >> v1:172.21.15.78:6789/0 conn(0x7f21b4098d30 legacy=0x7f21b412a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b1ffb700 1 -- 172.21.15.78:0/3082804699 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637752089 0 0) 0x7f21b4091c40 con 0x7f21b4098d30 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b37fe700 1 -- 172.21.15.78:0/3082804699 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b4098530 con 0x7f21b4099130 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b2ffd700 1 --2- 172.21.15.78:0/3082804699 >> v2:172.21.15.78:3300/0 conn(0x7f21b4064b70 0x7f21b4098840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b37fe700 1 --2- 172.21.15.78:0/3082804699 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 0x7f21b412aed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f21ac009e60 tx=0x7f21ac009780).ready entity=mon.2 client_cookie=2fad652402e15c9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b1ffb700 1 -- 172.21.15.78:0/3082804699 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00e070 con 0x7f21b4099130 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b1ffb700 1 -- 172.21.15.78:0/3082804699 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac00bb60 con 0x7f21b4099130 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.772+0000 7f21b1ffb700 1 -- 172.21.15.78:0/3082804699 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac012410 con 0x7f21b4099130 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.773+0000 7f21b99dd700 1 -- 172.21.15.78:0/3082804699 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 msgr2=0x7f21b412aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.773+0000 7f21b99dd700 1 --2- 172.21.15.78:0/3082804699 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 0x7f21b412aed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f21ac009e60 tx=0x7f21ac009780).stop 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.773+0000 7f21b99dd700 1 -- 172.21.15.78:0/3082804699 shutdown_connections 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.773+0000 7f21b99dd700 1 --2- 172.21.15.78:0/3082804699 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 0x7f21b412aed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.773+0000 7f21b99dd700 1 --2- 172.21.15.78:0/3082804699 >> v2:172.21.15.78:3300/0 conn(0x7f21b4064b70 0x7f21b4098840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.773+0000 7f21b99dd700 1 -- 172.21.15.78:0/3082804699 >> 172.21.15.78:0/3082804699 conn(0x7f21b409e7a0 msgr2=0x7f21b409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:00.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.773+0000 7f21b99dd700 1 -- 172.21.15.78:0/3082804699 shutdown_connections 2024-04-25T02:19:00.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.773+0000 7f21b99dd700 1 -- 172.21.15.78:0/3082804699 wait complete. 2024-04-25T02:19:00.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b99dd700 1 Processor -- start 2024-04-25T02:19:00.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b99dd700 1 -- start start 2024-04-25T02:19:00.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b99dd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b4098d30 0x7f21b4116bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b99dd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 0x7f21b41170c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b99dd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21b41175b0 0x7f21b4117a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b99dd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4127c50 con 0x7f21b4098d30 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b99dd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4099a80 con 0x7f21b41175b0 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b99dd700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21b411a620 con 0x7f21b4099130 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b4098d30 0x7f21b4116bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b4098d30 0x7f21b4116bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41344/0 (socket says 172.21.15.78:41344) 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b2ffd700 1 -- 172.21.15.78:0/1160927267 learned_addr learned my addr 172.21.15.78:0/1160927267 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b37fe700 1 --2- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21b41175b0 0x7f21b4117a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b27fc700 1 --2- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 0x7f21b41170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b2ffd700 1 -- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 msgr2=0x7f21b41170c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b2ffd700 1 --2- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f21b4099130 0x7f21b41170c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.774+0000 7f21b2ffd700 1 -- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21b41175b0 msgr2=0x7f21b4117a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f21b2ffd700 1 --2- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21b41175b0 0x7f21b4117a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f21b2ffd700 1 -- 172.21.15.78:0/1160927267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80092a0 con 0x7f21b4098d30 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f21b37fe700 1 --2- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f21b41175b0 0x7f21b4117a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f21b2ffd700 1 --2- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b4098d30 0x7f21b4116bd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f21a800e980 tx=0x7f21a8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f219b7fe700 1 -- 172.21.15.78:0/1160927267 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8012600 con 0x7f21b4098d30 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f219b7fe700 1 -- 172.21.15.78:0/1160927267 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8012760 con 0x7f21b4098d30 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f219b7fe700 1 -- 172.21.15.78:0/1160927267 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8012ae0 con 0x7f21b4098d30 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac009a20 con 0x7f21b4098d30 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b4117f20 con 0x7f21b4098d30 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.775+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21b409d4e0 con 0x7f21b4098d30 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.776+0000 7f219b7fe700 1 -- 172.21.15.78:0/1160927267 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f21a801b400 con 0x7f21b4098d30 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.776+0000 7f219b7fe700 1 -- 172.21.15.78:0/1160927267 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f21a803bce0 con 0x7f21b4098d30 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.776+0000 7f219b7fe700 1 -- 172.21.15.78:0/1160927267 --> v1:172.21.15.78:6800/47106 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21a0038980 con 0x7f21a0034c70 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.776+0000 7f219b7fe700 1 -- 172.21.15.78:0/1160927267 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21a803c0c0 con 0x7f21b4098d30 2024-04-25T02:19:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.777+0000 7f219b7fe700 1 -- 172.21.15.78:0/1160927267 <== osd.1 v1:172.21.15.78:6800/47106 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f21a0038980 con 0x7f21a0034c70 2024-04-25T02:19:00.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.790+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 --> v1:172.21.15.78:6800/47106 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f21b411a2a0 con 0x7f21a0034c70 2024-04-25T02:19:00.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.790+0000 7f219b7fe700 1 -- 172.21.15.78:0/1160927267 <== osd.1 v1:172.21.15.78:6800/47106 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f21ac00bcd0 con 0x7f21a0034c70 2024-04-25T02:19:00.795 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-25T02:19:00.795 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-04-25T02:19:00.795 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-25T02:19:00.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.790+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 >> v1:172.21.15.78:6800/47106 conn(0x7f21a0034c70 legacy=0x7f21a0037110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.791+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 >> v1:172.21.15.78:6816/46507 conn(0x7f21a002bd00 legacy=0x7f21a002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.791+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b4098d30 msgr2=0x7f21b4116bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.791+0000 7f21b99dd700 1 --2- 172.21.15.78:0/1160927267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b4098d30 0x7f21b4116bd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f21a800e980 tx=0x7f21a8009060).stop 2024-04-25T02:19:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.791+0000 7f21b37fe700 1 -- 172.21.15.78:0/1160927267 reap_dead start 2024-04-25T02:19:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.791+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 shutdown_connections 2024-04-25T02:19:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.791+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 >> 172.21.15.78:0/1160927267 conn(0x7f21b4064b70 msgr2=0x7f21b4096ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.791+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 shutdown_connections 2024-04-25T02:19:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.791+0000 7f21b99dd700 1 -- 172.21.15.78:0/1160927267 wait complete. 2024-04-25T02:19:00.806 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T02:19:00.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.917+0000 7f32e8b20700 1 Processor -- start 2024-04-25T02:19:00.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.917+0000 7f32e8b20700 1 -- start start 2024-04-25T02:19:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.917+0000 7f32e8b20700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e40937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.917+0000 7f32e8b20700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e41243e0 0x7f32e4127bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.917+0000 7f32e8b20700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e4096cf0 con 0x7f32e4124000 2024-04-25T02:19:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.917+0000 7f32e8b20700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4092d00 con 0x7f32e41243e0 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.917+0000 7f32e8b20700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32e40933a0 con 0x7f32e40961a0 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e1d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e40937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e2d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e41243e0 0x7f32e4127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e259c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f32e4124000 0x7f32e41274e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33084/0 (socket says 172.21.15.78:33084) 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e259c700 1 -- 172.21.15.78:0/248822092 learned_addr learned my addr 172.21.15.78:0/248822092 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e159a700 1 -- 172.21.15.78:0/248822092 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751007223 0 0) 0x7f32e4096cf0 con 0x7f32e4124000 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e2d9d700 1 -- 172.21.15.78:0/248822092 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 msgr2=0x7f32e40937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e2d9d700 1 --2- 172.21.15.78:0/248822092 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e40937a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e2d9d700 1 -- 172.21.15.78:0/248822092 >> v1:172.21.15.78:6789/0 conn(0x7f32e4124000 legacy=0x7f32e41274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e2d9d700 1 -- 172.21.15.78:0/248822092 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4124a50 con 0x7f32e41243e0 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e1d9b700 1 --2- 172.21.15.78:0/248822092 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e40937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e2d9d700 1 --2- 172.21.15.78:0/248822092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e41243e0 0x7f32e4127bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f32dc009ec0 tx=0x7f32dc009780).ready entity=mon.1 client_cookie=f4739e9153941771 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e159a700 1 -- 172.21.15.78:0/248822092 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00e070 con 0x7f32e41243e0 2024-04-25T02:19:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e159a700 1 -- 172.21.15.78:0/248822092 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc00bbf0 con 0x7f32e41243e0 2024-04-25T02:19:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.918+0000 7f32e159a700 1 -- 172.21.15.78:0/248822092 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc012410 con 0x7f32e41243e0 2024-04-25T02:19:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.919+0000 7f32e8b20700 1 -- 172.21.15.78:0/248822092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e41243e0 msgr2=0x7f32e4127bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.919+0000 7f32e8b20700 1 --2- 172.21.15.78:0/248822092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e41243e0 0x7f32e4127bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f32dc009ec0 tx=0x7f32dc009780).stop 2024-04-25T02:19:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.919+0000 7f32e8b20700 1 -- 172.21.15.78:0/248822092 shutdown_connections 2024-04-25T02:19:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.919+0000 7f32e8b20700 1 --2- 172.21.15.78:0/248822092 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e41243e0 0x7f32e4127bf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.919+0000 7f32e8b20700 1 --2- 172.21.15.78:0/248822092 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e40937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.919+0000 7f32e8b20700 1 -- 172.21.15.78:0/248822092 >> 172.21.15.78:0/248822092 conn(0x7f32e4097450 msgr2=0x7f32e4097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.919+0000 7f32e8b20700 1 -- 172.21.15.78:0/248822092 shutdown_connections 2024-04-25T02:19:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.919+0000 7f32e8b20700 1 -- 172.21.15.78:0/248822092 wait complete. 2024-04-25T02:19:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e8b20700 1 Processor -- start 2024-04-25T02:19:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e8b20700 1 -- start start 2024-04-25T02:19:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e8b20700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e41153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e8b20700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e4124000 0x7f32e41116d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e8b20700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e41243e0 0x7f32e4111d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e8b20700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4114950 con 0x7f32e41243e0 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e8b20700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4095150 con 0x7f32e4124000 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e8b20700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4092440 con 0x7f32e40961a0 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e259c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e41153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e2d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e41243e0 0x7f32e4111d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e1d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e4124000 0x7f32e41116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e259c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e41153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33352/0 (socket says 172.21.15.78:33352) 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e1d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e4124000 0x7f32e41116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39250/0 (socket says 172.21.15.78:39250) 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e259c700 1 -- 172.21.15.78:0/2661369786 learned_addr learned my addr 172.21.15.78:0/2661369786 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.920+0000 7f32e259c700 1 -- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e4124000 msgr2=0x7f32e41116d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32e259c700 1 --2- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e4124000 0x7f32e41116d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32e259c700 1 -- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e41243e0 msgr2=0x7f32e4111d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32e259c700 1 --2- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e41243e0 0x7f32e4111d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32e259c700 1 -- 172.21.15.78:0/2661369786 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d80092a0 con 0x7f32e40961a0 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32e2d9d700 1 --2- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e41243e0 0x7f32e4111d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32e259c700 1 --2- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e41153f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f32d400c4c0 tx=0x7f32d4007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32d2ffd700 1 -- 172.21.15.78:0/2661369786 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400ce30 con 0x7f32e40961a0 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32d2ffd700 1 -- 172.21.15.78:0/2661369786 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d40072e0 con 0x7f32e40961a0 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32dc009a20 con 0x7f32e40961a0 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32d2ffd700 1 -- 172.21.15.78:0/2661369786 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40057a0 con 0x7f32e40961a0 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e4112430 con 0x7f32e40961a0 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.921+0000 7f32d2ffd700 1 -- 172.21.15.78:0/2661369786 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f32d4005bd0 con 0x7f32e40961a0 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.922+0000 7f32d2ffd700 1 -- 172.21.15.78:0/2661369786 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f32d403a8a0 con 0x7f32e40961a0 2024-04-25T02:19:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.922+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e4097f70 con 0x7f32e40961a0 2024-04-25T02:19:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:00.926+0000 7f32d2ffd700 1 -- 172.21.15.78:0/2661369786 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f32d401d3f0 con 0x7f32e40961a0 2024-04-25T02:19:01.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.086+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f32e4046ce0 con 0x7f32c402bd00 2024-04-25T02:19:01.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.086+0000 7f32d2ffd700 1 -- 172.21.15.78:0/2661369786 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7f32e4046ce0 con 0x7f32c402bd00 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 >> v1:172.21.15.78:6816/46507 conn(0x7f32c402bd00 legacy=0x7f32c402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 msgr2=0x7f32e41153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 --2- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e41153f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f32d400c4c0 tx=0x7f32d4007c10).stop 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 shutdown_connections 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 --2- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32e41243e0 0x7f32e4111d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 --2- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f32e40961a0 0x7f32e41153f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 --2- 172.21.15.78:0/2661369786 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32e4124000 0x7f32e41116d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 >> 172.21.15.78:0/2661369786 conn(0x7f32e4097450 msgr2=0x7f32e41272d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 shutdown_connections 2024-04-25T02:19:01.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.088+0000 7f32e8b20700 1 -- 172.21.15.78:0/2661369786 wait complete. 2024-04-25T02:19:01.094 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T02:19:01.104 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T02:19:01.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:19:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.218+0000 7fd3458c1700 1 Processor -- start 2024-04-25T02:19:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.218+0000 7fd3458c1700 1 -- start start 2024-04-25T02:19:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.218+0000 7fd3458c1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340064b70 0x7fd340098840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.218+0000 7fd3458c1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd340099130 0x7fd34012aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.218+0000 7fd3458c1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd340091c40 con 0x7fd340098d30 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.218+0000 7fd3458c1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd340064f50 con 0x7fd340099130 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.218+0000 7fd3458c1700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd340065930 con 0x7fd340064b70 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33effd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340064b70 0x7fd340098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd340099130 0x7fd34012aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33e7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd340098d30 0x7fd34012a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33098/0 (socket says 172.21.15.78:33098) 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33e7fc700 1 -- 172.21.15.78:0/843209762 learned_addr learned my addr 172.21.15.78:0/843209762 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33effd700 1 --2- 172.21.15.78:0/843209762 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340064b70 0x7fd340098840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33358/0 (socket says 172.21.15.78:33358) 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33effd700 1 -- 172.21.15.78:0/843209762 >> v2:172.21.15.78:3300/0 conn(0x7fd340099130 msgr2=0x7fd34012aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33effd700 1 --2- 172.21.15.78:0/843209762 >> v2:172.21.15.78:3300/0 conn(0x7fd340099130 0x7fd34012aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33effd700 1 -- 172.21.15.78:0/843209762 >> v1:172.21.15.78:6789/0 conn(0x7fd340098d30 legacy=0x7fd34012a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33dffb700 1 -- 172.21.15.78:0/843209762 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419441247 0 0) 0x7fd340091c40 con 0x7fd340098d30 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33effd700 1 -- 172.21.15.78:0/843209762 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd340098530 con 0x7fd340064b70 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33f7fe700 1 --2- 172.21.15.78:0/843209762 >> v2:172.21.15.78:3300/0 conn(0x7fd340099130 0x7fd34012aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33effd700 1 --2- 172.21.15.78:0/843209762 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340064b70 0x7fd340098840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd334009790 tx=0x7fd334009060).ready entity=mon.2 client_cookie=4f73eddfca3dbad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33dffb700 1 -- 172.21.15.78:0/843209762 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400f510 con 0x7fd340064b70 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33dffb700 1 -- 172.21.15.78:0/843209762 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400f670 con 0x7fd340064b70 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.219+0000 7fd33dffb700 1 -- 172.21.15.78:0/843209762 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400f9f0 con 0x7fd340064b70 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.220+0000 7fd3458c1700 1 -- 172.21.15.78:0/843209762 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340064b70 msgr2=0x7fd340098840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.220+0000 7fd3458c1700 1 --2- 172.21.15.78:0/843209762 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340064b70 0x7fd340098840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd334009790 tx=0x7fd334009060).stop 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.220+0000 7fd3458c1700 1 -- 172.21.15.78:0/843209762 shutdown_connections 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.220+0000 7fd3458c1700 1 --2- 172.21.15.78:0/843209762 >> v2:172.21.15.78:3300/0 conn(0x7fd340099130 0x7fd34012aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.220+0000 7fd3458c1700 1 --2- 172.21.15.78:0/843209762 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340064b70 0x7fd340098840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.220+0000 7fd3458c1700 1 -- 172.21.15.78:0/843209762 >> 172.21.15.78:0/843209762 conn(0x7fd34009e7a0 msgr2=0x7fd34009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.220+0000 7fd3458c1700 1 -- 172.21.15.78:0/843209762 shutdown_connections 2024-04-25T02:19:01.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.220+0000 7fd3458c1700 1 -- 172.21.15.78:0/843209762 wait complete. 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd3458c1700 1 Processor -- start 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd3458c1700 1 -- start start 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd3458c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd340098d30 0x7fd340117090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd3458c1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd340099130 0x7fd340117580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd3458c1700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340117a70 0x7fd340140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd3458c1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd340118e10 con 0x7fd340098d30 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd3458c1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd340118c20 con 0x7fd340099130 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd3458c1700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd340118540 con 0x7fd340117a70 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd340098d30 0x7fd340117090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33f7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340117a70 0x7fd340140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd340098d30 0x7fd340117090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41370/0 (socket says 172.21.15.78:41370) 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33effd700 1 -- 172.21.15.78:0/725750830 learned_addr learned my addr 172.21.15.78:0/725750830 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33e7fc700 1 --2- 172.21.15.78:0/725750830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd340099130 0x7fd340117580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33effd700 1 -- 172.21.15.78:0/725750830 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340117a70 msgr2=0x7fd340140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33effd700 1 --2- 172.21.15.78:0/725750830 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340117a70 0x7fd340140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33effd700 1 -- 172.21.15.78:0/725750830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd340099130 msgr2=0x7fd340117580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33effd700 1 --2- 172.21.15.78:0/725750830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd340099130 0x7fd340117580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33effd700 1 -- 172.21.15.78:0/725750830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338009a20 con 0x7fd340098d30 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.221+0000 7fd33f7fe700 1 --2- 172.21.15.78:0/725750830 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd340117a70 0x7fd340140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.222+0000 7fd33effd700 1 --2- 172.21.15.78:0/725750830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd340098d30 0x7fd340117090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd340065a70 tx=0x7fd334017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.222+0000 7fd3277fe700 1 -- 172.21.15.78:0/725750830 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400f7e0 con 0x7fd340098d30 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.222+0000 7fd3277fe700 1 -- 172.21.15.78:0/725750830 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400f980 con 0x7fd340098d30 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.222+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3340092a0 con 0x7fd340098d30 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.222+0000 7fd3277fe700 1 -- 172.21.15.78:0/725750830 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33401b660 con 0x7fd340098d30 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.222+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd340117ed0 con 0x7fd340098d30 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.222+0000 7fd3277fe700 1 -- 172.21.15.78:0/725750830 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fd33401b9d0 con 0x7fd340098d30 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.222+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd340128850 con 0x7fd340098d30 2024-04-25T02:19:01.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.223+0000 7fd3277fe700 1 -- 172.21.15.78:0/725750830 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fd33403cd70 con 0x7fd340098d30 2024-04-25T02:19:01.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.223+0000 7fd3277fe700 1 -- 172.21.15.78:0/725750830 --> v1:172.21.15.78:6808/47116 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd32c038880 con 0x7fd32c034b70 2024-04-25T02:19:01.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.223+0000 7fd3277fe700 1 -- 172.21.15.78:0/725750830 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd33402c940 con 0x7fd340098d30 2024-04-25T02:19:01.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.224+0000 7fd3277fe700 1 -- 172.21.15.78:0/725750830 <== osd.2 v1:172.21.15.78:6808/47116 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7fd32c038880 con 0x7fd32c034b70 2024-04-25T02:19:01.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.236+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 --> v1:172.21.15.78:6808/47116 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd34011aa70 con 0x7fd32c034b70 2024-04-25T02:19:01.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd3277fe700 1 -- 172.21.15.78:0/725750830 <== osd.2 v1:172.21.15.78:6808/47116 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7fd34011aa70 con 0x7fd32c034b70 2024-04-25T02:19:01.241 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-25T02:19:01.241 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-04-25T02:19:01.241 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-25T02:19:01.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 >> v1:172.21.15.78:6808/47116 conn(0x7fd32c034b70 legacy=0x7fd32c037010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 >> v1:172.21.15.78:6816/46507 conn(0x7fd32c02bd00 legacy=0x7fd32c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd340098d30 msgr2=0x7fd340117090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd3458c1700 1 --2- 172.21.15.78:0/725750830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd340098d30 0x7fd340117090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd340065a70 tx=0x7fd334017000).stop 2024-04-25T02:19:01.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd33f7fe700 1 -- 172.21.15.78:0/725750830 reap_dead start 2024-04-25T02:19:01.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 shutdown_connections 2024-04-25T02:19:01.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 >> 172.21.15.78:0/725750830 conn(0x7fd340064b70 msgr2=0x7fd34012ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:01.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 shutdown_connections 2024-04-25T02:19:01.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.237+0000 7fd3458c1700 1 -- 172.21.15.78:0/725750830 wait complete. 2024-04-25T02:19:01.252 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T02:19:01.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.366+0000 7f5f7e940700 1 Processor -- start 2024-04-25T02:19:01.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.366+0000 7f5f7e940700 1 -- start start 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f7e940700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f78124000 0x7f5f780961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f7e940700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f780937a0 0x7f5f781243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f7e940700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f7e940700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f78096cf0 con 0x7f5f78124000 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f7e940700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78093ba0 con 0x7f5f781274e0 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f7e940700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78092d00 con 0x7f5f780937a0 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f780937a0 0x7f5f781243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f7cedd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f77fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f78124000 0x7f5f780961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f780937a0 0x7f5f781243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33370/0 (socket says 172.21.15.78:33370) 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f7cedd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78127990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39264/0 (socket says 172.21.15.78:39264) 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f777fe700 1 -- 172.21.15.78:0/3299941568 learned_addr learned my addr 172.21.15.78:0/3299941568 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f77fff700 1 -- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f780937a0 msgr2=0x7f5f781243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:01.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f77fff700 1 --2- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f780937a0 0x7f5f781243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f77fff700 1 -- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 msgr2=0x7f5f78127990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f77fff700 1 --2- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78127990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f77fff700 1 -- 172.21.15.78:0/3299941568 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f780933a0 con 0x7f5f78124000 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f777fe700 1 --2- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f780937a0 0x7f5f781243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f7cedd700 1 --2- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f77fff700 1 --2- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f78124000 0x7f5f780961a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f5f6800ba00 tx=0x7f5f6800b300).ready entity=mon.0 client_cookie=d90e64b81bb6b452 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f76ffd700 1 -- 172.21.15.78:0/3299941568 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6800b370 con 0x7f5f78124000 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f76ffd700 1 -- 172.21.15.78:0/3299941568 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6800d8c0 con 0x7f5f78124000 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.367+0000 7f5f76ffd700 1 -- 172.21.15.78:0/3299941568 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6800dc40 con 0x7f5f78124000 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.368+0000 7f5f7e940700 1 -- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f78124000 msgr2=0x7f5f780961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.368+0000 7f5f7e940700 1 --2- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f78124000 0x7f5f780961a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f5f6800ba00 tx=0x7f5f6800b300).stop 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.368+0000 7f5f7e940700 1 -- 172.21.15.78:0/3299941568 shutdown_connections 2024-04-25T02:19:01.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.368+0000 7f5f7e940700 1 --2- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.368+0000 7f5f7e940700 1 --2- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f78124000 0x7f5f780961a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.368+0000 7f5f7e940700 1 --2- 172.21.15.78:0/3299941568 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f780937a0 0x7f5f781243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.368+0000 7f5f7e940700 1 -- 172.21.15.78:0/3299941568 >> 172.21.15.78:0/3299941568 conn(0x7f5f78097450 msgr2=0x7f5f78097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:01.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.368+0000 7f5f7e940700 1 -- 172.21.15.78:0/3299941568 shutdown_connections 2024-04-25T02:19:01.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.368+0000 7f5f7e940700 1 -- 172.21.15.78:0/3299941568 wait complete. 2024-04-25T02:19:01.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f7e940700 1 Processor -- start 2024-04-25T02:19:01.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f7e940700 1 -- start start 2024-04-25T02:19:01.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f7e940700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f780937a0 0x7f5f78068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f7e940700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f78124000 0x7f5f78117450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f7e940700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f7e940700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f781169b0 con 0x7f5f780937a0 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f7e940700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78094fe0 con 0x7f5f781274e0 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f7e940700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78092440 con 0x7f5f78124000 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f77fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f780937a0 0x7f5f78068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f78124000 0x7f5f78117450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f77fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f780937a0 0x7f5f78068950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41376/0 (socket says 172.21.15.78:41376) 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.369+0000 7f5f77fff700 1 -- 172.21.15.78:0/3010266575 learned_addr learned my addr 172.21.15.78:0/3010266575 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f7cedd700 1 --2- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f77fff700 1 -- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f78124000 msgr2=0x7f5f78117450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f77fff700 1 --2- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f78124000 0x7f5f78117450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f77fff700 1 -- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 msgr2=0x7f5f78068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f77fff700 1 --2- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78068f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f77fff700 1 -- 172.21.15.78:0/3010266575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c009370 con 0x7f5f780937a0 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f77fff700 1 --2- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f780937a0 0x7f5f78068950 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f5f68010fd0 tx=0x7f5f6800b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f74ff9700 1 -- 172.21.15.78:0/3010266575 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68006910 con 0x7f5f780937a0 2024-04-25T02:19:01.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f74ff9700 1 -- 172.21.15.78:0/3010266575 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f68019660 con 0x7f5f780937a0 2024-04-25T02:19:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f70009a20 con 0x7f5f780937a0 2024-04-25T02:19:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f74ff9700 1 -- 172.21.15.78:0/3010266575 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68019a20 con 0x7f5f780937a0 2024-04-25T02:19:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.370+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6800b540 con 0x7f5f780937a0 2024-04-25T02:19:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.371+0000 7f5f74ff9700 1 -- 172.21.15.78:0/3010266575 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f5f6800f3d0 con 0x7f5f780937a0 2024-04-25T02:19:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.371+0000 7f5f74ff9700 1 -- 172.21.15.78:0/3010266575 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f5f6803cc50 con 0x7f5f780937a0 2024-04-25T02:19:01.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.371+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f78116bd0 con 0x7f5f780937a0 2024-04-25T02:19:01.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.376+0000 7f5f74ff9700 1 -- 172.21.15.78:0/3010266575 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f5f68028020 con 0x7f5f780937a0 2024-04-25T02:19:01.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.535+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f78116eb0 con 0x7f5f6402bd00 2024-04-25T02:19:01.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.536+0000 7f5f74ff9700 1 -- 172.21.15.78:0/3010266575 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7f5f6c009920 con 0x7f5f6402bd00 2024-04-25T02:19:01.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 >> v1:172.21.15.78:6816/46507 conn(0x7f5f6402bd00 legacy=0x7f5f6402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f780937a0 msgr2=0x7f5f78068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 --2- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f780937a0 0x7f5f78068950 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f5f68010fd0 tx=0x7f5f6800b300).stop 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 shutdown_connections 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 --2- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f781274e0 0x7f5f78068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 --2- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f780937a0 0x7f5f78068950 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 --2- 172.21.15.78:0/3010266575 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5f78124000 0x7f5f78117450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 >> 172.21.15.78:0/3010266575 conn(0x7f5f78097450 msgr2=0x7f5f780627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 shutdown_connections 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.538+0000 7f5f7e940700 1 -- 172.21.15.78:0/3010266575 wait complete. 2024-04-25T02:19:01.543 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T02:19:01.553 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T02:19:01.553 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:19:01.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f132d9b3700 1 Processor -- start 2024-04-25T02:19:01.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f132d9b3700 1 -- start start 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f132d9b3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1328098f50 0x7f132812fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f132d9b3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1328130040 0x7f1328132430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f132d9b3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1328091c40 con 0x7f1328064b70 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f132d9b3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1328064f50 con 0x7f1328130040 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f132d9b3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1328065930 con 0x7f1328098f50 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f13277fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1328130040 0x7f1328132430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f1326ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1328064b70 0x7f1328098840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33112/0 (socket says 172.21.15.78:33112) 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f1326ffd700 1 -- 172.21.15.78:0/3952281302 learned_addr learned my addr 172.21.15.78:0/3952281302 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f13277fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1328130040 0x7f1328132430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41392/0 (socket says 172.21.15.78:41392) 2024-04-25T02:19:01.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f13267fc700 1 --2- 172.21.15.78:0/3952281302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1328098f50 0x7f132812fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f1325ffb700 1 -- 172.21.15.78:0/3952281302 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615012031 0 0) 0x7f1328091c40 con 0x7f1328064b70 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f1325ffb700 1 -- 172.21.15.78:0/3952281302 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13100033f0 con 0x7f1328064b70 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f13267fc700 1 -- 172.21.15.78:0/3952281302 >> v2:172.21.15.78:3300/0 conn(0x7f1328130040 msgr2=0x7f1328132430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f13267fc700 1 --2- 172.21.15.78:0/3952281302 >> v2:172.21.15.78:3300/0 conn(0x7f1328130040 0x7f1328132430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f13267fc700 1 -- 172.21.15.78:0/3952281302 >> v1:172.21.15.78:6789/0 conn(0x7f1328064b70 legacy=0x7f1328098840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.667+0000 7f13267fc700 1 -- 172.21.15.78:0/3952281302 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328098530 con 0x7f1328098f50 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f13277fe700 1 --2- 172.21.15.78:0/3952281302 >> v2:172.21.15.78:3300/0 conn(0x7f1328130040 0x7f1328132430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f13267fc700 1 --2- 172.21.15.78:0/3952281302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1328098f50 0x7f132812fb50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f1318009760 tx=0x7f1318009060).ready entity=mon.1 client_cookie=c3bbae239e5fda06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f1325ffb700 1 -- 172.21.15.78:0/3952281302 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131800d4a0 con 0x7f1328098f50 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f1325ffb700 1 -- 172.21.15.78:0/3952281302 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131800d600 con 0x7f1328098f50 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f1325ffb700 1 -- 172.21.15.78:0/3952281302 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131800d980 con 0x7f1328098f50 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f132d9b3700 1 -- 172.21.15.78:0/3952281302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1328098f50 msgr2=0x7f132812fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f132d9b3700 1 --2- 172.21.15.78:0/3952281302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1328098f50 0x7f132812fb50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f1318009760 tx=0x7f1318009060).stop 2024-04-25T02:19:01.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f132d9b3700 1 -- 172.21.15.78:0/3952281302 shutdown_connections 2024-04-25T02:19:01.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f132d9b3700 1 --2- 172.21.15.78:0/3952281302 >> v2:172.21.15.78:3300/0 conn(0x7f1328130040 0x7f1328132430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f132d9b3700 1 --2- 172.21.15.78:0/3952281302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1328098f50 0x7f132812fb50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f132d9b3700 1 -- 172.21.15.78:0/3952281302 >> 172.21.15.78:0/3952281302 conn(0x7f132809e7a0 msgr2=0x7f132809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:01.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f132d9b3700 1 -- 172.21.15.78:0/3952281302 shutdown_connections 2024-04-25T02:19:01.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.668+0000 7f132d9b3700 1 -- 172.21.15.78:0/3952281302 wait complete. 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.669+0000 7f132d9b3700 1 Processor -- start 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.669+0000 7f132d9b3700 1 -- start start 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f132d9b3700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1328098f50 0x7f1328095bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f132d9b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1328130040 0x7f13280960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f132d9b3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13280965b0 0x7f13281404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f132d9b3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132812fda0 con 0x7f1328130040 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f132d9b3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1328099a80 con 0x7f13280965b0 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f132d9b3700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1328115270 con 0x7f1328098f50 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f1326ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1328098f50 0x7f1328095bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13277fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13280965b0 0x7f13281404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13267fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1328130040 0x7f13280960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13267fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1328130040 0x7f13280960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41400/0 (socket says 172.21.15.78:41400) 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f1326ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1328098f50 0x7f1328095bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33390/0 (socket says 172.21.15.78:33390) 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13277fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13280965b0 0x7f13281404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39304/0 (socket says 172.21.15.78:39304) 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13267fc700 1 -- 172.21.15.78:0/3250066751 learned_addr learned my addr 172.21.15.78:0/3250066751 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13277fe700 1 -- 172.21.15.78:0/3250066751 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1328098f50 msgr2=0x7f1328095bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13277fe700 1 --2- 172.21.15.78:0/3250066751 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1328098f50 0x7f1328095bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13277fe700 1 -- 172.21.15.78:0/3250066751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1328130040 msgr2=0x7f13280960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13277fe700 1 --2- 172.21.15.78:0/3250066751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1328130040 0x7f13280960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13277fe700 1 -- 172.21.15.78:0/3250066751 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320009a20 con 0x7f13280965b0 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f1326ffd700 1 --2- 172.21.15.78:0/3250066751 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f1328098f50 0x7f1328095bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f13277fe700 1 --2- 172.21.15.78:0/3250066751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13280965b0 0x7f13281404f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f1320009f00 tx=0x7f132000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f130f7fe700 1 -- 172.21.15.78:0/3250066751 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132000cb70 con 0x7f13280965b0 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f130f7fe700 1 -- 172.21.15.78:0/3250066751 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132000f040 con 0x7f13280965b0 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13180092a0 con 0x7f13280965b0 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f130f7fe700 1 -- 172.21.15.78:0/3250066751 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320013400 con 0x7f13280965b0 2024-04-25T02:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.670+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1328096f40 con 0x7f13280965b0 2024-04-25T02:19:01.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.671+0000 7f130f7fe700 1 -- 172.21.15.78:0/3250066751 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f1320013770 con 0x7f13280965b0 2024-04-25T02:19:01.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.671+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1328063870 con 0x7f13280965b0 2024-04-25T02:19:01.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.671+0000 7f130f7fe700 1 -- 172.21.15.78:0/3250066751 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f132003bcf0 con 0x7f13280965b0 2024-04-25T02:19:01.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.671+0000 7f130f7fe700 1 -- 172.21.15.78:0/3250066751 --> v1:172.21.15.78:6809/47117 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1314038900 con 0x7f1314034bf0 2024-04-25T02:19:01.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.671+0000 7f130f7fe700 1 -- 172.21.15.78:0/3250066751 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1320007340 con 0x7f13280965b0 2024-04-25T02:19:01.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.672+0000 7f130f7fe700 1 -- 172.21.15.78:0/3250066751 <== osd.3 v1:172.21.15.78:6809/47117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (unknown 0 0 1671252174) 0x7f1314038900 con 0x7f1314034bf0 2024-04-25T02:19:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 --> v1:172.21.15.78:6809/47117 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1328115940 con 0x7f1314034bf0 2024-04-25T02:19:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f130f7fe700 1 -- 172.21.15.78:0/3250066751 <== osd.3 v1:172.21.15.78:6809/47117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f1318009d80 con 0x7f1314034bf0 2024-04-25T02:19:01.689 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-04-25T02:19:01.690 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-04-25T02:19:01.690 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-04-25T02:19:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 >> v1:172.21.15.78:6809/47117 conn(0x7f1314034bf0 legacy=0x7f1314037090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 >> v1:172.21.15.78:6816/46507 conn(0x7f131402bd00 legacy=0x7f131402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13280965b0 msgr2=0x7f13281404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f132d9b3700 1 --2- 172.21.15.78:0/3250066751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13280965b0 0x7f13281404f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f1320009f00 tx=0x7f132000b040).stop 2024-04-25T02:19:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f13277fe700 1 -- 172.21.15.78:0/3250066751 reap_dead start 2024-04-25T02:19:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 shutdown_connections 2024-04-25T02:19:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 >> 172.21.15.78:0/3250066751 conn(0x7f1328064b70 msgr2=0x7f132812a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 shutdown_connections 2024-04-25T02:19:01.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.685+0000 7f132d9b3700 1 -- 172.21.15.78:0/3250066751 wait complete. 2024-04-25T02:19:01.701 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.812+0000 7f5b7aa74700 1 Processor -- start 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.812+0000 7f5b7aa74700 1 -- start start 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b7aa74700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b74124000 0x7f5b740961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b7aa74700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b740937a0 0x7f5b741243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b7aa74700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b7aa74700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b74096cf0 con 0x7f5b740937a0 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b7aa74700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74093ba0 con 0x7f5b741274e0 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b7aa74700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74092d00 con 0x7f5b74124000 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b73fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b740937a0 0x7f5b741243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b78810700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b74124000 0x7f5b740961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b79011700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b73fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b740937a0 0x7f5b741243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41410/0 (socket says 172.21.15.78:41410) 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b73fff700 1 -- 172.21.15.78:0/1897033785 learned_addr learned my addr 172.21.15.78:0/1897033785 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b79011700 1 -- 172.21.15.78:0/1897033785 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b74124000 msgr2=0x7f5b740961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b79011700 1 --2- 172.21.15.78:0/1897033785 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b74124000 0x7f5b740961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b79011700 1 -- 172.21.15.78:0/1897033785 >> v2:172.21.15.78:3300/0 conn(0x7f5b740937a0 msgr2=0x7f5b741243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b79011700 1 --2- 172.21.15.78:0/1897033785 >> v2:172.21.15.78:3300/0 conn(0x7f5b740937a0 0x7f5b741243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b79011700 1 -- 172.21.15.78:0/1897033785 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b740933a0 con 0x7f5b741274e0 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b78810700 1 --2- 172.21.15.78:0/1897033785 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b74124000 0x7f5b740961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b73fff700 1 --2- 172.21.15.78:0/1897033785 >> v2:172.21.15.78:3300/0 conn(0x7f5b740937a0 0x7f5b741243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b79011700 1 --2- 172.21.15.78:0/1897033785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74127990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5b6c00d100 tx=0x7f5b6c00b990).ready entity=mon.1 client_cookie=2fb9beb0d846666b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.813+0000 7f5b737fe700 1 -- 172.21.15.78:0/1897033785 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c010070 con 0x7f5b741274e0 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b737fe700 1 -- 172.21.15.78:0/1897033785 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c00b2e0 con 0x7f5b741274e0 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b737fe700 1 -- 172.21.15.78:0/1897033785 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00dc80 con 0x7f5b741274e0 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b7aa74700 1 -- 172.21.15.78:0/1897033785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 msgr2=0x7f5b74127990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b7aa74700 1 --2- 172.21.15.78:0/1897033785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74127990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5b6c00d100 tx=0x7f5b6c00b990).stop 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b7aa74700 1 -- 172.21.15.78:0/1897033785 shutdown_connections 2024-04-25T02:19:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b7aa74700 1 --2- 172.21.15.78:0/1897033785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74127990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b7aa74700 1 --2- 172.21.15.78:0/1897033785 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b74124000 0x7f5b740961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b7aa74700 1 --2- 172.21.15.78:0/1897033785 >> v2:172.21.15.78:3300/0 conn(0x7f5b740937a0 0x7f5b741243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b7aa74700 1 -- 172.21.15.78:0/1897033785 >> 172.21.15.78:0/1897033785 conn(0x7f5b74097450 msgr2=0x7f5b74097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b7aa74700 1 -- 172.21.15.78:0/1897033785 shutdown_connections 2024-04-25T02:19:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.814+0000 7f5b7aa74700 1 -- 172.21.15.78:0/1897033785 wait complete. 2024-04-25T02:19:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.815+0000 7f5b7aa74700 1 Processor -- start 2024-04-25T02:19:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.815+0000 7f5b7aa74700 1 -- start start 2024-04-25T02:19:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b7aa74700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b740937a0 0x7f5b74123720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b7aa74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b74124000 0x7f5b74115640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b7aa74700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74115b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b7aa74700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74092440 con 0x7f5b74124000 2024-04-25T02:19:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b7aa74700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74119120 con 0x7f5b741274e0 2024-04-25T02:19:01.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b7aa74700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74095180 con 0x7f5b740937a0 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b78810700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b740937a0 0x7f5b74123720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b73fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b74124000 0x7f5b74115640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b79011700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74115b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b78810700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b740937a0 0x7f5b74123720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33416/0 (socket says 172.21.15.78:33416) 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b78810700 1 -- 172.21.15.78:0/2234566558 learned_addr learned my addr 172.21.15.78:0/2234566558 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b79011700 1 -- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b740937a0 msgr2=0x7f5b74123720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b79011700 1 --2- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b740937a0 0x7f5b74123720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b79011700 1 -- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b74124000 msgr2=0x7f5b74115640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b79011700 1 --2- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b74124000 0x7f5b74115640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b79011700 1 -- 172.21.15.78:0/2234566558 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60009370 con 0x7f5b741274e0 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b78810700 1 --2- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b740937a0 0x7f5b74123720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b73fff700 1 --2- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b74124000 0x7f5b74115640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b79011700 1 --2- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74115b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5b6c015000 tx=0x7f5b6c00b990).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b71775700 1 -- 172.21.15.78:0/2234566558 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c009a40 con 0x7f5b741274e0 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b71775700 1 -- 172.21.15.78:0/2234566558 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c009ba0 con 0x7f5b741274e0 2024-04-25T02:19:01.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b680092a0 con 0x7f5b741274e0 2024-04-25T02:19:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b71775700 1 -- 172.21.15.78:0/2234566558 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c01f460 con 0x7f5b741274e0 2024-04-25T02:19:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.816+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c00bc30 con 0x7f5b741274e0 2024-04-25T02:19:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.817+0000 7f5b71775700 1 -- 172.21.15.78:0/2234566558 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f5b6c003040 con 0x7f5b741274e0 2024-04-25T02:19:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.817+0000 7f5b71775700 1 -- 172.21.15.78:0/2234566558 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f5b6c03c7a0 con 0x7f5b741274e0 2024-04-25T02:19:01.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.817+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b74097f70 con 0x7f5b741274e0 2024-04-25T02:19:01.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.822+0000 7f5b71775700 1 -- 172.21.15.78:0/2234566558 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f5b6c024020 con 0x7f5b741274e0 2024-04-25T02:19:01.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.979+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b74116440 con 0x7f5b5802bd00 2024-04-25T02:19:01.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.979+0000 7f5b71775700 1 -- 172.21.15.78:0/2234566558 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7f5b74116440 con 0x7f5b5802bd00 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 >> v1:172.21.15.78:6816/46507 conn(0x7f5b5802bd00 legacy=0x7f5b5802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 msgr2=0x7f5b74115b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 --2- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74115b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5b6c015000 tx=0x7f5b6c00b990).stop 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 shutdown_connections 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 --2- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b741274e0 0x7f5b74115b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 --2- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5b740937a0 0x7f5b74123720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 --2- 172.21.15.78:0/2234566558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b74124000 0x7f5b74115640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 >> 172.21.15.78:0/2234566558 conn(0x7f5b74097450 msgr2=0x7f5b741252d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 shutdown_connections 2024-04-25T02:19:01.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:01.981+0000 7f5b7aa74700 1 -- 172.21.15.78:0/2234566558 wait complete. 2024-04-25T02:19:01.987 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T02:19:01.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:19:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb31132700 1 Processor -- start 2024-04-25T02:19:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb31132700 1 -- start start 2024-04-25T02:19:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb31132700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c0961a0 0x7fcb2c0937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb31132700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb2c1243e0 0x7fcb2c127bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb31132700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2c096cf0 con 0x7fcb2c124000 2024-04-25T02:19:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb31132700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2c124850 con 0x7fcb2c1243e0 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb31132700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c092d00 con 0x7fcb2c0961a0 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb2a59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c0961a0 0x7fcb2c0937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb2b59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb2c1243e0 0x7fcb2c127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb2a59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c0961a0 0x7fcb2c0937a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33430/0 (socket says 172.21.15.78:33430) 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb2ad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcb2c124000 0x7fcb2c1274e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33118/0 (socket says 172.21.15.78:33118) 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.107+0000 7fcb2a59c700 1 -- 172.21.15.78:0/4104901228 learned_addr learned my addr 172.21.15.78:0/4104901228 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb2a59c700 1 -- 172.21.15.78:0/4104901228 >> v2:172.21.15.78:3300/0 conn(0x7fcb2c1243e0 msgr2=0x7fcb2c127bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb2a59c700 1 --2- 172.21.15.78:0/4104901228 >> v2:172.21.15.78:3300/0 conn(0x7fcb2c1243e0 0x7fcb2c127bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb2a59c700 1 -- 172.21.15.78:0/4104901228 >> v1:172.21.15.78:6789/0 conn(0x7fcb2c124000 legacy=0x7fcb2c1274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb2a59c700 1 -- 172.21.15.78:0/4104901228 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c0933a0 con 0x7fcb2c0961a0 2024-04-25T02:19:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb29d9b700 1 -- 172.21.15.78:0/4104901228 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053808585 0 0) 0x7fcb2c096cf0 con 0x7fcb2c124000 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb2b59e700 1 --2- 172.21.15.78:0/4104901228 >> v2:172.21.15.78:3300/0 conn(0x7fcb2c1243e0 0x7fcb2c127bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb2a59c700 1 --2- 172.21.15.78:0/4104901228 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c0961a0 0x7fcb2c0937a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcb1c006fd0 tx=0x7fcb1c0090f0).ready entity=mon.2 client_cookie=6c5bb44ebfc80195 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb29d9b700 1 -- 172.21.15.78:0/4104901228 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00b580 con 0x7fcb2c0961a0 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb29d9b700 1 -- 172.21.15.78:0/4104901228 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c00b6e0 con 0x7fcb2c0961a0 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb29d9b700 1 -- 172.21.15.78:0/4104901228 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00ba80 con 0x7fcb2c0961a0 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb31132700 1 -- 172.21.15.78:0/4104901228 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c0961a0 msgr2=0x7fcb2c0937a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb31132700 1 --2- 172.21.15.78:0/4104901228 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c0961a0 0x7fcb2c0937a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcb1c006fd0 tx=0x7fcb1c0090f0).stop 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb31132700 1 -- 172.21.15.78:0/4104901228 shutdown_connections 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb31132700 1 --2- 172.21.15.78:0/4104901228 >> v2:172.21.15.78:3300/0 conn(0x7fcb2c1243e0 0x7fcb2c127bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.108+0000 7fcb31132700 1 --2- 172.21.15.78:0/4104901228 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c0961a0 0x7fcb2c0937a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.109+0000 7fcb31132700 1 -- 172.21.15.78:0/4104901228 >> 172.21.15.78:0/4104901228 conn(0x7fcb2c097450 msgr2=0x7fcb2c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.109+0000 7fcb31132700 1 -- 172.21.15.78:0/4104901228 shutdown_connections 2024-04-25T02:19:02.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.109+0000 7fcb31132700 1 -- 172.21.15.78:0/4104901228 wait complete. 2024-04-25T02:19:02.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb31132700 1 Processor -- start 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb31132700 1 -- start start 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb31132700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb2c0961a0 0x7fcb2c1174c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb31132700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c124000 0x7fcb2c13a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb31132700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb2c1243e0 0x7fcb2c13a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb31132700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c13acb0 con 0x7fcb2c1243e0 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb31132700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c069c00 con 0x7fcb2c0961a0 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb31132700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c116ce0 con 0x7fcb2c124000 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb2ad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb2c0961a0 0x7fcb2c1174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb2a59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c124000 0x7fcb2c13a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb2b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb2c1243e0 0x7fcb2c13a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb2ad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb2c0961a0 0x7fcb2c1174c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:39324/0 (socket says 172.21.15.78:39324) 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb2a59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c124000 0x7fcb2c13a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:33444/0 (socket says 172.21.15.78:33444) 2024-04-25T02:19:02.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.110+0000 7fcb2ad9d700 1 -- 172.21.15.78:0/1920846148 learned_addr learned my addr 172.21.15.78:0/1920846148 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb2ad9d700 1 -- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c124000 msgr2=0x7fcb2c13a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb2ad9d700 1 --2- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c124000 0x7fcb2c13a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb2ad9d700 1 -- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb2c1243e0 msgr2=0x7fcb2c13a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb2ad9d700 1 --2- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb2c1243e0 0x7fcb2c13a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb2ad9d700 1 -- 172.21.15.78:0/1920846148 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2400bc30 con 0x7fcb2c0961a0 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb2b59e700 1 --2- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb2c1243e0 0x7fcb2c13a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb2a59c700 1 --2- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c124000 0x7fcb2c13a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb2ad9d700 1 --2- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb2c0961a0 0x7fcb2c1174c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fcb2000c4f0 tx=0x7fcb20007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb137fe700 1 -- 172.21.15.78:0/1920846148 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000ce20 con 0x7fcb2c0961a0 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb137fe700 1 -- 172.21.15.78:0/1920846148 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb200072e0 con 0x7fcb2c0961a0 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1c009370 con 0x7fcb2c0961a0 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb137fe700 1 -- 172.21.15.78:0/1920846148 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200056e0 con 0x7fcb2c0961a0 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c115660 con 0x7fcb2c0961a0 2024-04-25T02:19:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.111+0000 7fcb137fe700 1 -- 172.21.15.78:0/1920846148 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fcb20005a90 con 0x7fcb2c0961a0 2024-04-25T02:19:02.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.112+0000 7fcb137fe700 1 -- 172.21.15.78:0/1920846148 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fcb2003a940 con 0x7fcb2c0961a0 2024-04-25T02:19:02.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.112+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c116e20 con 0x7fcb2c0961a0 2024-04-25T02:19:02.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.117+0000 7fcb137fe700 1 -- 172.21.15.78:0/1920846148 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fcb2c116e20 con 0x7fcb2c0961a0 2024-04-25T02:19:02.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.272+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb2c116e20 con 0x7fcb1802bd00 2024-04-25T02:19:02.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.279+0000 7fcb137fe700 1 -- 172.21.15.78:0/1920846148 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256377 (unknown 2965378022 0 2572937755) 0x7fcb2c116e20 con 0x7fcb1802bd00 2024-04-25T02:19:02.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:19:02.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 >> v1:172.21.15.78:6816/46507 conn(0x7fcb1802bd00 legacy=0x7fcb1802e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb2c0961a0 msgr2=0x7fcb2c1174c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 --2- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb2c0961a0 0x7fcb2c1174c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fcb2000c4f0 tx=0x7fcb20007c10).stop 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 shutdown_connections 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 --2- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb2c1243e0 0x7fcb2c13a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 --2- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb2c0961a0 0x7fcb2c1174c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 --2- 172.21.15.78:0/1920846148 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fcb2c124000 0x7fcb2c13a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 >> 172.21.15.78:0/1920846148 conn(0x7fcb2c097450 msgr2=0x7fcb2c0950a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 shutdown_connections 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:02.282+0000 7fcb31132700 1 -- 172.21.15.78:0/1920846148 wait complete. 2024-04-25T02:19:02.289 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:19:02.297 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-04-25T02:19:00.304399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":27629,"num_write_kb":366886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27102,"ondisk_log_size":27102,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1511048,"kb_used_data":309864,"kb_used_omap":0,"kb_used_meta":1201152,"kb_avail":375976312,"statfs":{"total":386547056640,"available":384999743488,"internally_reserved":0,"allocated":317300736,"data_stored":316815546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1229979648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33670309,"num_objects":-738,"num_object_clones":0,"num_object_copies":-1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-738,"num_whiteouts":0,"num_read":7,"num_read_kb":78,"num_write":762,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002950"},"pg_stats":[{"pgid":"4.3f","version":"19'354","reported_seq":366,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275043+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:18:51.275043+0000","last_peered":"2024-04-25T02:18:51.275043+0000","last_clean":"2024-04-25T02:18:51.275043+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:18:51.275043+0000","last_undegraded":"2024-04-25T02:18:51.275043+0000","last_fullsized":"2024-04-25T02:18:51.275043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277671+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:18:51.277671+0000","last_peered":"2024-04-25T02:18:51.277671+0000","last_clean":"2024-04-25T02:18:51.277671+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:18:51.277671+0000","last_undegraded":"2024-04-25T02:18:51.277671+0000","last_fullsized":"2024-04-25T02:18:51.277671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267056+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:18:51.267056+0000","last_peered":"2024-04-25T02:18:51.267056+0000","last_clean":"2024-04-25T02:18:51.267056+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:18:51.267056+0000","last_undegraded":"2024-04-25T02:18:51.267056+0000","last_fullsized":"2024-04-25T02:18:51.267056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267040+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:18:51.267040+0000","last_peered":"2024-04-25T02:18:51.267040+0000","last_clean":"2024-04-25T02:18:51.267040+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:18:51.267040+0000","last_undegraded":"2024-04-25T02:18:51.267040+0000","last_fullsized":"2024-04-25T02:18:51.267040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269216+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:18:51.269216+0000","last_peered":"2024-04-25T02:18:51.269216+0000","last_clean":"2024-04-25T02:18:51.269216+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:18:51.269216+0000","last_undegraded":"2024-04-25T02:18:51.269216+0000","last_fullsized":"2024-04-25T02:18:51.269216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278782+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:18:51.278782+0000","last_peered":"2024-04-25T02:18:51.278782+0000","last_clean":"2024-04-25T02:18:51.278782+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:18:51.278782+0000","last_undegraded":"2024-04-25T02:18:51.278782+0000","last_fullsized":"2024-04-25T02:18:51.278782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'376","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272984+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:18:51.272984+0000","last_peered":"2024-04-25T02:18:51.272984+0000","last_clean":"2024-04-25T02:18:51.272984+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:18:51.272984+0000","last_undegraded":"2024-04-25T02:18:51.272984+0000","last_fullsized":"2024-04-25T02:18:51.272984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":376,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":3216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'297","reported_seq":309,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272124+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:18:51.272124+0000","last_peered":"2024-04-25T02:18:51.272124+0000","last_clean":"2024-04-25T02:18:51.272124+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:18:51.272124+0000","last_undegraded":"2024-04-25T02:18:51.272124+0000","last_fullsized":"2024-04-25T02:18:51.272124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":297,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":2172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269598+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:18:51.269598+0000","last_peered":"2024-04-25T02:18:51.269598+0000","last_clean":"2024-04-25T02:18:51.269598+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:18:51.269598+0000","last_undegraded":"2024-04-25T02:18:51.269598+0000","last_fullsized":"2024-04-25T02:18:51.269598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'351","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267201+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:18:51.267201+0000","last_peered":"2024-04-25T02:18:51.267201+0000","last_clean":"2024-04-25T02:18:51.267201+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:18:51.267201+0000","last_undegraded":"2024-04-25T02:18:51.267201+0000","last_fullsized":"2024-04-25T02:18:51.267201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.256733+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:18:51.256733+0000","last_peered":"2024-04-25T02:18:51.256733+0000","last_clean":"2024-04-25T02:18:51.256733+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:18:51.256733+0000","last_undegraded":"2024-04-25T02:18:51.256733+0000","last_fullsized":"2024-04-25T02:18:51.256733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":2530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'322","reported_seq":334,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277216+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:18:51.277216+0000","last_peered":"2024-04-25T02:18:51.277216+0000","last_clean":"2024-04-25T02:18:51.277216+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:18:51.277216+0000","last_undegraded":"2024-04-25T02:18:51.277216+0000","last_fullsized":"2024-04-25T02:18:51.277216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":322,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'359","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277681+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:18:51.277681+0000","last_peered":"2024-04-25T02:18:51.277681+0000","last_clean":"2024-04-25T02:18:51.277681+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:18:51.277681+0000","last_undegraded":"2024-04-25T02:18:51.277681+0000","last_fullsized":"2024-04-25T02:18:51.277681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":359,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":2645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278233+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:18:51.278233+0000","last_peered":"2024-04-25T02:18:51.278233+0000","last_clean":"2024-04-25T02:18:51.278233+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:18:51.278233+0000","last_undegraded":"2024-04-25T02:18:51.278233+0000","last_fullsized":"2024-04-25T02:18:51.278233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253088+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:18:51.253088+0000","last_peered":"2024-04-25T02:18:51.253088+0000","last_clean":"2024-04-25T02:18:51.253088+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:18:51.253088+0000","last_undegraded":"2024-04-25T02:18:51.253088+0000","last_fullsized":"2024-04-25T02:18:51.253088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'380","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271052+0000","last_change":"2024-04-25T02:10:53.852512+0000","last_active":"2024-04-25T02:18:51.271052+0000","last_peered":"2024-04-25T02:18:51.271052+0000","last_clean":"2024-04-25T02:18:51.271052+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:18:51.271052+0000","last_undegraded":"2024-04-25T02:18:51.271052+0000","last_fullsized":"2024-04-25T02:18:51.271052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":380,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.264403+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:18:51.264403+0000","last_peered":"2024-04-25T02:18:51.264403+0000","last_clean":"2024-04-25T02:18:51.264403+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:18:51.264403+0000","last_undegraded":"2024-04-25T02:18:51.264403+0000","last_fullsized":"2024-04-25T02:18:51.264403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'340","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253849+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:18:51.253849+0000","last_peered":"2024-04-25T02:18:51.253849+0000","last_clean":"2024-04-25T02:18:51.253849+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:18:51.253849+0000","last_undegraded":"2024-04-25T02:18:51.253849+0000","last_fullsized":"2024-04-25T02:18:51.253849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'356","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276313+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:18:51.276313+0000","last_peered":"2024-04-25T02:18:51.276313+0000","last_clean":"2024-04-25T02:18:51.276313+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:18:51.276313+0000","last_undegraded":"2024-04-25T02:18:51.276313+0000","last_fullsized":"2024-04-25T02:18:51.276313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269721+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:18:51.269721+0000","last_peered":"2024-04-25T02:18:51.269721+0000","last_clean":"2024-04-25T02:18:51.269721+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:18:51.269721+0000","last_undegraded":"2024-04-25T02:18:51.269721+0000","last_fullsized":"2024-04-25T02:18:51.269721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'344","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273747+0000","last_change":"2024-04-25T02:10:53.852792+0000","last_active":"2024-04-25T02:18:51.273747+0000","last_peered":"2024-04-25T02:18:51.273747+0000","last_clean":"2024-04-25T02:18:51.273747+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:18:51.273747+0000","last_undegraded":"2024-04-25T02:18:51.273747+0000","last_fullsized":"2024-04-25T02:18:51.273747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'383","reported_seq":395,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267045+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:18:51.267045+0000","last_peered":"2024-04-25T02:18:51.267045+0000","last_clean":"2024-04-25T02:18:51.267045+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:18:51.267045+0000","last_undegraded":"2024-04-25T02:18:51.267045+0000","last_fullsized":"2024-04-25T02:18:51.267045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":2481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'350","reported_seq":362,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273435+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:18:51.273435+0000","last_peered":"2024-04-25T02:18:51.273435+0000","last_clean":"2024-04-25T02:18:51.273435+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:18:51.273435+0000","last_undegraded":"2024-04-25T02:18:51.273435+0000","last_fullsized":"2024-04-25T02:18:51.273435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":350,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271458+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:18:51.271458+0000","last_peered":"2024-04-25T02:18:51.271458+0000","last_clean":"2024-04-25T02:18:51.271458+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:18:51.271458+0000","last_undegraded":"2024-04-25T02:18:51.271458+0000","last_fullsized":"2024-04-25T02:18:51.271458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'386","reported_seq":398,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.250133+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:18:51.250133+0000","last_peered":"2024-04-25T02:18:51.250133+0000","last_clean":"2024-04-25T02:18:51.250133+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:18:51.250133+0000","last_undegraded":"2024-04-25T02:18:51.250133+0000","last_fullsized":"2024-04-25T02:18:51.250133+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281870+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:18:51.281870+0000","last_peered":"2024-04-25T02:18:51.281870+0000","last_clean":"2024-04-25T02:18:51.281870+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:18:51.281870+0000","last_undegraded":"2024-04-25T02:18:51.281870+0000","last_fullsized":"2024-04-25T02:18:51.281870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":421,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268411+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:18:51.268411+0000","last_peered":"2024-04-25T02:18:51.268411+0000","last_clean":"2024-04-25T02:18:51.268411+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:18:51.268411+0000","last_undegraded":"2024-04-25T02:18:51.268411+0000","last_fullsized":"2024-04-25T02:18:51.268411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'154","reported_seq":167,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.381581+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:18:45.381581+0000","last_peered":"2024-04-25T02:18:45.381581+0000","last_clean":"2024-04-25T02:18:45.381581+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:18:45.381581+0000","last_undegraded":"2024-04-25T02:18:45.381581+0000","last_fullsized":"2024-04-25T02:18:45.381581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":154,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":16455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'334","reported_seq":346,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272426+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:18:51.272426+0000","last_peered":"2024-04-25T02:18:51.272426+0000","last_clean":"2024-04-25T02:18:51.272426+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:18:51.272426+0000","last_undegraded":"2024-04-25T02:18:51.272426+0000","last_fullsized":"2024-04-25T02:18:51.272426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":334,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'76","reported_seq":89,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:44.365713+0000","last_change":"2024-04-25T02:10:02.370405+0000","last_active":"2024-04-25T02:18:44.365713+0000","last_peered":"2024-04-25T02:18:44.365713+0000","last_clean":"2024-04-25T02:18:44.365713+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:18:44.365713+0000","last_undegraded":"2024-04-25T02:18:44.365713+0000","last_fullsized":"2024-04-25T02:18:44.365713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":76,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'347","reported_seq":359,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263176+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:18:51.263176+0000","last_peered":"2024-04-25T02:18:51.263176+0000","last_clean":"2024-04-25T02:18:51.263176+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:18:51.263176+0000","last_undegraded":"2024-04-25T02:18:51.263176+0000","last_fullsized":"2024-04-25T02:18:51.263176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":347,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'243","reported_seq":256,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:31.210530+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:18:31.210530+0000","last_peered":"2024-04-25T02:18:31.210530+0000","last_clean":"2024-04-25T02:18:31.210530+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:18:31.210530+0000","last_undegraded":"2024-04-25T02:18:31.210530+0000","last_fullsized":"2024-04-25T02:18:31.210530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270570+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:18:51.270570+0000","last_peered":"2024-04-25T02:18:51.270570+0000","last_clean":"2024-04-25T02:18:51.270570+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:18:51.270570+0000","last_undegraded":"2024-04-25T02:18:51.270570+0000","last_fullsized":"2024-04-25T02:18:51.270570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'6","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.386829+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:18:39.386829+0000","last_peered":"2024-04-25T02:18:39.386829+0000","last_clean":"2024-04-25T02:18:39.386829+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:18:39.386829+0000","last_undegraded":"2024-04-25T02:18:39.386829+0000","last_fullsized":"2024-04-25T02:18:39.386829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'377","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273185+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:18:51.273185+0000","last_peered":"2024-04-25T02:18:51.273185+0000","last_clean":"2024-04-25T02:18:51.273185+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:18:51.273185+0000","last_undegraded":"2024-04-25T02:18:51.273185+0000","last_fullsized":"2024-04-25T02:18:51.273185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":377,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":2757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'80","reported_seq":93,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:53.336567+0000","last_change":"2024-04-25T02:10:02.367526+0000","last_active":"2024-04-25T02:18:53.336567+0000","last_peered":"2024-04-25T02:18:53.336567+0000","last_clean":"2024-04-25T02:18:53.336567+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:18:53.336567+0000","last_undegraded":"2024-04-25T02:18:53.336567+0000","last_fullsized":"2024-04-25T02:18:53.336567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":80,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6184361,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'412","reported_seq":424,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273256+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:18:51.273256+0000","last_peered":"2024-04-25T02:18:51.273256+0000","last_clean":"2024-04-25T02:18:51.273256+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:18:51.273256+0000","last_undegraded":"2024-04-25T02:18:51.273256+0000","last_fullsized":"2024-04-25T02:18:51.273256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":412,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'361","reported_seq":374,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.493452+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:18:48.493452+0000","last_peered":"2024-04-25T02:18:48.493452+0000","last_clean":"2024-04-25T02:18:48.493452+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:18:48.493452+0000","last_undegraded":"2024-04-25T02:18:48.493452+0000","last_fullsized":"2024-04-25T02:18:48.493452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":361,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270896+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:18:51.270896+0000","last_peered":"2024-04-25T02:18:51.270896+0000","last_clean":"2024-04-25T02:18:51.270896+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:18:51.270896+0000","last_undegraded":"2024-04-25T02:18:51.270896+0000","last_fullsized":"2024-04-25T02:18:51.270896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'305","reported_seq":318,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:47.440007+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:18:47.440007+0000","last_peered":"2024-04-25T02:18:47.440007+0000","last_clean":"2024-04-25T02:18:47.440007+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:18:47.440007+0000","last_undegraded":"2024-04-25T02:18:47.440007+0000","last_fullsized":"2024-04-25T02:18:47.440007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":305,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8389252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":12434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'364","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276850+0000","last_change":"2024-04-25T02:10:53.855075+0000","last_active":"2024-04-25T02:18:51.276850+0000","last_peered":"2024-04-25T02:18:51.276850+0000","last_clean":"2024-04-25T02:18:51.276850+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:18:51.276850+0000","last_undegraded":"2024-04-25T02:18:51.276850+0000","last_fullsized":"2024-04-25T02:18:51.276850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'126","reported_seq":139,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.464847+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:18:28.464847+0000","last_peered":"2024-04-25T02:18:28.464847+0000","last_clean":"2024-04-25T02:18:28.464847+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:18:28.464847+0000","last_undegraded":"2024-04-25T02:18:28.464847+0000","last_fullsized":"2024-04-25T02:18:28.464847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":126,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'333","reported_seq":342,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281255+0000","last_change":"2024-04-25T02:10:53.850733+0000","last_active":"2024-04-25T02:18:51.281255+0000","last_peered":"2024-04-25T02:18:51.281255+0000","last_clean":"2024-04-25T02:18:51.281255+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:18:51.281255+0000","last_undegraded":"2024-04-25T02:18:51.281255+0000","last_fullsized":"2024-04-25T02:18:51.281255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.835508+0000","last_change":"2024-04-25T02:10:02.370169+0000","last_active":"2024-04-25T02:10:52.835508+0000","last_peered":"2024-04-25T02:10:52.835508+0000","last_clean":"2024-04-25T02:10:52.835508+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:10:52.835508+0000","last_undegraded":"2024-04-25T02:10:52.835508+0000","last_fullsized":"2024-04-25T02:10:52.835508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'353","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268219+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:18:51.268219+0000","last_peered":"2024-04-25T02:18:51.268219+0000","last_clean":"2024-04-25T02:18:51.268219+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:18:51.268219+0000","last_undegraded":"2024-04-25T02:18:51.268219+0000","last_fullsized":"2024-04-25T02:18:51.268219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":353,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'3","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.466944+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:18:28.466944+0000","last_peered":"2024-04-25T02:18:28.466944+0000","last_clean":"2024-04-25T02:18:28.466944+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:18:28.466944+0000","last_undegraded":"2024-04-25T02:18:28.466944+0000","last_fullsized":"2024-04-25T02:18:28.466944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'406","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253893+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:18:51.253893+0000","last_peered":"2024-04-25T02:18:51.253893+0000","last_clean":"2024-04-25T02:18:51.253893+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:18:51.253893+0000","last_undegraded":"2024-04-25T02:18:51.253893+0000","last_fullsized":"2024-04-25T02:18:51.253893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":2547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'135","reported_seq":148,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:43.341218+0000","last_change":"2024-04-25T02:10:02.360557+0000","last_active":"2024-04-25T02:18:43.341218+0000","last_peered":"2024-04-25T02:18:43.341218+0000","last_clean":"2024-04-25T02:18:43.341218+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:18:43.341218+0000","last_undegraded":"2024-04-25T02:18:43.341218+0000","last_fullsized":"2024-04-25T02:18:43.341218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":135,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'351","reported_seq":360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279851+0000","last_change":"2024-04-25T02:10:53.853097+0000","last_active":"2024-04-25T02:18:51.279851+0000","last_peered":"2024-04-25T02:18:51.279851+0000","last_clean":"2024-04-25T02:18:51.279851+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:18:51.279851+0000","last_undegraded":"2024-04-25T02:18:51.279851+0000","last_fullsized":"2024-04-25T02:18:51.279851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'46","reported_seq":59,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:16:36.265281+0000","last_change":"2024-04-25T02:10:02.370637+0000","last_active":"2024-04-25T02:16:36.265281+0000","last_peered":"2024-04-25T02:16:36.265281+0000","last_clean":"2024-04-25T02:16:36.265281+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:16:36.265281+0000","last_undegraded":"2024-04-25T02:16:36.265281+0000","last_fullsized":"2024-04-25T02:16:36.265281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'375","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273633+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:18:51.273633+0000","last_peered":"2024-04-25T02:18:51.273633+0000","last_clean":"2024-04-25T02:18:51.273633+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:18:51.273633+0000","last_undegraded":"2024-04-25T02:18:51.273633+0000","last_fullsized":"2024-04-25T02:18:51.273633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":375,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'107","reported_seq":120,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.406993+0000","last_change":"2024-04-25T02:10:02.358829+0000","last_active":"2024-04-25T02:18:45.406993+0000","last_peered":"2024-04-25T02:18:45.406993+0000","last_clean":"2024-04-25T02:18:45.406993+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:18:45.406993+0000","last_undegraded":"2024-04-25T02:18:45.406993+0000","last_fullsized":"2024-04-25T02:18:45.406993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":107,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'396","reported_seq":408,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.225239+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:18:51.225239+0000","last_peered":"2024-04-25T02:18:51.225239+0000","last_clean":"2024-04-25T02:18:51.225239+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:18:51.225239+0000","last_undegraded":"2024-04-25T02:18:51.225239+0000","last_fullsized":"2024-04-25T02:18:51.225239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":396,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'82","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:42.341444+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:18:42.341444+0000","last_peered":"2024-04-25T02:18:42.341444+0000","last_clean":"2024-04-25T02:18:42.341444+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:18:42.341444+0000","last_undegraded":"2024-04-25T02:18:42.341444+0000","last_fullsized":"2024-04-25T02:18:42.341444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":82,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'356","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280670+0000","last_change":"2024-04-25T02:10:02.744548+0000","last_active":"2024-04-25T02:18:51.280670+0000","last_peered":"2024-04-25T02:18:51.280670+0000","last_clean":"2024-04-25T02:18:51.280670+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:18:51.280670+0000","last_undegraded":"2024-04-25T02:18:51.280670+0000","last_fullsized":"2024-04-25T02:18:51.280670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'32","reported_seq":45,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.375524+0000","last_change":"2024-04-25T02:10:02.371223+0000","last_active":"2024-04-25T02:18:38.375524+0000","last_peered":"2024-04-25T02:18:38.375524+0000","last_clean":"2024-04-25T02:18:38.375524+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:18:38.375524+0000","last_undegraded":"2024-04-25T02:18:38.375524+0000","last_fullsized":"2024-04-25T02:18:38.375524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'398","reported_seq":410,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267105+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:18:51.267105+0000","last_peered":"2024-04-25T02:18:51.267105+0000","last_clean":"2024-04-25T02:18:51.267105+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:18:51.267105+0000","last_undegraded":"2024-04-25T02:18:51.267105+0000","last_fullsized":"2024-04-25T02:18:51.267105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":398,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'114","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:40.356060+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:18:40.356060+0000","last_peered":"2024-04-25T02:18:40.356060+0000","last_clean":"2024-04-25T02:18:40.356060+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:18:40.356060+0000","last_undegraded":"2024-04-25T02:18:40.356060+0000","last_fullsized":"2024-04-25T02:18:40.356060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":114,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":12332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'459","reported_seq":471,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.248908+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:18:51.248908+0000","last_peered":"2024-04-25T02:18:51.248908+0000","last_clean":"2024-04-25T02:18:51.248908+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:18:51.248908+0000","last_undegraded":"2024-04-25T02:18:51.248908+0000","last_fullsized":"2024-04-25T02:18:51.248908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":459,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'74","reported_seq":87,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:40.059312+0000","last_change":"2024-04-25T02:10:02.367348+0000","last_active":"2024-04-25T02:18:40.059312+0000","last_peered":"2024-04-25T02:18:40.059312+0000","last_clean":"2024-04-25T02:18:40.059312+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:18:40.059312+0000","last_undegraded":"2024-04-25T02:18:40.059312+0000","last_fullsized":"2024-04-25T02:18:40.059312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":74,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'354","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279792+0000","last_change":"2024-04-25T02:10:53.851188+0000","last_active":"2024-04-25T02:18:51.279792+0000","last_peered":"2024-04-25T02:18:51.279792+0000","last_clean":"2024-04-25T02:18:51.279792+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:18:51.279792+0000","last_undegraded":"2024-04-25T02:18:51.279792+0000","last_fullsized":"2024-04-25T02:18:51.279792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"19'31","reported_seq":44,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:37.320752+0000","last_change":"2024-04-25T02:10:02.360699+0000","last_active":"2024-04-25T02:18:37.320752+0000","last_peered":"2024-04-25T02:18:37.320752+0000","last_clean":"2024-04-25T02:18:37.320752+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:18:37.320752+0000","last_undegraded":"2024-04-25T02:18:37.320752+0000","last_fullsized":"2024-04-25T02:18:37.320752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'332","reported_seq":344,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275215+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:18:51.275215+0000","last_peered":"2024-04-25T02:18:51.275215+0000","last_clean":"2024-04-25T02:18:51.275215+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:18:51.275215+0000","last_undegraded":"2024-04-25T02:18:51.275215+0000","last_fullsized":"2024-04-25T02:18:51.275215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":332,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'112","reported_seq":125,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:15:40.889041+0000","last_change":"2024-04-25T02:10:02.365974+0000","last_active":"2024-04-25T02:15:40.889041+0000","last_peered":"2024-04-25T02:15:40.889041+0000","last_clean":"2024-04-25T02:15:40.889041+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:15:40.889041+0000","last_undegraded":"2024-04-25T02:15:40.889041+0000","last_fullsized":"2024-04-25T02:15:40.889041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":112,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'328","reported_seq":340,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270459+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:18:51.270459+0000","last_peered":"2024-04-25T02:18:51.270459+0000","last_clean":"2024-04-25T02:18:51.270459+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:18:51.270459+0000","last_undegraded":"2024-04-25T02:18:51.270459+0000","last_fullsized":"2024-04-25T02:18:51.270459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838364+0000","last_change":"2024-04-25T02:09:58.222014+0000","last_active":"2024-04-25T02:10:52.838364+0000","last_peered":"2024-04-25T02:10:52.838364+0000","last_clean":"2024-04-25T02:10:52.838364+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:10:52.838364+0000","last_undegraded":"2024-04-25T02:10:52.838364+0000","last_fullsized":"2024-04-25T02:10:52.838364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'93","reported_seq":106,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.313037+0000","last_change":"2024-04-25T02:10:02.367538+0000","last_active":"2024-04-25T02:18:38.313037+0000","last_peered":"2024-04-25T02:18:38.313037+0000","last_clean":"2024-04-25T02:18:38.313037+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:18:38.313037+0000","last_undegraded":"2024-04-25T02:18:38.313037+0000","last_fullsized":"2024-04-25T02:18:38.313037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":93,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270717+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:18:51.270717+0000","last_peered":"2024-04-25T02:18:51.270717+0000","last_clean":"2024-04-25T02:18:51.270717+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:18:51.270717+0000","last_undegraded":"2024-04-25T02:18:51.270717+0000","last_fullsized":"2024-04-25T02:18:51.270717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839925+0000","last_change":"2024-04-25T02:09:58.221754+0000","last_active":"2024-04-25T02:10:52.839925+0000","last_peered":"2024-04-25T02:10:52.839925+0000","last_clean":"2024-04-25T02:10:52.839925+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:10:52.839925+0000","last_undegraded":"2024-04-25T02:10:52.839925+0000","last_fullsized":"2024-04-25T02:10:52.839925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'15","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:43.756248+0000","last_change":"2024-04-25T02:10:02.360464+0000","last_active":"2024-04-25T02:18:43.756248+0000","last_peered":"2024-04-25T02:18:43.756248+0000","last_clean":"2024-04-25T02:18:43.756248+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:18:43.756248+0000","last_undegraded":"2024-04-25T02:18:43.756248+0000","last_fullsized":"2024-04-25T02:18:43.756248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'326","reported_seq":338,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279087+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:18:51.279087+0000","last_peered":"2024-04-25T02:18:51.279087+0000","last_clean":"2024-04-25T02:18:51.279087+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:18:51.279087+0000","last_undegraded":"2024-04-25T02:18:51.279087+0000","last_fullsized":"2024-04-25T02:18:51.279087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":326,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.834714+0000","last_change":"2024-04-25T02:09:58.226445+0000","last_active":"2024-04-25T02:10:52.834714+0000","last_peered":"2024-04-25T02:10:52.834714+0000","last_clean":"2024-04-25T02:10:52.834714+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:10:52.834714+0000","last_undegraded":"2024-04-25T02:10:52.834714+0000","last_fullsized":"2024-04-25T02:10:52.834714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'241","reported_seq":254,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:08.991600+0000","last_change":"2024-04-25T02:10:02.361010+0000","last_active":"2024-04-25T02:18:08.991600+0000","last_peered":"2024-04-25T02:18:08.991600+0000","last_clean":"2024-04-25T02:18:08.991600+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:18:08.991600+0000","last_undegraded":"2024-04-25T02:18:08.991600+0000","last_fullsized":"2024-04-25T02:18:08.991600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":241,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":12388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'331","reported_seq":343,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.266717+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:18:51.266717+0000","last_peered":"2024-04-25T02:18:51.266717+0000","last_clean":"2024-04-25T02:18:51.266717+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:18:51.266717+0000","last_undegraded":"2024-04-25T02:18:51.266717+0000","last_fullsized":"2024-04-25T02:18:51.266717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":331,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":2335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.842499+0000","last_change":"2024-04-25T02:09:58.226741+0000","last_active":"2024-04-25T02:10:52.842499+0000","last_peered":"2024-04-25T02:10:52.842499+0000","last_clean":"2024-04-25T02:10:52.842499+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:10:52.842499+0000","last_undegraded":"2024-04-25T02:10:52.842499+0000","last_fullsized":"2024-04-25T02:10:52.842499+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.837741+0000","last_change":"2024-04-25T02:09:58.221760+0000","last_active":"2024-04-25T02:10:52.837741+0000","last_peered":"2024-04-25T02:10:52.837741+0000","last_clean":"2024-04-25T02:10:52.837741+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:10:52.837741+0000","last_undegraded":"2024-04-25T02:10:52.837741+0000","last_fullsized":"2024-04-25T02:10:52.837741+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'160","reported_seq":173,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:32.342332+0000","last_change":"2024-04-25T02:10:02.364629+0000","last_active":"2024-04-25T02:18:32.342332+0000","last_peered":"2024-04-25T02:18:32.342332+0000","last_clean":"2024-04-25T02:18:32.342332+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:18:32.342332+0000","last_undegraded":"2024-04-25T02:18:32.342332+0000","last_fullsized":"2024-04-25T02:18:32.342332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":160,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'344","reported_seq":356,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268567+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:18:51.268567+0000","last_peered":"2024-04-25T02:18:51.268567+0000","last_clean":"2024-04-25T02:18:51.268567+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:18:51.268567+0000","last_undegraded":"2024-04-25T02:18:51.268567+0000","last_fullsized":"2024-04-25T02:18:51.268567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.838954+0000","last_change":"2024-04-25T02:09:58.221870+0000","last_active":"2024-04-25T02:10:52.838954+0000","last_peered":"2024-04-25T02:10:52.838954+0000","last_clean":"2024-04-25T02:10:52.838954+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:10:52.838954+0000","last_undegraded":"2024-04-25T02:10:52.838954+0000","last_fullsized":"2024-04-25T02:10:52.838954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'626","reported_seq":1261,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:50.371325+0000","last_change":"2024-04-25T02:10:02.356105+0000","last_active":"2024-04-25T02:18:50.371325+0000","last_peered":"2024-04-25T02:18:50.371325+0000","last_clean":"2024-04-25T02:18:50.371325+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:18:50.371325+0000","last_undegraded":"2024-04-25T02:18:50.371325+0000","last_fullsized":"2024-04-25T02:18:50.371325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":626,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1113626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":622,"num_write_kb":1507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'415","reported_seq":427,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263065+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:18:51.263065+0000","last_peered":"2024-04-25T02:18:51.263065+0000","last_clean":"2024-04-25T02:18:51.263065+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:18:51.263065+0000","last_undegraded":"2024-04-25T02:18:51.263065+0000","last_fullsized":"2024-04-25T02:18:51.263065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841699+0000","last_change":"2024-04-25T02:09:58.219174+0000","last_active":"2024-04-25T02:10:52.841699+0000","last_peered":"2024-04-25T02:10:52.841699+0000","last_clean":"2024-04-25T02:10:52.841699+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:10:52.841699+0000","last_undegraded":"2024-04-25T02:10:52.841699+0000","last_fullsized":"2024-04-25T02:10:52.841699+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'44","reported_seq":57,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:23.925413+0000","last_change":"2024-04-25T02:10:02.360478+0000","last_active":"2024-04-25T02:18:23.925413+0000","last_peered":"2024-04-25T02:18:23.925413+0000","last_clean":"2024-04-25T02:18:23.925413+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:18:23.925413+0000","last_undegraded":"2024-04-25T02:18:23.925413+0000","last_fullsized":"2024-04-25T02:18:23.925413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'343","reported_seq":355,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271627+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:18:51.271627+0000","last_peered":"2024-04-25T02:18:51.271627+0000","last_clean":"2024-04-25T02:18:51.271627+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:18:51.271627+0000","last_undegraded":"2024-04-25T02:18:51.271627+0000","last_fullsized":"2024-04-25T02:18:51.271627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'63","reported_seq":76,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.385067+0000","last_change":"2024-04-25T02:10:02.370193+0000","last_active":"2024-04-25T02:18:48.385067+0000","last_peered":"2024-04-25T02:18:48.385067+0000","last_clean":"2024-04-25T02:18:48.385067+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:18:48.385067+0000","last_undegraded":"2024-04-25T02:18:48.385067+0000","last_fullsized":"2024-04-25T02:18:48.385067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.839006+0000","last_change":"2024-04-25T02:09:58.221763+0000","last_active":"2024-04-25T02:10:52.839006+0000","last_peered":"2024-04-25T02:10:52.839006+0000","last_clean":"2024-04-25T02:10:52.839006+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:10:52.839006+0000","last_undegraded":"2024-04-25T02:10:52.839006+0000","last_fullsized":"2024-04-25T02:10:52.839006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273457+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:18:51.273457+0000","last_peered":"2024-04-25T02:18:51.273457+0000","last_clean":"2024-04-25T02:18:51.273457+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:18:51.273457+0000","last_undegraded":"2024-04-25T02:18:51.273457+0000","last_fullsized":"2024-04-25T02:18:51.273457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:10:52.841219+0000","last_change":"2024-04-25T02:09:58.219170+0000","last_active":"2024-04-25T02:10:52.841219+0000","last_peered":"2024-04-25T02:10:52.841219+0000","last_clean":"2024-04-25T02:10:52.841219+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:10:52.841219+0000","last_undegraded":"2024-04-25T02:10:52.841219+0000","last_fullsized":"2024-04-25T02:10:52.841219+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:09:57.204513+0000","last_clean_scrub_stamp":"2024-04-25T02:09:57.204513+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'72","reported_seq":85,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.339279+0000","last_change":"2024-04-25T02:10:02.370537+0000","last_active":"2024-04-25T02:18:48.339279+0000","last_peered":"2024-04-25T02:18:48.339279+0000","last_clean":"2024-04-25T02:18:48.339279+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:18:48.339279+0000","last_undegraded":"2024-04-25T02:18:48.339279+0000","last_fullsized":"2024-04-25T02:18:48.339279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":72,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'336","reported_seq":348,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277539+0000","last_change":"2024-04-25T02:10:02.748709+0000","last_active":"2024-04-25T02:18:51.277539+0000","last_peered":"2024-04-25T02:18:51.277539+0000","last_clean":"2024-04-25T02:18:51.277539+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:18:51.277539+0000","last_undegraded":"2024-04-25T02:18:51.277539+0000","last_fullsized":"2024-04-25T02:18:51.277539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":336,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'30","reported_seq":43,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.535566+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:18:38.535566+0000","last_peered":"2024-04-25T02:18:38.535566+0000","last_clean":"2024-04-25T02:18:38.535566+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:18:38.535566+0000","last_undegraded":"2024-04-25T02:18:38.535566+0000","last_fullsized":"2024-04-25T02:18:38.535566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281228+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:18:51.281228+0000","last_peered":"2024-04-25T02:18:51.281228+0000","last_clean":"2024-04-25T02:18:51.281228+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:18:51.281228+0000","last_undegraded":"2024-04-25T02:18:51.281228+0000","last_fullsized":"2024-04-25T02:18:51.281228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'46","reported_seq":59,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.361965+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:18:39.361965+0000","last_peered":"2024-04-25T02:18:39.361965+0000","last_clean":"2024-04-25T02:18:39.361965+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:18:39.361965+0000","last_undegraded":"2024-04-25T02:18:39.361965+0000","last_fullsized":"2024-04-25T02:18:39.361965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277504+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:18:51.277504+0000","last_peered":"2024-04-25T02:18:51.277504+0000","last_clean":"2024-04-25T02:18:51.277504+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:18:51.277504+0000","last_undegraded":"2024-04-25T02:18:51.277504+0000","last_fullsized":"2024-04-25T02:18:51.277504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":2199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'244","reported_seq":257,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.342289+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:18:48.342289+0000","last_peered":"2024-04-25T02:18:48.342289+0000","last_clean":"2024-04-25T02:18:48.342289+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:18:48.342289+0000","last_undegraded":"2024-04-25T02:18:48.342289+0000","last_fullsized":"2024-04-25T02:18:48.342289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":244,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277080+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:18:51.277080+0000","last_peered":"2024-04-25T02:18:51.277080+0000","last_clean":"2024-04-25T02:18:51.277080+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:18:51.277080+0000","last_undegraded":"2024-04-25T02:18:51.277080+0000","last_fullsized":"2024-04-25T02:18:51.277080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'110","reported_seq":123,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.799634+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:18:45.799634+0000","last_peered":"2024-04-25T02:18:45.799634+0000","last_clean":"2024-04-25T02:18:45.799634+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:18:45.799634+0000","last_undegraded":"2024-04-25T02:18:45.799634+0000","last_fullsized":"2024-04-25T02:18:45.799634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":110,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'370","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280559+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:18:51.280559+0000","last_peered":"2024-04-25T02:18:51.280559+0000","last_clean":"2024-04-25T02:18:51.280559+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:18:51.280559+0000","last_undegraded":"2024-04-25T02:18:51.280559+0000","last_fullsized":"2024-04-25T02:18:51.280559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":370,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'55","reported_seq":68,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:41.302148+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:18:41.302148+0000","last_peered":"2024-04-25T02:18:41.302148+0000","last_clean":"2024-04-25T02:18:41.302148+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:18:41.302148+0000","last_undegraded":"2024-04-25T02:18:41.302148+0000","last_fullsized":"2024-04-25T02:18:41.302148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":55,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'414","reported_seq":426,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280055+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:18:51.280055+0000","last_peered":"2024-04-25T02:18:51.280055+0000","last_clean":"2024-04-25T02:18:51.280055+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:18:51.280055+0000","last_undegraded":"2024-04-25T02:18:51.280055+0000","last_fullsized":"2024-04-25T02:18:51.280055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":414,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'413","reported_seq":425,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281808+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:18:51.281808+0000","last_peered":"2024-04-25T02:18:51.281808+0000","last_clean":"2024-04-25T02:18:51.281808+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:18:51.281808+0000","last_undegraded":"2024-04-25T02:18:51.281808+0000","last_fullsized":"2024-04-25T02:18:51.281808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":413,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":2919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276676+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:18:51.276676+0000","last_peered":"2024-04-25T02:18:51.276676+0000","last_clean":"2024-04-25T02:18:51.276676+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:18:51.276676+0000","last_undegraded":"2024-04-25T02:18:51.276676+0000","last_fullsized":"2024-04-25T02:18:51.276676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":3172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'394","reported_seq":406,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.251643+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:18:51.251643+0000","last_peered":"2024-04-25T02:18:51.251643+0000","last_clean":"2024-04-25T02:18:51.251643+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:18:51.251643+0000","last_undegraded":"2024-04-25T02:18:51.251643+0000","last_fullsized":"2024-04-25T02:18:51.251643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":394,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.259897+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:18:51.259897+0000","last_peered":"2024-04-25T02:18:51.259897+0000","last_clean":"2024-04-25T02:18:51.259897+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:18:51.259897+0000","last_undegraded":"2024-04-25T02:18:51.259897+0000","last_fullsized":"2024-04-25T02:18:51.259897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281654+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:18:51.281654+0000","last_peered":"2024-04-25T02:18:51.281654+0000","last_clean":"2024-04-25T02:18:51.281654+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:18:51.281654+0000","last_undegraded":"2024-04-25T02:18:51.281654+0000","last_fullsized":"2024-04-25T02:18:51.281654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":167505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23216,"ondisk_log_size":23216,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":3994,"num_write_kb":199381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316645376,"data_stored":316588690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3886,"ondisk_log_size":3886,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705776,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370056,"kb_used_data":72832,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94001784,"statfs":{"total":96636764160,"available":96257826816,"internally_reserved":0,"allocated":74579968,"data_stored":74464209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.22600000000000001,"15min":0.26800000000000002},"min":{"1min":0.16700000000000001,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.36199999999999999,"5min":0.437,"15min":0.44},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.248,"15min":0.29499999999999998},"min":{"1min":0.17999999999999999,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.40899999999999997,"5min":0.50900000000000001,"15min":0.53400000000000003},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.255,"5min":0.26400000000000001,"15min":0.30199999999999999},"min":{"1min":0.191,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39100000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.252,"5min":0.25800000000000001,"15min":0.30199999999999999},"min":{"1min":0.21099999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.373,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.441}]},{"osd":3,"last update":"Thu Apr 25 02:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.28399999999999997,"15min":0.32700000000000001},"min":{"1min":0.219,"5min":0.192,"15min":0.192},"max":{"1min":0.36799999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.28100000000000003,"15min":0.32500000000000001},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":0.39900000000000002,"5min":0.628,"15min":0.628},"last":0.47899999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705775,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405844,"kb_used_data":100428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93965996,"statfs":{"total":96636764160,"available":96221179904,"internally_reserved":0,"allocated":102838272,"data_stored":102710905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.22600000000000001,"5min":0.23599999999999999,"15min":0.28899999999999998},"min":{"1min":0.17000000000000001,"5min":0.13200000000000001,"15min":0.13200000000000001},"max":{"1min":0.308,"5min":0.43099999999999999,"15min":0.49299999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.25,"15min":0.29699999999999999},"min":{"1min":0.17399999999999999,"5min":0.155,"15min":0.155},"max":{"1min":0.36599999999999999,"5min":0.44900000000000001,"15min":0.46700000000000003},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26700000000000002,"15min":0.318},"min":{"1min":0.20499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.316,"5min":0.47099999999999997,"15min":0.48299999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.27000000000000002,"15min":0.316},"min":{"1min":0.20599999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.45200000000000001,"5min":0.46500000000000002,"15min":0.53400000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:18:17 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.27700000000000002,"15min":0.33000000000000002},"min":{"1min":0.219,"5min":0.186,"15min":0.186},"max":{"1min":0.41999999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.255,"5min":0.28399999999999997,"15min":0.32900000000000001},"min":{"1min":0.222,"5min":0.193,"15min":0.193},"max":{"1min":0.41199999999999998,"5min":0.49099999999999999,"15min":0.51900000000000002},"last":0.496}]}]},{"osd":0,"up_from":9,"seq":38654705775,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364024,"kb_used_data":66800,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94007816,"statfs":{"total":96636764160,"available":96264003584,"internally_reserved":0,"allocated":68403200,"data_stored":68279904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.222,"15min":0.28899999999999998},"min":{"1min":0.156,"5min":0.156,"15min":0.14399999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.54900000000000004},"last":0.309},{"interface":"front","average":{"1min":0.246,"5min":0.246,"15min":0.29999999999999999},"min":{"1min":0.17000000000000001,"5min":0.16700000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.48799999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.253,"15min":0.316},"min":{"1min":0.19400000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.42399999999999999,"5min":0.42599999999999999,"15min":0.53400000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.317},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.47799999999999998,"5min":0.49399999999999999,"15min":0.52200000000000002},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.27300000000000002,"15min":0.33400000000000002},"min":{"1min":0.215,"5min":0.182,"15min":0.182},"max":{"1min":0.42999999999999999,"5min":0.49299999999999999,"15min":0.56899999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.309,"5min":0.27400000000000002,"15min":0.32700000000000001},"min":{"1min":0.23200000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705776,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371124,"kb_used_data":69804,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94000716,"statfs":{"total":96636764160,"available":96256733184,"internally_reserved":0,"allocated":71479296,"data_stored":71360528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.218,"15min":0.27300000000000002},"min":{"1min":0.161,"5min":0.154,"15min":0.154},"max":{"1min":0.30099999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23699999999999999,"15min":0.28799999999999998},"min":{"1min":0.16900000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.34799999999999998,"5min":0.46700000000000003,"15min":0.5},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.255,"15min":0.312},"min":{"1min":0.19400000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.318,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.27500000000000002,"15min":0.33300000000000002},"min":{"1min":0.222,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.313,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.502}]},{"osd":3,"last update":"Thu Apr 25 02:18:13 2024","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.26000000000000001,"15min":0.308},"min":{"1min":0.20899999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.32500000000000001,"5min":0.46000000000000002,"15min":0.48399999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.377,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68239360,"data_stored":68223190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74416128,"data_stored":74407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102674432,"data_stored":102654191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:19:02.305 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.305 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.305 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.305 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.306 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.306 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.306 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.306 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.306 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.306 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.306 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.306 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.307 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.307 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.307 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.307 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.307 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.307 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.307 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.308 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.309 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.309 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.309 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.309 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.309 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.309 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.309 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.310 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.310 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.310 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.310 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.310 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.310 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.310 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.310 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.311 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.311 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.311 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.311 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.311 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.311 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.311 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.311 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.311 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.312 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.312 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.312 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.312 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.312 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.312 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.313 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.313 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.313 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.313 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.313 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.313 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.313 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T02:09:57.204513+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=9, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.313 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.313 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.314 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T02:09:57.204513+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=9, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.314 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.314 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.314 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T02:09:57.204513+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=9, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.314 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.314 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.314 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T02:09:57.204513+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=9, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.314 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T02:09:57.204513+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=9, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T02:09:57.204513+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=9, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T02:09:57.204513+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=9, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.315 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T02:09:57.204513+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=9, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.316 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.316 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T02:09:57.204513+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=9, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.316 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.316 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.316 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.316 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.316 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.316 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.317 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.317 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.317 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.317 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.317 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.317 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.317 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.317 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.317 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.318 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.318 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:02.318 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:19:22.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.448+0000 7fa921194700 1 Processor -- start 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.448+0000 7fa921194700 1 -- start start 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa921194700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c124000 0x7fa91c0961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa921194700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c0937a0 0x7fa91c1243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa921194700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91c096cf0 con 0x7fa91c1274e0 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa921194700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c093ba0 con 0x7fa91c124000 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa921194700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c092d00 con 0x7fa91c0937a0 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91ad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c124000 0x7fa91c0961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91b59e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa91c1274e0 0x7fa91c127960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:51658/0 (socket says 172.21.15.78:51658) 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91a59c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c0937a0 0x7fa91c1243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91b59e700 1 -- 172.21.15.78:0/2579054162 learned_addr learned my addr 172.21.15.78:0/2579054162 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91a59c700 1 -- 172.21.15.78:0/2579054162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c124000 msgr2=0x7fa91c0961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91a59c700 1 --2- 172.21.15.78:0/2579054162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c124000 0x7fa91c0961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa919d9b700 1 -- 172.21.15.78:0/2579054162 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824774611 0 0) 0x7fa91c096cf0 con 0x7fa91c1274e0 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91a59c700 1 -- 172.21.15.78:0/2579054162 >> v1:172.21.15.78:6789/0 conn(0x7fa91c1274e0 legacy=0x7fa91c127960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91a59c700 1 -- 172.21.15.78:0/2579054162 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c0933a0 con 0x7fa91c0937a0 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91ad9d700 1 --2- 172.21.15.78:0/2579054162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c124000 0x7fa91c0961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa91a59c700 1 --2- 172.21.15.78:0/2579054162 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c0937a0 0x7fa91c1243e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa90c009790 tx=0x7fa90c009060).ready entity=mon.2 client_cookie=cbf1d87fb5b5350a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa919d9b700 1 -- 172.21.15.78:0/2579054162 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0090d0 con 0x7fa91c0937a0 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa919d9b700 1 -- 172.21.15.78:0/2579054162 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c00f510 con 0x7fa91c0937a0 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.449+0000 7fa919d9b700 1 -- 172.21.15.78:0/2579054162 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c00f890 con 0x7fa91c0937a0 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.450+0000 7fa921194700 1 -- 172.21.15.78:0/2579054162 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c0937a0 msgr2=0x7fa91c1243e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.450+0000 7fa921194700 1 --2- 172.21.15.78:0/2579054162 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c0937a0 0x7fa91c1243e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa90c009790 tx=0x7fa90c009060).stop 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.450+0000 7fa921194700 1 -- 172.21.15.78:0/2579054162 shutdown_connections 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.450+0000 7fa921194700 1 --2- 172.21.15.78:0/2579054162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c124000 0x7fa91c0961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.450+0000 7fa921194700 1 --2- 172.21.15.78:0/2579054162 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c0937a0 0x7fa91c1243e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.450+0000 7fa921194700 1 -- 172.21.15.78:0/2579054162 >> 172.21.15.78:0/2579054162 conn(0x7fa91c097450 msgr2=0x7fa91c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.450+0000 7fa921194700 1 -- 172.21.15.78:0/2579054162 shutdown_connections 2024-04-25T02:19:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.450+0000 7fa921194700 1 -- 172.21.15.78:0/2579054162 wait complete. 2024-04-25T02:19:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.451+0000 7fa921194700 1 Processor -- start 2024-04-25T02:19:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.451+0000 7fa921194700 1 -- start start 2024-04-25T02:19:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.451+0000 7fa921194700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa91c0937a0 0x7fa91c069d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa921194700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c124000 0x7fa91c128870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa921194700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c1274e0 0x7fa91c128d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa921194700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c092440 con 0x7fa91c0937a0 2024-04-25T02:19:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa921194700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c12b300 con 0x7fa91c1274e0 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa921194700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c12b5c0 con 0x7fa91c124000 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa91c0937a0 0x7fa91c069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91b59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c1274e0 0x7fa91c128d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91b59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c1274e0 0x7fa91c128d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:43826/0 (socket says 172.21.15.78:43826) 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91ad9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa91c0937a0 0x7fa91c069d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44302/0 (socket says 172.21.15.78:44302) 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91b59e700 1 -- 172.21.15.78:0/72130921 learned_addr learned my addr 172.21.15.78:0/72130921 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91a59c700 1 --2- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c124000 0x7fa91c128870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91b59e700 1 -- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c124000 msgr2=0x7fa91c128870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91b59e700 1 --2- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c124000 0x7fa91c128870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91b59e700 1 -- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa91c0937a0 msgr2=0x7fa91c069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91b59e700 1 --2- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa91c0937a0 0x7fa91c069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91b59e700 1 -- 172.21.15.78:0/72130921 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9100092a0 con 0x7fa91c1274e0 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91ad9d700 1 --2- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa91c0937a0 0x7fa91c069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa91b59e700 1 --2- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c1274e0 0x7fa91c128d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa91400c7e0 tx=0x7fa914007f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa9037fe700 1 -- 172.21.15.78:0/72130921 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914005d30 con 0x7fa91c1274e0 2024-04-25T02:19:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa9037fe700 1 -- 172.21.15.78:0/72130921 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa914005e90 con 0x7fa91c1274e0 2024-04-25T02:19:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c0092a0 con 0x7fa91c1274e0 2024-04-25T02:19:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa9037fe700 1 -- 172.21.15.78:0/72130921 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914007360 con 0x7fa91c1274e0 2024-04-25T02:19:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.452+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c129a00 con 0x7fa91c1274e0 2024-04-25T02:19:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.453+0000 7fa9037fe700 1 -- 172.21.15.78:0/72130921 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fa914007750 con 0x7fa91c1274e0 2024-04-25T02:19:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.453+0000 7fa9037fe700 1 -- 172.21.15.78:0/72130921 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fa91403b170 con 0x7fa91c1274e0 2024-04-25T02:19:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.453+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c091b30 con 0x7fa91c1274e0 2024-04-25T02:19:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.458+0000 7fa9037fe700 1 -- 172.21.15.78:0/72130921 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fa91401a710 con 0x7fa91c1274e0 2024-04-25T02:19:22.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.617+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa91c046ce0 con 0x7fa90802bd30 2024-04-25T02:19:22.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.624+0000 7fa9037fe700 1 -- 172.21.15.78:0/72130921 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256578 (unknown 2965378022 0 2306652140) 0x7fa91c046ce0 con 0x7fa90802bd30 2024-04-25T02:19:22.632 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:19:22.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 >> v1:172.21.15.78:6816/46507 conn(0x7fa90802bd30 legacy=0x7fa90802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:22.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c1274e0 msgr2=0x7fa91c128d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:22.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 --2- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c1274e0 0x7fa91c128d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa91400c7e0 tx=0x7fa914007f90).stop 2024-04-25T02:19:22.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 shutdown_connections 2024-04-25T02:19:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 --2- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa91c1274e0 0x7fa91c128d60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 --2- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa91c0937a0 0x7fa91c069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 --2- 172.21.15.78:0/72130921 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa91c124000 0x7fa91c128870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 >> 172.21.15.78:0/72130921 conn(0x7fa91c097450 msgr2=0x7fa91c12fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 shutdown_connections 2024-04-25T02:19:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:22.627+0000 7fa921194700 1 -- 172.21.15.78:0/72130921 wait complete. 2024-04-25T02:19:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:19:22.642 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-04-25T02:19:22.309653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":27629,"num_write_kb":366886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27128,"ondisk_log_size":27128,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1511048,"kb_used_data":309864,"kb_used_omap":0,"kb_used_meta":1201152,"kb_avail":375976312,"statfs":{"total":386547056640,"available":384999743488,"internally_reserved":0,"allocated":317300736,"data_stored":316815546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1229979648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002970"},"pg_stats":[{"pgid":"4.3f","version":"19'354","reported_seq":366,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275043+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:18:51.275043+0000","last_peered":"2024-04-25T02:18:51.275043+0000","last_clean":"2024-04-25T02:18:51.275043+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:18:51.275043+0000","last_undegraded":"2024-04-25T02:18:51.275043+0000","last_fullsized":"2024-04-25T02:18:51.275043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277671+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:18:51.277671+0000","last_peered":"2024-04-25T02:18:51.277671+0000","last_clean":"2024-04-25T02:18:51.277671+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:18:51.277671+0000","last_undegraded":"2024-04-25T02:18:51.277671+0000","last_fullsized":"2024-04-25T02:18:51.277671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267056+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:18:51.267056+0000","last_peered":"2024-04-25T02:18:51.267056+0000","last_clean":"2024-04-25T02:18:51.267056+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:18:51.267056+0000","last_undegraded":"2024-04-25T02:18:51.267056+0000","last_fullsized":"2024-04-25T02:18:51.267056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267040+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:18:51.267040+0000","last_peered":"2024-04-25T02:18:51.267040+0000","last_clean":"2024-04-25T02:18:51.267040+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:18:51.267040+0000","last_undegraded":"2024-04-25T02:18:51.267040+0000","last_fullsized":"2024-04-25T02:18:51.267040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269216+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:18:51.269216+0000","last_peered":"2024-04-25T02:18:51.269216+0000","last_clean":"2024-04-25T02:18:51.269216+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:18:51.269216+0000","last_undegraded":"2024-04-25T02:18:51.269216+0000","last_fullsized":"2024-04-25T02:18:51.269216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278782+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:18:51.278782+0000","last_peered":"2024-04-25T02:18:51.278782+0000","last_clean":"2024-04-25T02:18:51.278782+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:18:51.278782+0000","last_undegraded":"2024-04-25T02:18:51.278782+0000","last_fullsized":"2024-04-25T02:18:51.278782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'376","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272984+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:18:51.272984+0000","last_peered":"2024-04-25T02:18:51.272984+0000","last_clean":"2024-04-25T02:18:51.272984+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:18:51.272984+0000","last_undegraded":"2024-04-25T02:18:51.272984+0000","last_fullsized":"2024-04-25T02:18:51.272984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":376,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":3216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'297","reported_seq":309,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272124+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:18:51.272124+0000","last_peered":"2024-04-25T02:18:51.272124+0000","last_clean":"2024-04-25T02:18:51.272124+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:18:51.272124+0000","last_undegraded":"2024-04-25T02:18:51.272124+0000","last_fullsized":"2024-04-25T02:18:51.272124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":297,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":2172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269598+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:18:51.269598+0000","last_peered":"2024-04-25T02:18:51.269598+0000","last_clean":"2024-04-25T02:18:51.269598+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:18:51.269598+0000","last_undegraded":"2024-04-25T02:18:51.269598+0000","last_fullsized":"2024-04-25T02:18:51.269598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'351","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267201+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:18:51.267201+0000","last_peered":"2024-04-25T02:18:51.267201+0000","last_clean":"2024-04-25T02:18:51.267201+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:18:51.267201+0000","last_undegraded":"2024-04-25T02:18:51.267201+0000","last_fullsized":"2024-04-25T02:18:51.267201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.256733+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:18:51.256733+0000","last_peered":"2024-04-25T02:18:51.256733+0000","last_clean":"2024-04-25T02:18:51.256733+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:18:51.256733+0000","last_undegraded":"2024-04-25T02:18:51.256733+0000","last_fullsized":"2024-04-25T02:18:51.256733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":2530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'322","reported_seq":334,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277216+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:18:51.277216+0000","last_peered":"2024-04-25T02:18:51.277216+0000","last_clean":"2024-04-25T02:18:51.277216+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:18:51.277216+0000","last_undegraded":"2024-04-25T02:18:51.277216+0000","last_fullsized":"2024-04-25T02:18:51.277216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":322,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'359","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277681+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:18:51.277681+0000","last_peered":"2024-04-25T02:18:51.277681+0000","last_clean":"2024-04-25T02:18:51.277681+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:18:51.277681+0000","last_undegraded":"2024-04-25T02:18:51.277681+0000","last_fullsized":"2024-04-25T02:18:51.277681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":359,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":2645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278233+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:18:51.278233+0000","last_peered":"2024-04-25T02:18:51.278233+0000","last_clean":"2024-04-25T02:18:51.278233+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:18:51.278233+0000","last_undegraded":"2024-04-25T02:18:51.278233+0000","last_fullsized":"2024-04-25T02:18:51.278233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253088+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:18:51.253088+0000","last_peered":"2024-04-25T02:18:51.253088+0000","last_clean":"2024-04-25T02:18:51.253088+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:18:51.253088+0000","last_undegraded":"2024-04-25T02:18:51.253088+0000","last_fullsized":"2024-04-25T02:18:51.253088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'380","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271052+0000","last_change":"2024-04-25T02:10:53.852512+0000","last_active":"2024-04-25T02:18:51.271052+0000","last_peered":"2024-04-25T02:18:51.271052+0000","last_clean":"2024-04-25T02:18:51.271052+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:18:51.271052+0000","last_undegraded":"2024-04-25T02:18:51.271052+0000","last_fullsized":"2024-04-25T02:18:51.271052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":380,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.264403+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:18:51.264403+0000","last_peered":"2024-04-25T02:18:51.264403+0000","last_clean":"2024-04-25T02:18:51.264403+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:18:51.264403+0000","last_undegraded":"2024-04-25T02:18:51.264403+0000","last_fullsized":"2024-04-25T02:18:51.264403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'340","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253849+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:18:51.253849+0000","last_peered":"2024-04-25T02:18:51.253849+0000","last_clean":"2024-04-25T02:18:51.253849+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:18:51.253849+0000","last_undegraded":"2024-04-25T02:18:51.253849+0000","last_fullsized":"2024-04-25T02:18:51.253849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'356","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276313+0000","last_change":"2024-04-25T02:10:02.748736+0000","last_active":"2024-04-25T02:18:51.276313+0000","last_peered":"2024-04-25T02:18:51.276313+0000","last_clean":"2024-04-25T02:18:51.276313+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:18:51.276313+0000","last_undegraded":"2024-04-25T02:18:51.276313+0000","last_fullsized":"2024-04-25T02:18:51.276313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269721+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:18:51.269721+0000","last_peered":"2024-04-25T02:18:51.269721+0000","last_clean":"2024-04-25T02:18:51.269721+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:18:51.269721+0000","last_undegraded":"2024-04-25T02:18:51.269721+0000","last_fullsized":"2024-04-25T02:18:51.269721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'344","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273747+0000","last_change":"2024-04-25T02:10:53.852792+0000","last_active":"2024-04-25T02:18:51.273747+0000","last_peered":"2024-04-25T02:18:51.273747+0000","last_clean":"2024-04-25T02:18:51.273747+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:18:51.273747+0000","last_undegraded":"2024-04-25T02:18:51.273747+0000","last_fullsized":"2024-04-25T02:18:51.273747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'383","reported_seq":395,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267045+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:18:51.267045+0000","last_peered":"2024-04-25T02:18:51.267045+0000","last_clean":"2024-04-25T02:18:51.267045+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:18:51.267045+0000","last_undegraded":"2024-04-25T02:18:51.267045+0000","last_fullsized":"2024-04-25T02:18:51.267045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":2481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'350","reported_seq":362,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273435+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:18:51.273435+0000","last_peered":"2024-04-25T02:18:51.273435+0000","last_clean":"2024-04-25T02:18:51.273435+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:18:51.273435+0000","last_undegraded":"2024-04-25T02:18:51.273435+0000","last_fullsized":"2024-04-25T02:18:51.273435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":350,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271458+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:18:51.271458+0000","last_peered":"2024-04-25T02:18:51.271458+0000","last_clean":"2024-04-25T02:18:51.271458+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:18:51.271458+0000","last_undegraded":"2024-04-25T02:18:51.271458+0000","last_fullsized":"2024-04-25T02:18:51.271458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'386","reported_seq":398,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.250133+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:18:51.250133+0000","last_peered":"2024-04-25T02:18:51.250133+0000","last_clean":"2024-04-25T02:18:51.250133+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:18:51.250133+0000","last_undegraded":"2024-04-25T02:18:51.250133+0000","last_fullsized":"2024-04-25T02:18:51.250133+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281870+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:18:51.281870+0000","last_peered":"2024-04-25T02:18:51.281870+0000","last_clean":"2024-04-25T02:18:51.281870+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:18:51.281870+0000","last_undegraded":"2024-04-25T02:18:51.281870+0000","last_fullsized":"2024-04-25T02:18:51.281870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":421,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268411+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:18:51.268411+0000","last_peered":"2024-04-25T02:18:51.268411+0000","last_clean":"2024-04-25T02:18:51.268411+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:18:51.268411+0000","last_undegraded":"2024-04-25T02:18:51.268411+0000","last_fullsized":"2024-04-25T02:18:51.268411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'154","reported_seq":167,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.381581+0000","last_change":"2024-04-25T02:10:02.357756+0000","last_active":"2024-04-25T02:18:45.381581+0000","last_peered":"2024-04-25T02:18:45.381581+0000","last_clean":"2024-04-25T02:18:45.381581+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:18:45.381581+0000","last_undegraded":"2024-04-25T02:18:45.381581+0000","last_fullsized":"2024-04-25T02:18:45.381581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":154,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":16455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'334","reported_seq":346,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272426+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:18:51.272426+0000","last_peered":"2024-04-25T02:18:51.272426+0000","last_clean":"2024-04-25T02:18:51.272426+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:18:51.272426+0000","last_undegraded":"2024-04-25T02:18:51.272426+0000","last_fullsized":"2024-04-25T02:18:51.272426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":334,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'77","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.512649+0000","last_change":"2024-04-25T02:19:19.512649+0000","last_active":"2024-04-25T02:19:19.512649+0000","last_peered":"2024-04-25T02:19:19.512649+0000","last_clean":"2024-04-25T02:19:19.512649+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:19:19.512649+0000","last_undegraded":"2024-04-25T02:19:19.512649+0000","last_fullsized":"2024-04-25T02:19:19.512649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'77","last_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_deep_scrub":"19'77","last_deep_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.512541+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'347","reported_seq":359,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263176+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:18:51.263176+0000","last_peered":"2024-04-25T02:18:51.263176+0000","last_clean":"2024-04-25T02:18:51.263176+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:18:51.263176+0000","last_undegraded":"2024-04-25T02:18:51.263176+0000","last_fullsized":"2024-04-25T02:18:51.263176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":347,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'243","reported_seq":256,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:31.210530+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:18:31.210530+0000","last_peered":"2024-04-25T02:18:31.210530+0000","last_clean":"2024-04-25T02:18:31.210530+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:18:31.210530+0000","last_undegraded":"2024-04-25T02:18:31.210530+0000","last_fullsized":"2024-04-25T02:18:31.210530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270570+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:18:51.270570+0000","last_peered":"2024-04-25T02:18:51.270570+0000","last_clean":"2024-04-25T02:18:51.270570+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:18:51.270570+0000","last_undegraded":"2024-04-25T02:18:51.270570+0000","last_fullsized":"2024-04-25T02:18:51.270570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'6","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.386829+0000","last_change":"2024-04-25T02:10:02.370804+0000","last_active":"2024-04-25T02:18:39.386829+0000","last_peered":"2024-04-25T02:18:39.386829+0000","last_clean":"2024-04-25T02:18:39.386829+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:18:39.386829+0000","last_undegraded":"2024-04-25T02:18:39.386829+0000","last_fullsized":"2024-04-25T02:18:39.386829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'377","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273185+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:18:51.273185+0000","last_peered":"2024-04-25T02:18:51.273185+0000","last_clean":"2024-04-25T02:18:51.273185+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:18:51.273185+0000","last_undegraded":"2024-04-25T02:18:51.273185+0000","last_fullsized":"2024-04-25T02:18:51.273185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":377,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":2757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'81","reported_seq":99,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:15.705733+0000","last_change":"2024-04-25T02:19:15.705733+0000","last_active":"2024-04-25T02:19:15.705733+0000","last_peered":"2024-04-25T02:19:15.705733+0000","last_clean":"2024-04-25T02:19:15.705733+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:19:15.705733+0000","last_undegraded":"2024-04-25T02:19:15.705733+0000","last_fullsized":"2024-04-25T02:19:15.705733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'81","last_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_deep_scrub":"19'81","last_deep_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_clean_scrub_stamp":"2024-04-25T02:19:15.705635+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6184361,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'412","reported_seq":424,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273256+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:18:51.273256+0000","last_peered":"2024-04-25T02:18:51.273256+0000","last_clean":"2024-04-25T02:18:51.273256+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:18:51.273256+0000","last_undegraded":"2024-04-25T02:18:51.273256+0000","last_fullsized":"2024-04-25T02:18:51.273256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":412,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'361","reported_seq":374,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.493452+0000","last_change":"2024-04-25T02:10:02.371773+0000","last_active":"2024-04-25T02:18:48.493452+0000","last_peered":"2024-04-25T02:18:48.493452+0000","last_clean":"2024-04-25T02:18:48.493452+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:18:48.493452+0000","last_undegraded":"2024-04-25T02:18:48.493452+0000","last_fullsized":"2024-04-25T02:18:48.493452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":361,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270896+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:18:51.270896+0000","last_peered":"2024-04-25T02:18:51.270896+0000","last_clean":"2024-04-25T02:18:51.270896+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:18:51.270896+0000","last_undegraded":"2024-04-25T02:18:51.270896+0000","last_fullsized":"2024-04-25T02:18:51.270896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'305","reported_seq":318,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:47.440007+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:18:47.440007+0000","last_peered":"2024-04-25T02:18:47.440007+0000","last_clean":"2024-04-25T02:18:47.440007+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:18:47.440007+0000","last_undegraded":"2024-04-25T02:18:47.440007+0000","last_fullsized":"2024-04-25T02:18:47.440007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":305,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8389252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":12434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'364","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276850+0000","last_change":"2024-04-25T02:10:53.855075+0000","last_active":"2024-04-25T02:18:51.276850+0000","last_peered":"2024-04-25T02:18:51.276850+0000","last_clean":"2024-04-25T02:18:51.276850+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:18:51.276850+0000","last_undegraded":"2024-04-25T02:18:51.276850+0000","last_fullsized":"2024-04-25T02:18:51.276850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'126","reported_seq":139,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.464847+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:18:28.464847+0000","last_peered":"2024-04-25T02:18:28.464847+0000","last_clean":"2024-04-25T02:18:28.464847+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:18:28.464847+0000","last_undegraded":"2024-04-25T02:18:28.464847+0000","last_fullsized":"2024-04-25T02:18:28.464847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":126,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'333","reported_seq":342,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281255+0000","last_change":"2024-04-25T02:10:53.850733+0000","last_active":"2024-04-25T02:18:51.281255+0000","last_peered":"2024-04-25T02:18:51.281255+0000","last_clean":"2024-04-25T02:18:51.281255+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:18:51.281255+0000","last_undegraded":"2024-04-25T02:18:51.281255+0000","last_fullsized":"2024-04-25T02:18:51.281255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.296955+0000","last_change":"2024-04-25T02:19:21.296955+0000","last_active":"2024-04-25T02:19:21.296955+0000","last_peered":"2024-04-25T02:19:21.296955+0000","last_clean":"2024-04-25T02:19:21.296955+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:19:21.296955+0000","last_undegraded":"2024-04-25T02:19:21.296955+0000","last_fullsized":"2024-04-25T02:19:21.296955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.296829+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'353","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268219+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:18:51.268219+0000","last_peered":"2024-04-25T02:18:51.268219+0000","last_clean":"2024-04-25T02:18:51.268219+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:18:51.268219+0000","last_undegraded":"2024-04-25T02:18:51.268219+0000","last_fullsized":"2024-04-25T02:18:51.268219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":353,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'3","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.466944+0000","last_change":"2024-04-25T02:10:02.359209+0000","last_active":"2024-04-25T02:18:28.466944+0000","last_peered":"2024-04-25T02:18:28.466944+0000","last_clean":"2024-04-25T02:18:28.466944+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:18:28.466944+0000","last_undegraded":"2024-04-25T02:18:28.466944+0000","last_fullsized":"2024-04-25T02:18:28.466944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'406","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253893+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:18:51.253893+0000","last_peered":"2024-04-25T02:18:51.253893+0000","last_clean":"2024-04-25T02:18:51.253893+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:18:51.253893+0000","last_undegraded":"2024-04-25T02:18:51.253893+0000","last_fullsized":"2024-04-25T02:18:51.253893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":2547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'140","reported_seq":158,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.491862+0000","last_change":"2024-04-25T02:19:11.491862+0000","last_active":"2024-04-25T02:19:11.491862+0000","last_peered":"2024-04-25T02:19:11.491862+0000","last_clean":"2024-04-25T02:19:11.491862+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:19:11.491862+0000","last_undegraded":"2024-04-25T02:19:11.491862+0000","last_fullsized":"2024-04-25T02:19:11.491862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'140","last_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_deep_scrub":"19'140","last_deep_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.491759+0000","log_size":140,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'351","reported_seq":360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279851+0000","last_change":"2024-04-25T02:10:53.853097+0000","last_active":"2024-04-25T02:18:51.279851+0000","last_peered":"2024-04-25T02:18:51.279851+0000","last_clean":"2024-04-25T02:18:51.279851+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:18:51.279851+0000","last_undegraded":"2024-04-25T02:18:51.279851+0000","last_fullsized":"2024-04-25T02:18:51.279851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'48","reported_seq":66,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.281870+0000","last_change":"2024-04-25T02:19:19.281870+0000","last_active":"2024-04-25T02:19:19.281870+0000","last_peered":"2024-04-25T02:19:19.281870+0000","last_clean":"2024-04-25T02:19:19.281870+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:19:19.281870+0000","last_undegraded":"2024-04-25T02:19:19.281870+0000","last_fullsized":"2024-04-25T02:19:19.281870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'48","last_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_deep_scrub":"19'48","last_deep_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.281770+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'375","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273633+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:18:51.273633+0000","last_peered":"2024-04-25T02:18:51.273633+0000","last_clean":"2024-04-25T02:18:51.273633+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:18:51.273633+0000","last_undegraded":"2024-04-25T02:18:51.273633+0000","last_fullsized":"2024-04-25T02:18:51.273633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":375,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'109","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.663012+0000","last_change":"2024-04-25T02:19:13.663012+0000","last_active":"2024-04-25T02:19:13.663012+0000","last_peered":"2024-04-25T02:19:13.663012+0000","last_clean":"2024-04-25T02:19:13.663012+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:19:13.663012+0000","last_undegraded":"2024-04-25T02:19:13.663012+0000","last_fullsized":"2024-04-25T02:19:13.663012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'109","last_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_deep_scrub":"19'109","last_deep_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.662909+0000","log_size":109,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'396","reported_seq":408,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.225239+0000","last_change":"2024-04-25T02:10:02.742462+0000","last_active":"2024-04-25T02:18:51.225239+0000","last_peered":"2024-04-25T02:18:51.225239+0000","last_clean":"2024-04-25T02:18:51.225239+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:18:51.225239+0000","last_undegraded":"2024-04-25T02:18:51.225239+0000","last_fullsized":"2024-04-25T02:18:51.225239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":396,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'82","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:42.341444+0000","last_change":"2024-04-25T02:10:02.370148+0000","last_active":"2024-04-25T02:18:42.341444+0000","last_peered":"2024-04-25T02:18:42.341444+0000","last_clean":"2024-04-25T02:18:42.341444+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:18:42.341444+0000","last_undegraded":"2024-04-25T02:18:42.341444+0000","last_fullsized":"2024-04-25T02:18:42.341444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":82,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'356","reported_seq":373,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.666077+0000","last_change":"2024-04-25T02:19:19.666077+0000","last_active":"2024-04-25T02:19:19.666077+0000","last_peered":"2024-04-25T02:19:19.666077+0000","last_clean":"2024-04-25T02:19:19.666077+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:19:19.666077+0000","last_undegraded":"2024-04-25T02:19:19.666077+0000","last_fullsized":"2024-04-25T02:19:19.666077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'356","last_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_deep_scrub":"19'356","last_deep_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.665961+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'33","reported_seq":51,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.244079+0000","last_change":"2024-04-25T02:19:09.244079+0000","last_active":"2024-04-25T02:19:09.244079+0000","last_peered":"2024-04-25T02:19:09.244079+0000","last_clean":"2024-04-25T02:19:09.244079+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:19:09.244079+0000","last_undegraded":"2024-04-25T02:19:09.244079+0000","last_fullsized":"2024-04-25T02:19:09.244079+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'33","last_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_deep_scrub":"19'33","last_deep_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.243976+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'398","reported_seq":410,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267105+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:18:51.267105+0000","last_peered":"2024-04-25T02:18:51.267105+0000","last_clean":"2024-04-25T02:18:51.267105+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:18:51.267105+0000","last_undegraded":"2024-04-25T02:18:51.267105+0000","last_fullsized":"2024-04-25T02:18:51.267105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":398,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'114","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:40.356060+0000","last_change":"2024-04-25T02:10:02.372741+0000","last_active":"2024-04-25T02:18:40.356060+0000","last_peered":"2024-04-25T02:18:40.356060+0000","last_clean":"2024-04-25T02:18:40.356060+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:18:40.356060+0000","last_undegraded":"2024-04-25T02:18:40.356060+0000","last_fullsized":"2024-04-25T02:18:40.356060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":114,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":12332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'459","reported_seq":471,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.248908+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:18:51.248908+0000","last_peered":"2024-04-25T02:18:51.248908+0000","last_clean":"2024-04-25T02:18:51.248908+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:18:51.248908+0000","last_undegraded":"2024-04-25T02:18:51.248908+0000","last_fullsized":"2024-04-25T02:18:51.248908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":459,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'76","reported_seq":94,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.854739+0000","last_change":"2024-04-25T02:19:21.854739+0000","last_active":"2024-04-25T02:19:21.854739+0000","last_peered":"2024-04-25T02:19:21.854739+0000","last_clean":"2024-04-25T02:19:21.854739+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:19:21.854739+0000","last_undegraded":"2024-04-25T02:19:21.854739+0000","last_fullsized":"2024-04-25T02:19:21.854739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'76","last_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_deep_scrub":"19'76","last_deep_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.854641+0000","log_size":76,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'354","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.708606+0000","last_change":"2024-04-25T02:19:21.708606+0000","last_active":"2024-04-25T02:19:21.708606+0000","last_peered":"2024-04-25T02:19:21.708606+0000","last_clean":"2024-04-25T02:19:21.708606+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:19:21.708606+0000","last_undegraded":"2024-04-25T02:19:21.708606+0000","last_fullsized":"2024-04-25T02:19:21.708606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'354","last_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_deep_scrub":"19'354","last_deep_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.708495+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"19'32","reported_seq":50,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:17.789878+0000","last_change":"2024-04-25T02:19:17.789878+0000","last_active":"2024-04-25T02:19:17.789878+0000","last_peered":"2024-04-25T02:19:17.789878+0000","last_clean":"2024-04-25T02:19:17.789878+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:19:17.789878+0000","last_undegraded":"2024-04-25T02:19:17.789878+0000","last_fullsized":"2024-04-25T02:19:17.789878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'32","last_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_deep_scrub":"19'32","last_deep_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_clean_scrub_stamp":"2024-04-25T02:19:17.789779+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'332","reported_seq":344,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275215+0000","last_change":"2024-04-25T02:10:02.742778+0000","last_active":"2024-04-25T02:18:51.275215+0000","last_peered":"2024-04-25T02:18:51.275215+0000","last_clean":"2024-04-25T02:18:51.275215+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:18:51.275215+0000","last_undegraded":"2024-04-25T02:18:51.275215+0000","last_fullsized":"2024-04-25T02:18:51.275215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":332,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'113","reported_seq":131,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.807276+0000","last_change":"2024-04-25T02:19:16.807276+0000","last_active":"2024-04-25T02:19:16.807276+0000","last_peered":"2024-04-25T02:19:16.807276+0000","last_clean":"2024-04-25T02:19:16.807276+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:19:16.807276+0000","last_undegraded":"2024-04-25T02:19:16.807276+0000","last_fullsized":"2024-04-25T02:19:16.807276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'113","last_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_deep_scrub":"19'113","last_deep_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.807162+0000","log_size":113,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'328","reported_seq":340,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270459+0000","last_change":"2024-04-25T02:10:02.745696+0000","last_active":"2024-04-25T02:18:51.270459+0000","last_peered":"2024-04-25T02:18:51.270459+0000","last_clean":"2024-04-25T02:18:51.270459+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:18:51.270459+0000","last_undegraded":"2024-04-25T02:18:51.270459+0000","last_fullsized":"2024-04-25T02:18:51.270459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.467431+0000","last_change":"2024-04-25T02:19:02.467431+0000","last_active":"2024-04-25T02:19:02.467431+0000","last_peered":"2024-04-25T02:19:02.467431+0000","last_clean":"2024-04-25T02:19:02.467431+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:19:02.467431+0000","last_undegraded":"2024-04-25T02:19:02.467431+0000","last_fullsized":"2024-04-25T02:19:02.467431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.467334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'95","reported_seq":113,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.615993+0000","last_change":"2024-04-25T02:19:11.615993+0000","last_active":"2024-04-25T02:19:11.615993+0000","last_peered":"2024-04-25T02:19:11.615993+0000","last_clean":"2024-04-25T02:19:11.615993+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:19:11.615993+0000","last_undegraded":"2024-04-25T02:19:11.615993+0000","last_fullsized":"2024-04-25T02:19:11.615993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'95","last_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_deep_scrub":"19'95","last_deep_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.615813+0000","log_size":95,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270717+0000","last_change":"2024-04-25T02:10:02.744340+0000","last_active":"2024-04-25T02:18:51.270717+0000","last_peered":"2024-04-25T02:18:51.270717+0000","last_clean":"2024-04-25T02:18:51.270717+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:18:51.270717+0000","last_undegraded":"2024-04-25T02:18:51.270717+0000","last_fullsized":"2024-04-25T02:18:51.270717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:06.911064+0000","last_change":"2024-04-25T02:19:06.911064+0000","last_active":"2024-04-25T02:19:06.911064+0000","last_peered":"2024-04-25T02:19:06.911064+0000","last_clean":"2024-04-25T02:19:06.911064+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:19:06.911064+0000","last_undegraded":"2024-04-25T02:19:06.911064+0000","last_fullsized":"2024-04-25T02:19:06.911064+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_clean_scrub_stamp":"2024-04-25T02:19:06.910932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'16","reported_seq":34,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.302362+0000","last_change":"2024-04-25T02:19:05.302362+0000","last_active":"2024-04-25T02:19:05.302362+0000","last_peered":"2024-04-25T02:19:05.302362+0000","last_clean":"2024-04-25T02:19:05.302362+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:19:05.302362+0000","last_undegraded":"2024-04-25T02:19:05.302362+0000","last_fullsized":"2024-04-25T02:19:05.302362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'16","last_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_deep_scrub":"19'16","last_deep_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.302256+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'326","reported_seq":338,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.279087+0000","last_change":"2024-04-25T02:10:02.732995+0000","last_active":"2024-04-25T02:18:51.279087+0000","last_peered":"2024-04-25T02:18:51.279087+0000","last_clean":"2024-04-25T02:18:51.279087+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:18:51.279087+0000","last_undegraded":"2024-04-25T02:18:51.279087+0000","last_fullsized":"2024-04-25T02:18:51.279087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":326,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.564824+0000","last_change":"2024-04-25T02:19:01.564824+0000","last_active":"2024-04-25T02:19:01.564824+0000","last_peered":"2024-04-25T02:19:01.564824+0000","last_clean":"2024-04-25T02:19:01.564824+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:19:01.564824+0000","last_undegraded":"2024-04-25T02:19:01.564824+0000","last_fullsized":"2024-04-25T02:19:01.564824+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.564726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'243","reported_seq":261,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.526240+0000","last_change":"2024-04-25T02:19:08.526240+0000","last_active":"2024-04-25T02:19:08.526240+0000","last_peered":"2024-04-25T02:19:08.526240+0000","last_clean":"2024-04-25T02:19:08.526240+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:19:08.526240+0000","last_undegraded":"2024-04-25T02:19:08.526240+0000","last_fullsized":"2024-04-25T02:19:08.526240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'243","last_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_deep_scrub":"19'243","last_deep_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.526107+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":12388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'331","reported_seq":343,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.266717+0000","last_change":"2024-04-25T02:10:02.730019+0000","last_active":"2024-04-25T02:18:51.266717+0000","last_peered":"2024-04-25T02:18:51.266717+0000","last_clean":"2024-04-25T02:18:51.266717+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:18:51.266717+0000","last_undegraded":"2024-04-25T02:18:51.266717+0000","last_fullsized":"2024-04-25T02:18:51.266717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":331,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":2335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.862881+0000","last_change":"2024-04-25T02:19:07.862881+0000","last_active":"2024-04-25T02:19:07.862881+0000","last_peered":"2024-04-25T02:19:07.862881+0000","last_clean":"2024-04-25T02:19:07.862881+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:19:07.862881+0000","last_undegraded":"2024-04-25T02:19:07.862881+0000","last_fullsized":"2024-04-25T02:19:07.862881+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.862746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.436078+0000","last_change":"2024-04-25T02:19:01.436078+0000","last_active":"2024-04-25T02:19:01.436078+0000","last_peered":"2024-04-25T02:19:01.436078+0000","last_clean":"2024-04-25T02:19:01.436078+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:19:01.436078+0000","last_undegraded":"2024-04-25T02:19:01.436078+0000","last_fullsized":"2024-04-25T02:19:01.436078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.435931+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'162","reported_seq":180,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.898853+0000","last_change":"2024-04-25T02:19:11.898853+0000","last_active":"2024-04-25T02:19:11.898853+0000","last_peered":"2024-04-25T02:19:11.898853+0000","last_clean":"2024-04-25T02:19:11.898853+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:19:11.898853+0000","last_undegraded":"2024-04-25T02:19:11.898853+0000","last_fullsized":"2024-04-25T02:19:11.898853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'162","last_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_deep_scrub":"19'162","last_deep_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.898758+0000","log_size":162,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'344","reported_seq":356,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268567+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:18:51.268567+0000","last_peered":"2024-04-25T02:18:51.268567+0000","last_clean":"2024-04-25T02:18:51.268567+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:18:51.268567+0000","last_undegraded":"2024-04-25T02:18:51.268567+0000","last_fullsized":"2024-04-25T02:18:51.268567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.879508+0000","last_change":"2024-04-25T02:19:05.879508+0000","last_active":"2024-04-25T02:19:05.879508+0000","last_peered":"2024-04-25T02:19:05.879508+0000","last_clean":"2024-04-25T02:19:05.879508+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:19:05.879508+0000","last_undegraded":"2024-04-25T02:19:05.879508+0000","last_fullsized":"2024-04-25T02:19:05.879508+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.879394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'626","reported_seq":1266,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.344141+0000","last_change":"2024-04-25T02:19:02.344141+0000","last_active":"2024-04-25T02:19:02.344141+0000","last_peered":"2024-04-25T02:19:02.344141+0000","last_clean":"2024-04-25T02:19:02.344141+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:19:02.344141+0000","last_undegraded":"2024-04-25T02:19:02.344141+0000","last_fullsized":"2024-04-25T02:19:02.344141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'626","last_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_deep_scrub":"19'626","last_deep_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.344043+0000","log_size":626,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1113626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":622,"num_write_kb":1507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'415","reported_seq":427,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263065+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:18:51.263065+0000","last_peered":"2024-04-25T02:18:51.263065+0000","last_clean":"2024-04-25T02:18:51.263065+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:18:51.263065+0000","last_undegraded":"2024-04-25T02:18:51.263065+0000","last_fullsized":"2024-04-25T02:18:51.263065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.840625+0000","last_change":"2024-04-25T02:19:08.840625+0000","last_active":"2024-04-25T02:19:08.840625+0000","last_peered":"2024-04-25T02:19:08.840625+0000","last_clean":"2024-04-25T02:19:08.840625+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:19:08.840625+0000","last_undegraded":"2024-04-25T02:19:08.840625+0000","last_fullsized":"2024-04-25T02:19:08.840625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.840520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'45","reported_seq":63,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.518176+0000","last_change":"2024-04-25T02:19:09.518176+0000","last_active":"2024-04-25T02:19:09.518176+0000","last_peered":"2024-04-25T02:19:09.518176+0000","last_clean":"2024-04-25T02:19:09.518176+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:19:09.518176+0000","last_undegraded":"2024-04-25T02:19:09.518176+0000","last_fullsized":"2024-04-25T02:19:09.518176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'45","last_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_deep_scrub":"19'45","last_deep_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.518059+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'343","reported_seq":355,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271627+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:18:51.271627+0000","last_peered":"2024-04-25T02:18:51.271627+0000","last_clean":"2024-04-25T02:18:51.271627+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:18:51.271627+0000","last_undegraded":"2024-04-25T02:18:51.271627+0000","last_fullsized":"2024-04-25T02:18:51.271627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'65","reported_seq":83,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.839509+0000","last_change":"2024-04-25T02:19:13.839509+0000","last_active":"2024-04-25T02:19:13.839509+0000","last_peered":"2024-04-25T02:19:13.839509+0000","last_clean":"2024-04-25T02:19:13.839509+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:19:13.839509+0000","last_undegraded":"2024-04-25T02:19:13.839509+0000","last_fullsized":"2024-04-25T02:19:13.839509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'65","last_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_deep_scrub":"19'65","last_deep_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.839408+0000","log_size":65,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:03.479134+0000","last_change":"2024-04-25T02:19:03.479134+0000","last_active":"2024-04-25T02:19:03.479134+0000","last_peered":"2024-04-25T02:19:03.479134+0000","last_clean":"2024-04-25T02:19:03.479134+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:19:03.479134+0000","last_undegraded":"2024-04-25T02:19:03.479134+0000","last_fullsized":"2024-04-25T02:19:03.479134+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_clean_scrub_stamp":"2024-04-25T02:19:03.479027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273457+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:18:51.273457+0000","last_peered":"2024-04-25T02:18:51.273457+0000","last_clean":"2024-04-25T02:18:51.273457+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:18:51.273457+0000","last_undegraded":"2024-04-25T02:18:51.273457+0000","last_fullsized":"2024-04-25T02:18:51.273457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:10.845393+0000","last_change":"2024-04-25T02:19:10.845393+0000","last_active":"2024-04-25T02:19:10.845393+0000","last_peered":"2024-04-25T02:19:10.845393+0000","last_clean":"2024-04-25T02:19:10.845393+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:19:10.845393+0000","last_undegraded":"2024-04-25T02:19:10.845393+0000","last_fullsized":"2024-04-25T02:19:10.845393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_clean_scrub_stamp":"2024-04-25T02:19:10.845259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'72","reported_seq":90,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.244226+0000","last_change":"2024-04-25T02:19:07.244226+0000","last_active":"2024-04-25T02:19:07.244226+0000","last_peered":"2024-04-25T02:19:07.244226+0000","last_clean":"2024-04-25T02:19:07.244226+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:19:07.244226+0000","last_undegraded":"2024-04-25T02:19:07.244226+0000","last_fullsized":"2024-04-25T02:19:07.244226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'72","last_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_deep_scrub":"19'72","last_deep_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.244087+0000","log_size":72,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'336","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.688927+0000","last_change":"2024-04-25T02:19:16.688927+0000","last_active":"2024-04-25T02:19:16.688927+0000","last_peered":"2024-04-25T02:19:16.688927+0000","last_clean":"2024-04-25T02:19:16.688927+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:19:16.688927+0000","last_undegraded":"2024-04-25T02:19:16.688927+0000","last_fullsized":"2024-04-25T02:19:16.688927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'336","last_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_deep_scrub":"19'336","last_deep_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.688815+0000","log_size":336,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'30","reported_seq":43,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:38.535566+0000","last_change":"2024-04-25T02:10:02.374878+0000","last_active":"2024-04-25T02:18:38.535566+0000","last_peered":"2024-04-25T02:18:38.535566+0000","last_clean":"2024-04-25T02:18:38.535566+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:18:38.535566+0000","last_undegraded":"2024-04-25T02:18:38.535566+0000","last_fullsized":"2024-04-25T02:18:38.535566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281228+0000","last_change":"2024-04-25T02:10:02.741317+0000","last_active":"2024-04-25T02:18:51.281228+0000","last_peered":"2024-04-25T02:18:51.281228+0000","last_clean":"2024-04-25T02:18:51.281228+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:18:51.281228+0000","last_undegraded":"2024-04-25T02:18:51.281228+0000","last_fullsized":"2024-04-25T02:18:51.281228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'46","reported_seq":59,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:39.361965+0000","last_change":"2024-04-25T02:10:02.360651+0000","last_active":"2024-04-25T02:18:39.361965+0000","last_peered":"2024-04-25T02:18:39.361965+0000","last_clean":"2024-04-25T02:18:39.361965+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:18:39.361965+0000","last_undegraded":"2024-04-25T02:18:39.361965+0000","last_fullsized":"2024-04-25T02:18:39.361965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":46,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277504+0000","last_change":"2024-04-25T02:10:02.743105+0000","last_active":"2024-04-25T02:18:51.277504+0000","last_peered":"2024-04-25T02:18:51.277504+0000","last_clean":"2024-04-25T02:18:51.277504+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:18:51.277504+0000","last_undegraded":"2024-04-25T02:18:51.277504+0000","last_fullsized":"2024-04-25T02:18:51.277504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":2199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'244","reported_seq":257,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.342289+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:18:48.342289+0000","last_peered":"2024-04-25T02:18:48.342289+0000","last_clean":"2024-04-25T02:18:48.342289+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:18:48.342289+0000","last_undegraded":"2024-04-25T02:18:48.342289+0000","last_fullsized":"2024-04-25T02:18:48.342289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":244,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277080+0000","last_change":"2024-04-25T02:10:02.745012+0000","last_active":"2024-04-25T02:18:51.277080+0000","last_peered":"2024-04-25T02:18:51.277080+0000","last_clean":"2024-04-25T02:18:51.277080+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:18:51.277080+0000","last_undegraded":"2024-04-25T02:18:51.277080+0000","last_fullsized":"2024-04-25T02:18:51.277080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'110","reported_seq":123,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.799634+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:18:45.799634+0000","last_peered":"2024-04-25T02:18:45.799634+0000","last_clean":"2024-04-25T02:18:45.799634+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:18:45.799634+0000","last_undegraded":"2024-04-25T02:18:45.799634+0000","last_fullsized":"2024-04-25T02:18:45.799634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":110,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'370","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280559+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:18:51.280559+0000","last_peered":"2024-04-25T02:18:51.280559+0000","last_clean":"2024-04-25T02:18:51.280559+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:18:51.280559+0000","last_undegraded":"2024-04-25T02:18:51.280559+0000","last_fullsized":"2024-04-25T02:18:51.280559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":370,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'55","reported_seq":68,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:41.302148+0000","last_change":"2024-04-25T02:10:02.370962+0000","last_active":"2024-04-25T02:18:41.302148+0000","last_peered":"2024-04-25T02:18:41.302148+0000","last_clean":"2024-04-25T02:18:41.302148+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:18:41.302148+0000","last_undegraded":"2024-04-25T02:18:41.302148+0000","last_fullsized":"2024-04-25T02:18:41.302148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":55,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'414","reported_seq":426,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280055+0000","last_change":"2024-04-25T02:10:02.742001+0000","last_active":"2024-04-25T02:18:51.280055+0000","last_peered":"2024-04-25T02:18:51.280055+0000","last_clean":"2024-04-25T02:18:51.280055+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:18:51.280055+0000","last_undegraded":"2024-04-25T02:18:51.280055+0000","last_fullsized":"2024-04-25T02:18:51.280055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":414,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'413","reported_seq":425,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281808+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:18:51.281808+0000","last_peered":"2024-04-25T02:18:51.281808+0000","last_clean":"2024-04-25T02:18:51.281808+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:18:51.281808+0000","last_undegraded":"2024-04-25T02:18:51.281808+0000","last_fullsized":"2024-04-25T02:18:51.281808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":413,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":2919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276676+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:18:51.276676+0000","last_peered":"2024-04-25T02:18:51.276676+0000","last_clean":"2024-04-25T02:18:51.276676+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:18:51.276676+0000","last_undegraded":"2024-04-25T02:18:51.276676+0000","last_fullsized":"2024-04-25T02:18:51.276676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":3172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'394","reported_seq":406,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.251643+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:18:51.251643+0000","last_peered":"2024-04-25T02:18:51.251643+0000","last_clean":"2024-04-25T02:18:51.251643+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:18:51.251643+0000","last_undegraded":"2024-04-25T02:18:51.251643+0000","last_fullsized":"2024-04-25T02:18:51.251643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":394,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.259897+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:18:51.259897+0000","last_peered":"2024-04-25T02:18:51.259897+0000","last_clean":"2024-04-25T02:18:51.259897+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:18:51.259897+0000","last_undegraded":"2024-04-25T02:18:51.259897+0000","last_fullsized":"2024-04-25T02:18:51.259897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281654+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:18:51.281654+0000","last_peered":"2024-04-25T02:18:51.281654+0000","last_clean":"2024-04-25T02:18:51.281654+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:18:51.281654+0000","last_undegraded":"2024-04-25T02:18:51.281654+0000","last_fullsized":"2024-04-25T02:18:51.281654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":167505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23216,"ondisk_log_size":23216,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":3994,"num_write_kb":199381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316645376,"data_stored":316588690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705781,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370056,"kb_used_data":72832,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94001784,"statfs":{"total":96636764160,"available":96257826816,"internally_reserved":0,"allocated":74579968,"data_stored":74464209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.23799999999999999,"15min":0.26800000000000002},"min":{"1min":0.156,"5min":0.156,"15min":0.14599999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.253,"15min":0.29299999999999998},"min":{"1min":0.17599999999999999,"5min":0.16500000000000001,"15min":0.16300000000000001},"max":{"1min":0.45900000000000002,"5min":0.50900000000000001,"15min":0.53400000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.27600000000000002,"5min":0.26400000000000001,"15min":0.29899999999999999},"min":{"1min":0.19,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.45200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.29999999999999999},"min":{"1min":0.192,"5min":0.186,"15min":0.186},"max":{"1min":0.441,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.28899999999999998,"15min":0.32500000000000001},"min":{"1min":0.223,"5min":0.192,"15min":0.192},"max":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":0.47899999999999998,"5min":0.628,"15min":0.628},"last":0.35799999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705780,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405844,"kb_used_data":100428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93965996,"statfs":{"total":96636764160,"available":96221179904,"internally_reserved":0,"allocated":102838272,"data_stored":102710905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.28599999999999998},"min":{"1min":0.182,"5min":0.13200000000000001,"15min":0.13200000000000001},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.49299999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.252,"15min":0.29399999999999998},"min":{"1min":0.19500000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.315},"min":{"1min":0.182,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.307,"5min":0.27400000000000002,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.53400000000000003},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.32800000000000001},"min":{"1min":0.22,"5min":0.186,"15min":0.186},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.496,"5min":0.496,"15min":0.51900000000000002},"last":0.34899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705780,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364024,"kb_used_data":66800,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94007816,"statfs":{"total":96636764160,"available":96264003584,"internally_reserved":0,"allocated":68403200,"data_stored":68279904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:19:15 2024","interfaces":[{"interface":"back","average":{"1min":2.452,"5min":0.66600000000000004,"15min":0.43099999999999999},"min":{"1min":0.19400000000000001,"5min":0.156,"15min":0.14399999999999999},"max":{"1min":34.734000000000002,"5min":34.734000000000002,"15min":34.734000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.32700000000000001,"15min":0.32200000000000001},"min":{"1min":0.20699999999999999,"5min":0.16700000000000001,"15min":0.16300000000000001},"max":{"1min":4.8769999999999998,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Apr 25 02:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.39300000000000002,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":9.0670000000000002,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.39400000000000002,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.192,"15min":0.192},"max":{"1min":9.2899999999999991,"5min":9.2899999999999991,"15min":9.2899999999999991},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:19:15 2024","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":0.66500000000000004,"15min":0.45900000000000002},"min":{"1min":0.252,"5min":0.182,"15min":0.182},"max":{"1min":29.867999999999999,"5min":29.867999999999999,"15min":29.867999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.6060000000000001,"5min":0.54200000000000004,"15min":0.40999999999999998},"min":{"1min":0.26000000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":20.276,"5min":20.276,"15min":20.276},"last":0.501}]}]},{"osd":1,"up_from":9,"seq":38654705781,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371124,"kb_used_data":69804,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94000716,"statfs":{"total":96636764160,"available":96256733184,"internally_reserved":0,"allocated":71479296,"data_stored":71360528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.224,"15min":0.27100000000000002},"min":{"1min":0.16600000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.318,"5min":0.246,"15min":0.28899999999999998},"min":{"1min":0.191,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Apr 25 02:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.311},"min":{"1min":0.20599999999999999,"5min":0.154,"15min":0.153},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.57799999999999996},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.28599999999999998,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.27300000000000002,"15min":0.31},"min":{"1min":0.22700000000000001,"5min":0.17999999999999999,"15min":0.17799999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.28399999999999997,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68239360,"data_stored":68223190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74416128,"data_stored":74407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102674432,"data_stored":102654191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:19:22.647 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.647 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.647 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.647 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.647 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.647 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.647 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.647 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.648 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.649 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.650 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.650 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.650 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.650 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.650 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.650 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.650 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.650 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.651 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.651 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.651 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.651 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.651 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.651 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.651 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.651 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.651 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.652 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.652 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.652 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.652 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.652 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.652 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.652 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.652 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.652 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.653 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.653 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.653 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.653 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.653 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.653 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.653 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.653 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.654 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.654 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.654 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.654 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.654 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.654 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.654 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.654 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.654 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.655 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.655 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.655 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:22.655 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:19:42.656 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.789+0000 7fc80dce5700 1 Processor -- start 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.789+0000 7fc80dce5700 1 -- start start 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc80dce5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8080972f0 0x7fc8081279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc80dce5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc808127ee0 0x7fc80812a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc80dce5700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc80812acc0 0x7fc80812b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc80dce5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8080976d0 con 0x7fc8080972f0 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc80dce5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc808065420 con 0x7fc808127ee0 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc80dce5700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080656e0 con 0x7fc80812acc0 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc806ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc808127ee0 0x7fc80812a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc8077fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8080972f0 0x7fc8081279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:42.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc807fff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc80812acc0 0x7fc80812b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc806ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc808127ee0 0x7fc80812a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:44188/0 (socket says 172.21.15.78:44188) 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc8077fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8080972f0 0x7fc8081279f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59556/0 (socket says 172.21.15.78:59556) 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc807fff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc80812acc0 0x7fc80812b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43164/0 (socket says 172.21.15.78:43164) 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc806ffd700 1 -- 172.21.15.78:0/1411985403 learned_addr learned my addr 172.21.15.78:0/1411985403 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc807fff700 1 -- 172.21.15.78:0/1411985403 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc808127ee0 msgr2=0x7fc80812a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc807fff700 1 --2- 172.21.15.78:0/1411985403 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc808127ee0 0x7fc80812a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc807fff700 1 -- 172.21.15.78:0/1411985403 >> v2:172.21.15.78:3300/0 conn(0x7fc8080972f0 msgr2=0x7fc8081279f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc807fff700 1 --2- 172.21.15.78:0/1411985403 >> v2:172.21.15.78:3300/0 conn(0x7fc8080972f0 0x7fc8081279f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc807fff700 1 -- 172.21.15.78:0/1411985403 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808097c30 con 0x7fc80812acc0 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc8077fe700 1 --2- 172.21.15.78:0/1411985403 >> v2:172.21.15.78:3300/0 conn(0x7fc8080972f0 0x7fc8081279f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc806ffd700 1 --2- 172.21.15.78:0/1411985403 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc808127ee0 0x7fc80812a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.790+0000 7fc807fff700 1 --2- 172.21.15.78:0/1411985403 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc80812acc0 0x7fc80812b150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fc800009e60 tx=0x7fc800009780).ready entity=mon.2 client_cookie=73dec5cffda05d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:42.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc8067fc700 1 -- 172.21.15.78:0/1411985403 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80000e070 con 0x7fc80812acc0 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc8067fc700 1 -- 172.21.15.78:0/1411985403 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80000bab0 con 0x7fc80812acc0 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc8067fc700 1 -- 172.21.15.78:0/1411985403 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80000be30 con 0x7fc80812acc0 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc80dce5700 1 -- 172.21.15.78:0/1411985403 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc80812acc0 msgr2=0x7fc80812b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc80dce5700 1 --2- 172.21.15.78:0/1411985403 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc80812acc0 0x7fc80812b150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fc800009e60 tx=0x7fc800009780).stop 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc80dce5700 1 -- 172.21.15.78:0/1411985403 shutdown_connections 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc80dce5700 1 --2- 172.21.15.78:0/1411985403 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc80812acc0 0x7fc80812b150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc80dce5700 1 --2- 172.21.15.78:0/1411985403 >> v2:172.21.15.78:3300/0 conn(0x7fc8080972f0 0x7fc8081279f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc80dce5700 1 --2- 172.21.15.78:0/1411985403 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc808127ee0 0x7fc80812a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc80dce5700 1 -- 172.21.15.78:0/1411985403 >> 172.21.15.78:0/1411985403 conn(0x7fc80809c550 msgr2=0x7fc8080983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc80dce5700 1 -- 172.21.15.78:0/1411985403 shutdown_connections 2024-04-25T02:19:42.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.791+0000 7fc80dce5700 1 -- 172.21.15.78:0/1411985403 wait complete. 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.792+0000 7fc80dce5700 1 Processor -- start 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.792+0000 7fc80dce5700 1 -- start start 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc80dce5700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc808127ee0 0x7fc808139ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc80dce5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc80812acc0 0x7fc80813a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc80dce5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc80813a8b0 0x7fc808111f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc80dce5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc808096cc0 con 0x7fc80812acc0 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc80dce5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc808113320 con 0x7fc80813a8b0 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc80dce5700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc808064a40 con 0x7fc808127ee0 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc8077fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc808127ee0 0x7fc808139ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc807fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc80813a8b0 0x7fc808111f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc8077fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc808127ee0 0x7fc808139ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:43176/0 (socket says 172.21.15.78:43176) 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc8077fe700 1 -- 172.21.15.78:0/3892197324 learned_addr learned my addr 172.21.15.78:0/3892197324 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc806ffd700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc80812acc0 0x7fc80813a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc8077fe700 1 -- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc80813a8b0 msgr2=0x7fc808111f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:42.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc8077fe700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc80813a8b0 0x7fc808111f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc8077fe700 1 -- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc80812acc0 msgr2=0x7fc80813a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc8077fe700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc80812acc0 0x7fc80813a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc8077fe700 1 -- 172.21.15.78:0/3892197324 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f00092a0 con 0x7fc808127ee0 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc807fff700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc80813a8b0 0x7fc808111f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.793+0000 7fc806ffd700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc80812acc0 0x7fc80813a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.794+0000 7fc8077fe700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc808127ee0 0x7fc808139ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc7f000ea20 tx=0x7fc7f0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.794+0000 7fc7fffff700 1 -- 172.21.15.78:0/3892197324 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f000ee60 con 0x7fc808127ee0 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.794+0000 7fc7fffff700 1 -- 172.21.15.78:0/3892197324 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f000c850 con 0x7fc808127ee0 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.794+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f8009370 con 0x7fc808127ee0 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.794+0000 7fc7fffff700 1 -- 172.21.15.78:0/3892197324 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f000cbd0 con 0x7fc808127ee0 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.794+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc800009a20 con 0x7fc808127ee0 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.795+0000 7fc7fffff700 1 -- 172.21.15.78:0/3892197324 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fc7f001b400 con 0x7fc808127ee0 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.795+0000 7fc7fffff700 1 -- 172.21.15.78:0/3892197324 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fc7f003b760 con 0x7fc808127ee0 2024-04-25T02:19:42.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.795+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc808098af0 con 0x7fc808127ee0 2024-04-25T02:19:42.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.800+0000 7fc7fffff700 1 -- 172.21.15.78:0/3892197324 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fc7f0019900 con 0x7fc808127ee0 2024-04-25T02:19:42.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.956+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc808113620 con 0x7fc7e802bd30 2024-04-25T02:19:42.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.962+0000 7fc7fffff700 1 -- 172.21.15.78:0/3892197324 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256671 (unknown 2965378022 0 2385303621) 0x7fc808113620 con 0x7fc7e802bd30 2024-04-25T02:19:42.969 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 >> v1:172.21.15.78:6816/46507 conn(0x7fc7e802bd30 legacy=0x7fc7e802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc808127ee0 msgr2=0x7fc808139ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc808127ee0 0x7fc808139ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc7f000ea20 tx=0x7fc7f0009060).stop 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 shutdown_connections 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc80813a8b0 0x7fc808111f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc808127ee0 0x7fc808139ed0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 --2- 172.21.15.78:0/3892197324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc80812acc0 0x7fc80813a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 >> 172.21.15.78:0/3892197324 conn(0x7fc8080972f0 msgr2=0x7fc80809a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 shutdown_connections 2024-04-25T02:19:42.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:19:42.965+0000 7fc80dce5700 1 -- 172.21.15.78:0/3892197324 wait complete. 2024-04-25T02:19:42.972 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:19:42.980 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-04-25T02:19:42.314712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":27629,"num_write_kb":366886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":450,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27144,"ondisk_log_size":27144,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1511048,"kb_used_data":309864,"kb_used_omap":0,"kb_used_meta":1201152,"kb_avail":375976312,"statfs":{"total":386547056640,"available":384999743488,"internally_reserved":0,"allocated":317300736,"data_stored":316815546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1229979648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003157"},"pg_stats":[{"pgid":"4.3f","version":"19'354","reported_seq":366,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.275043+0000","last_change":"2024-04-25T02:10:02.748780+0000","last_active":"2024-04-25T02:18:51.275043+0000","last_peered":"2024-04-25T02:18:51.275043+0000","last_clean":"2024-04-25T02:18:51.275043+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:18:51.275043+0000","last_undegraded":"2024-04-25T02:18:51.275043+0000","last_fullsized":"2024-04-25T02:18:51.275043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277671+0000","last_change":"2024-04-25T02:10:02.744318+0000","last_active":"2024-04-25T02:18:51.277671+0000","last_peered":"2024-04-25T02:18:51.277671+0000","last_clean":"2024-04-25T02:18:51.277671+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:18:51.277671+0000","last_undegraded":"2024-04-25T02:18:51.277671+0000","last_fullsized":"2024-04-25T02:18:51.277671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267056+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:18:51.267056+0000","last_peered":"2024-04-25T02:18:51.267056+0000","last_clean":"2024-04-25T02:18:51.267056+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:18:51.267056+0000","last_undegraded":"2024-04-25T02:18:51.267056+0000","last_fullsized":"2024-04-25T02:18:51.267056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267040+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:18:51.267040+0000","last_peered":"2024-04-25T02:18:51.267040+0000","last_clean":"2024-04-25T02:18:51.267040+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:18:51.267040+0000","last_undegraded":"2024-04-25T02:18:51.267040+0000","last_fullsized":"2024-04-25T02:18:51.267040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269216+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:18:51.269216+0000","last_peered":"2024-04-25T02:18:51.269216+0000","last_clean":"2024-04-25T02:18:51.269216+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:18:51.269216+0000","last_undegraded":"2024-04-25T02:18:51.269216+0000","last_fullsized":"2024-04-25T02:18:51.269216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278782+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:18:51.278782+0000","last_peered":"2024-04-25T02:18:51.278782+0000","last_clean":"2024-04-25T02:18:51.278782+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:18:51.278782+0000","last_undegraded":"2024-04-25T02:18:51.278782+0000","last_fullsized":"2024-04-25T02:18:51.278782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'376","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272984+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:18:51.272984+0000","last_peered":"2024-04-25T02:18:51.272984+0000","last_clean":"2024-04-25T02:18:51.272984+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:18:51.272984+0000","last_undegraded":"2024-04-25T02:18:51.272984+0000","last_fullsized":"2024-04-25T02:18:51.272984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":376,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":3216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'297","reported_seq":309,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272124+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:18:51.272124+0000","last_peered":"2024-04-25T02:18:51.272124+0000","last_clean":"2024-04-25T02:18:51.272124+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:18:51.272124+0000","last_undegraded":"2024-04-25T02:18:51.272124+0000","last_fullsized":"2024-04-25T02:18:51.272124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":297,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":2172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269598+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:18:51.269598+0000","last_peered":"2024-04-25T02:18:51.269598+0000","last_clean":"2024-04-25T02:18:51.269598+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:18:51.269598+0000","last_undegraded":"2024-04-25T02:18:51.269598+0000","last_fullsized":"2024-04-25T02:18:51.269598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'351","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267201+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:18:51.267201+0000","last_peered":"2024-04-25T02:18:51.267201+0000","last_clean":"2024-04-25T02:18:51.267201+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:18:51.267201+0000","last_undegraded":"2024-04-25T02:18:51.267201+0000","last_fullsized":"2024-04-25T02:18:51.267201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.256733+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:18:51.256733+0000","last_peered":"2024-04-25T02:18:51.256733+0000","last_clean":"2024-04-25T02:18:51.256733+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:18:51.256733+0000","last_undegraded":"2024-04-25T02:18:51.256733+0000","last_fullsized":"2024-04-25T02:18:51.256733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":2530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'322","reported_seq":334,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277216+0000","last_change":"2024-04-25T02:10:02.743477+0000","last_active":"2024-04-25T02:18:51.277216+0000","last_peered":"2024-04-25T02:18:51.277216+0000","last_clean":"2024-04-25T02:18:51.277216+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:18:51.277216+0000","last_undegraded":"2024-04-25T02:18:51.277216+0000","last_fullsized":"2024-04-25T02:18:51.277216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":322,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'359","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.277681+0000","last_change":"2024-04-25T02:10:02.743086+0000","last_active":"2024-04-25T02:18:51.277681+0000","last_peered":"2024-04-25T02:18:51.277681+0000","last_clean":"2024-04-25T02:18:51.277681+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:18:51.277681+0000","last_undegraded":"2024-04-25T02:18:51.277681+0000","last_fullsized":"2024-04-25T02:18:51.277681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":359,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":2645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278233+0000","last_change":"2024-04-25T02:10:02.730683+0000","last_active":"2024-04-25T02:18:51.278233+0000","last_peered":"2024-04-25T02:18:51.278233+0000","last_clean":"2024-04-25T02:18:51.278233+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:18:51.278233+0000","last_undegraded":"2024-04-25T02:18:51.278233+0000","last_fullsized":"2024-04-25T02:18:51.278233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253088+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:18:51.253088+0000","last_peered":"2024-04-25T02:18:51.253088+0000","last_clean":"2024-04-25T02:18:51.253088+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:18:51.253088+0000","last_undegraded":"2024-04-25T02:18:51.253088+0000","last_fullsized":"2024-04-25T02:18:51.253088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'380","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271052+0000","last_change":"2024-04-25T02:10:53.852512+0000","last_active":"2024-04-25T02:18:51.271052+0000","last_peered":"2024-04-25T02:18:51.271052+0000","last_clean":"2024-04-25T02:18:51.271052+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:18:51.271052+0000","last_undegraded":"2024-04-25T02:18:51.271052+0000","last_fullsized":"2024-04-25T02:18:51.271052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":380,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.264403+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:18:51.264403+0000","last_peered":"2024-04-25T02:18:51.264403+0000","last_clean":"2024-04-25T02:18:51.264403+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:18:51.264403+0000","last_undegraded":"2024-04-25T02:18:51.264403+0000","last_fullsized":"2024-04-25T02:18:51.264403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'340","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253849+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:18:51.253849+0000","last_peered":"2024-04-25T02:18:51.253849+0000","last_clean":"2024-04-25T02:18:51.253849+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:18:51.253849+0000","last_undegraded":"2024-04-25T02:18:51.253849+0000","last_fullsized":"2024-04-25T02:18:51.253849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'356","reported_seq":373,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:40.854714+0000","last_change":"2024-04-25T02:19:40.854714+0000","last_active":"2024-04-25T02:19:40.854714+0000","last_peered":"2024-04-25T02:19:40.854714+0000","last_clean":"2024-04-25T02:19:40.854714+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:19:40.854714+0000","last_undegraded":"2024-04-25T02:19:40.854714+0000","last_fullsized":"2024-04-25T02:19:40.854714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'356","last_scrub_stamp":"2024-04-25T02:19:40.854586+0000","last_deep_scrub":"19'356","last_deep_scrub_stamp":"2024-04-25T02:19:40.854586+0000","last_clean_scrub_stamp":"2024-04-25T02:19:40.854586+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269721+0000","last_change":"2024-04-25T02:10:02.737476+0000","last_active":"2024-04-25T02:18:51.269721+0000","last_peered":"2024-04-25T02:18:51.269721+0000","last_clean":"2024-04-25T02:18:51.269721+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:18:51.269721+0000","last_undegraded":"2024-04-25T02:18:51.269721+0000","last_fullsized":"2024-04-25T02:18:51.269721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'344","reported_seq":358,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:39.836256+0000","last_change":"2024-04-25T02:19:39.836256+0000","last_active":"2024-04-25T02:19:39.836256+0000","last_peered":"2024-04-25T02:19:39.836256+0000","last_clean":"2024-04-25T02:19:39.836256+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:19:39.836256+0000","last_undegraded":"2024-04-25T02:19:39.836256+0000","last_fullsized":"2024-04-25T02:19:39.836256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'344","last_scrub_stamp":"2024-04-25T02:19:39.836145+0000","last_deep_scrub":"19'344","last_deep_scrub_stamp":"2024-04-25T02:19:39.836145+0000","last_clean_scrub_stamp":"2024-04-25T02:19:39.836145+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'383","reported_seq":395,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267045+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:18:51.267045+0000","last_peered":"2024-04-25T02:18:51.267045+0000","last_clean":"2024-04-25T02:18:51.267045+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:18:51.267045+0000","last_undegraded":"2024-04-25T02:18:51.267045+0000","last_fullsized":"2024-04-25T02:18:51.267045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":2481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'350","reported_seq":362,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273435+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:18:51.273435+0000","last_peered":"2024-04-25T02:18:51.273435+0000","last_clean":"2024-04-25T02:18:51.273435+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:18:51.273435+0000","last_undegraded":"2024-04-25T02:18:51.273435+0000","last_fullsized":"2024-04-25T02:18:51.273435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":350,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271458+0000","last_change":"2024-04-25T02:10:02.733600+0000","last_active":"2024-04-25T02:18:51.271458+0000","last_peered":"2024-04-25T02:18:51.271458+0000","last_clean":"2024-04-25T02:18:51.271458+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:18:51.271458+0000","last_undegraded":"2024-04-25T02:18:51.271458+0000","last_fullsized":"2024-04-25T02:18:51.271458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'386","reported_seq":398,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.250133+0000","last_change":"2024-04-25T02:10:02.745732+0000","last_active":"2024-04-25T02:18:51.250133+0000","last_peered":"2024-04-25T02:18:51.250133+0000","last_clean":"2024-04-25T02:18:51.250133+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:18:51.250133+0000","last_undegraded":"2024-04-25T02:18:51.250133+0000","last_fullsized":"2024-04-25T02:18:51.250133+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'421","reported_seq":433,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281870+0000","last_change":"2024-04-25T02:10:02.730962+0000","last_active":"2024-04-25T02:18:51.281870+0000","last_peered":"2024-04-25T02:18:51.281870+0000","last_clean":"2024-04-25T02:18:51.281870+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:18:51.281870+0000","last_undegraded":"2024-04-25T02:18:51.281870+0000","last_fullsized":"2024-04-25T02:18:51.281870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":421,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268411+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:18:51.268411+0000","last_peered":"2024-04-25T02:18:51.268411+0000","last_clean":"2024-04-25T02:18:51.268411+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:18:51.268411+0000","last_undegraded":"2024-04-25T02:18:51.268411+0000","last_fullsized":"2024-04-25T02:18:51.268411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'157","reported_seq":175,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:22.516024+0000","last_change":"2024-04-25T02:19:22.516024+0000","last_active":"2024-04-25T02:19:22.516024+0000","last_peered":"2024-04-25T02:19:22.516024+0000","last_clean":"2024-04-25T02:19:22.516024+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:19:22.516024+0000","last_undegraded":"2024-04-25T02:19:22.516024+0000","last_fullsized":"2024-04-25T02:19:22.516024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'157","last_scrub_stamp":"2024-04-25T02:19:22.515900+0000","last_deep_scrub":"19'157","last_deep_scrub_stamp":"2024-04-25T02:19:22.515900+0000","last_clean_scrub_stamp":"2024-04-25T02:19:22.515900+0000","log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":16455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'334","reported_seq":346,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272426+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:18:51.272426+0000","last_peered":"2024-04-25T02:18:51.272426+0000","last_clean":"2024-04-25T02:18:51.272426+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:18:51.272426+0000","last_undegraded":"2024-04-25T02:18:51.272426+0000","last_fullsized":"2024-04-25T02:18:51.272426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":334,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'77","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.512649+0000","last_change":"2024-04-25T02:19:19.512649+0000","last_active":"2024-04-25T02:19:19.512649+0000","last_peered":"2024-04-25T02:19:19.512649+0000","last_clean":"2024-04-25T02:19:19.512649+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:19:19.512649+0000","last_undegraded":"2024-04-25T02:19:19.512649+0000","last_fullsized":"2024-04-25T02:19:19.512649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'77","last_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_deep_scrub":"19'77","last_deep_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.512541+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'347","reported_seq":359,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263176+0000","last_change":"2024-04-25T02:10:02.737781+0000","last_active":"2024-04-25T02:18:51.263176+0000","last_peered":"2024-04-25T02:18:51.263176+0000","last_clean":"2024-04-25T02:18:51.263176+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:18:51.263176+0000","last_undegraded":"2024-04-25T02:18:51.263176+0000","last_fullsized":"2024-04-25T02:18:51.263176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":347,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'243","reported_seq":256,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:31.210530+0000","last_change":"2024-04-25T02:10:02.371338+0000","last_active":"2024-04-25T02:18:31.210530+0000","last_peered":"2024-04-25T02:18:31.210530+0000","last_clean":"2024-04-25T02:18:31.210530+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:18:31.210530+0000","last_undegraded":"2024-04-25T02:18:31.210530+0000","last_fullsized":"2024-04-25T02:18:31.210530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270570+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:18:51.270570+0000","last_peered":"2024-04-25T02:18:51.270570+0000","last_clean":"2024-04-25T02:18:51.270570+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:18:51.270570+0000","last_undegraded":"2024-04-25T02:18:51.270570+0000","last_fullsized":"2024-04-25T02:18:51.270570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'6","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.290157+0000","last_change":"2024-04-25T02:19:27.290157+0000","last_active":"2024-04-25T02:19:27.290157+0000","last_peered":"2024-04-25T02:19:27.290157+0000","last_clean":"2024-04-25T02:19:27.290157+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:19:27.290157+0000","last_undegraded":"2024-04-25T02:19:27.290157+0000","last_fullsized":"2024-04-25T02:19:27.290157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-25T02:19:27.290042+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-25T02:19:27.290042+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.290042+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'377","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273185+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:18:51.273185+0000","last_peered":"2024-04-25T02:18:51.273185+0000","last_clean":"2024-04-25T02:18:51.273185+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:18:51.273185+0000","last_undegraded":"2024-04-25T02:18:51.273185+0000","last_fullsized":"2024-04-25T02:18:51.273185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":377,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":2757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'81","reported_seq":99,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:15.705733+0000","last_change":"2024-04-25T02:19:15.705733+0000","last_active":"2024-04-25T02:19:15.705733+0000","last_peered":"2024-04-25T02:19:15.705733+0000","last_clean":"2024-04-25T02:19:15.705733+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:19:15.705733+0000","last_undegraded":"2024-04-25T02:19:15.705733+0000","last_fullsized":"2024-04-25T02:19:15.705733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'81","last_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_deep_scrub":"19'81","last_deep_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_clean_scrub_stamp":"2024-04-25T02:19:15.705635+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6184361,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'412","reported_seq":424,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273256+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:18:51.273256+0000","last_peered":"2024-04-25T02:18:51.273256+0000","last_clean":"2024-04-25T02:18:51.273256+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:18:51.273256+0000","last_undegraded":"2024-04-25T02:18:51.273256+0000","last_fullsized":"2024-04-25T02:18:51.273256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":412,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'364","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.364468+0000","last_change":"2024-04-25T02:19:25.364468+0000","last_active":"2024-04-25T02:19:25.364468+0000","last_peered":"2024-04-25T02:19:25.364468+0000","last_clean":"2024-04-25T02:19:25.364468+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:19:25.364468+0000","last_undegraded":"2024-04-25T02:19:25.364468+0000","last_fullsized":"2024-04-25T02:19:25.364468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'364","last_scrub_stamp":"2024-04-25T02:19:25.364369+0000","last_deep_scrub":"19'364","last_deep_scrub_stamp":"2024-04-25T02:19:25.364369+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.364369+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270896+0000","last_change":"2024-04-25T02:10:02.744299+0000","last_active":"2024-04-25T02:18:51.270896+0000","last_peered":"2024-04-25T02:18:51.270896+0000","last_clean":"2024-04-25T02:18:51.270896+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:18:51.270896+0000","last_undegraded":"2024-04-25T02:18:51.270896+0000","last_fullsized":"2024-04-25T02:18:51.270896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'305","reported_seq":318,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:47.440007+0000","last_change":"2024-04-25T02:10:02.363982+0000","last_active":"2024-04-25T02:18:47.440007+0000","last_peered":"2024-04-25T02:18:47.440007+0000","last_clean":"2024-04-25T02:18:47.440007+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:18:47.440007+0000","last_undegraded":"2024-04-25T02:18:47.440007+0000","last_fullsized":"2024-04-25T02:18:47.440007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":305,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8389252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":12434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'364","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:26.735843+0000","last_change":"2024-04-25T02:19:26.735843+0000","last_active":"2024-04-25T02:19:26.735843+0000","last_peered":"2024-04-25T02:19:26.735843+0000","last_clean":"2024-04-25T02:19:26.735843+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:19:26.735843+0000","last_undegraded":"2024-04-25T02:19:26.735843+0000","last_fullsized":"2024-04-25T02:19:26.735843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'364","last_scrub_stamp":"2024-04-25T02:19:26.735719+0000","last_deep_scrub":"19'364","last_deep_scrub_stamp":"2024-04-25T02:19:26.735719+0000","last_clean_scrub_stamp":"2024-04-25T02:19:26.735719+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'126","reported_seq":139,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:28.464847+0000","last_change":"2024-04-25T02:10:02.364534+0000","last_active":"2024-04-25T02:18:28.464847+0000","last_peered":"2024-04-25T02:18:28.464847+0000","last_clean":"2024-04-25T02:18:28.464847+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:18:28.464847+0000","last_undegraded":"2024-04-25T02:18:28.464847+0000","last_fullsized":"2024-04-25T02:18:28.464847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":126,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'333","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.771910+0000","last_change":"2024-04-25T02:19:27.771910+0000","last_active":"2024-04-25T02:19:27.771910+0000","last_peered":"2024-04-25T02:19:27.771910+0000","last_clean":"2024-04-25T02:19:27.771910+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:19:27.771910+0000","last_undegraded":"2024-04-25T02:19:27.771910+0000","last_fullsized":"2024-04-25T02:19:27.771910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:27.771815+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:27.771815+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.771815+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.296955+0000","last_change":"2024-04-25T02:19:21.296955+0000","last_active":"2024-04-25T02:19:21.296955+0000","last_peered":"2024-04-25T02:19:21.296955+0000","last_clean":"2024-04-25T02:19:21.296955+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:19:21.296955+0000","last_undegraded":"2024-04-25T02:19:21.296955+0000","last_fullsized":"2024-04-25T02:19:21.296955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.296829+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'353","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268219+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:18:51.268219+0000","last_peered":"2024-04-25T02:18:51.268219+0000","last_clean":"2024-04-25T02:18:51.268219+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:18:51.268219+0000","last_undegraded":"2024-04-25T02:18:51.268219+0000","last_fullsized":"2024-04-25T02:18:51.268219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":353,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'3","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:31.773766+0000","last_change":"2024-04-25T02:19:31.773766+0000","last_active":"2024-04-25T02:19:31.773766+0000","last_peered":"2024-04-25T02:19:31.773766+0000","last_clean":"2024-04-25T02:19:31.773766+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:19:31.773766+0000","last_undegraded":"2024-04-25T02:19:31.773766+0000","last_fullsized":"2024-04-25T02:19:31.773766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-25T02:19:31.773623+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-25T02:19:31.773623+0000","last_clean_scrub_stamp":"2024-04-25T02:19:31.773623+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'406","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253893+0000","last_change":"2024-04-25T02:10:02.743508+0000","last_active":"2024-04-25T02:18:51.253893+0000","last_peered":"2024-04-25T02:18:51.253893+0000","last_clean":"2024-04-25T02:18:51.253893+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:18:51.253893+0000","last_undegraded":"2024-04-25T02:18:51.253893+0000","last_fullsized":"2024-04-25T02:18:51.253893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":2547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'140","reported_seq":158,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.491862+0000","last_change":"2024-04-25T02:19:11.491862+0000","last_active":"2024-04-25T02:19:11.491862+0000","last_peered":"2024-04-25T02:19:11.491862+0000","last_clean":"2024-04-25T02:19:11.491862+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:19:11.491862+0000","last_undegraded":"2024-04-25T02:19:11.491862+0000","last_fullsized":"2024-04-25T02:19:11.491862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'140","last_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_deep_scrub":"19'140","last_deep_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.491759+0000","log_size":140,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'351","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:30.803636+0000","last_change":"2024-04-25T02:19:30.803636+0000","last_active":"2024-04-25T02:19:30.803636+0000","last_peered":"2024-04-25T02:19:30.803636+0000","last_clean":"2024-04-25T02:19:30.803636+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:19:30.803636+0000","last_undegraded":"2024-04-25T02:19:30.803636+0000","last_fullsized":"2024-04-25T02:19:30.803636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'351","last_scrub_stamp":"2024-04-25T02:19:30.803487+0000","last_deep_scrub":"19'351","last_deep_scrub_stamp":"2024-04-25T02:19:30.803487+0000","last_clean_scrub_stamp":"2024-04-25T02:19:30.803487+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'48","reported_seq":66,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.281870+0000","last_change":"2024-04-25T02:19:19.281870+0000","last_active":"2024-04-25T02:19:19.281870+0000","last_peered":"2024-04-25T02:19:19.281870+0000","last_clean":"2024-04-25T02:19:19.281870+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:19:19.281870+0000","last_undegraded":"2024-04-25T02:19:19.281870+0000","last_fullsized":"2024-04-25T02:19:19.281870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'48","last_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_deep_scrub":"19'48","last_deep_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.281770+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'375","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273633+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:18:51.273633+0000","last_peered":"2024-04-25T02:18:51.273633+0000","last_clean":"2024-04-25T02:18:51.273633+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:18:51.273633+0000","last_undegraded":"2024-04-25T02:18:51.273633+0000","last_fullsized":"2024-04-25T02:18:51.273633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":375,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'109","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.663012+0000","last_change":"2024-04-25T02:19:13.663012+0000","last_active":"2024-04-25T02:19:13.663012+0000","last_peered":"2024-04-25T02:19:13.663012+0000","last_clean":"2024-04-25T02:19:13.663012+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:19:13.663012+0000","last_undegraded":"2024-04-25T02:19:13.663012+0000","last_fullsized":"2024-04-25T02:19:13.663012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'109","last_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_deep_scrub":"19'109","last_deep_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.662909+0000","log_size":109,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'396","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:35.607004+0000","last_change":"2024-04-25T02:19:35.607004+0000","last_active":"2024-04-25T02:19:35.607004+0000","last_peered":"2024-04-25T02:19:35.607004+0000","last_clean":"2024-04-25T02:19:35.607004+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:19:35.607004+0000","last_undegraded":"2024-04-25T02:19:35.607004+0000","last_fullsized":"2024-04-25T02:19:35.607004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'396","last_scrub_stamp":"2024-04-25T02:19:35.606880+0000","last_deep_scrub":"19'396","last_deep_scrub_stamp":"2024-04-25T02:19:35.606880+0000","last_clean_scrub_stamp":"2024-04-25T02:19:35.606880+0000","log_size":396,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'84","reported_seq":102,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:29.801974+0000","last_change":"2024-04-25T02:19:29.801974+0000","last_active":"2024-04-25T02:19:29.801974+0000","last_peered":"2024-04-25T02:19:29.801974+0000","last_clean":"2024-04-25T02:19:29.801974+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:19:29.801974+0000","last_undegraded":"2024-04-25T02:19:29.801974+0000","last_fullsized":"2024-04-25T02:19:29.801974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'84","last_scrub_stamp":"2024-04-25T02:19:29.801721+0000","last_deep_scrub":"19'84","last_deep_scrub_stamp":"2024-04-25T02:19:29.801721+0000","last_clean_scrub_stamp":"2024-04-25T02:19:29.801721+0000","log_size":84,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'356","reported_seq":373,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.666077+0000","last_change":"2024-04-25T02:19:19.666077+0000","last_active":"2024-04-25T02:19:19.666077+0000","last_peered":"2024-04-25T02:19:19.666077+0000","last_clean":"2024-04-25T02:19:19.666077+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:19:19.666077+0000","last_undegraded":"2024-04-25T02:19:19.666077+0000","last_fullsized":"2024-04-25T02:19:19.666077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'356","last_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_deep_scrub":"19'356","last_deep_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.665961+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'33","reported_seq":51,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.244079+0000","last_change":"2024-04-25T02:19:09.244079+0000","last_active":"2024-04-25T02:19:09.244079+0000","last_peered":"2024-04-25T02:19:09.244079+0000","last_clean":"2024-04-25T02:19:09.244079+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:19:09.244079+0000","last_undegraded":"2024-04-25T02:19:09.244079+0000","last_fullsized":"2024-04-25T02:19:09.244079+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'33","last_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_deep_scrub":"19'33","last_deep_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.243976+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'398","reported_seq":410,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267105+0000","last_change":"2024-04-25T02:10:02.741156+0000","last_active":"2024-04-25T02:18:51.267105+0000","last_peered":"2024-04-25T02:18:51.267105+0000","last_clean":"2024-04-25T02:18:51.267105+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:18:51.267105+0000","last_undegraded":"2024-04-25T02:18:51.267105+0000","last_fullsized":"2024-04-25T02:18:51.267105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":398,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'117","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.843685+0000","last_change":"2024-04-25T02:19:25.843685+0000","last_active":"2024-04-25T02:19:25.843685+0000","last_peered":"2024-04-25T02:19:25.843685+0000","last_clean":"2024-04-25T02:19:25.843685+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:19:25.843685+0000","last_undegraded":"2024-04-25T02:19:25.843685+0000","last_fullsized":"2024-04-25T02:19:25.843685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'117","last_scrub_stamp":"2024-04-25T02:19:25.843568+0000","last_deep_scrub":"19'117","last_deep_scrub_stamp":"2024-04-25T02:19:25.843568+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.843568+0000","log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":12332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":450,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'459","reported_seq":471,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.248908+0000","last_change":"2024-04-25T02:10:02.743444+0000","last_active":"2024-04-25T02:18:51.248908+0000","last_peered":"2024-04-25T02:18:51.248908+0000","last_clean":"2024-04-25T02:18:51.248908+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:18:51.248908+0000","last_undegraded":"2024-04-25T02:18:51.248908+0000","last_fullsized":"2024-04-25T02:18:51.248908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":459,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'76","reported_seq":94,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.854739+0000","last_change":"2024-04-25T02:19:21.854739+0000","last_active":"2024-04-25T02:19:21.854739+0000","last_peered":"2024-04-25T02:19:21.854739+0000","last_clean":"2024-04-25T02:19:21.854739+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:19:21.854739+0000","last_undegraded":"2024-04-25T02:19:21.854739+0000","last_fullsized":"2024-04-25T02:19:21.854739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'76","last_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_deep_scrub":"19'76","last_deep_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.854641+0000","log_size":76,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'354","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.708606+0000","last_change":"2024-04-25T02:19:21.708606+0000","last_active":"2024-04-25T02:19:21.708606+0000","last_peered":"2024-04-25T02:19:21.708606+0000","last_clean":"2024-04-25T02:19:21.708606+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:19:21.708606+0000","last_undegraded":"2024-04-25T02:19:21.708606+0000","last_fullsized":"2024-04-25T02:19:21.708606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'354","last_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_deep_scrub":"19'354","last_deep_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.708495+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"19'32","reported_seq":50,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:17.789878+0000","last_change":"2024-04-25T02:19:17.789878+0000","last_active":"2024-04-25T02:19:17.789878+0000","last_peered":"2024-04-25T02:19:17.789878+0000","last_clean":"2024-04-25T02:19:17.789878+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:19:17.789878+0000","last_undegraded":"2024-04-25T02:19:17.789878+0000","last_fullsized":"2024-04-25T02:19:17.789878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'32","last_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_deep_scrub":"19'32","last_deep_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_clean_scrub_stamp":"2024-04-25T02:19:17.789779+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'332","reported_seq":349,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:24.721403+0000","last_change":"2024-04-25T02:19:24.721403+0000","last_active":"2024-04-25T02:19:24.721403+0000","last_peered":"2024-04-25T02:19:24.721403+0000","last_clean":"2024-04-25T02:19:24.721403+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:19:24.721403+0000","last_undegraded":"2024-04-25T02:19:24.721403+0000","last_fullsized":"2024-04-25T02:19:24.721403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'332","last_scrub_stamp":"2024-04-25T02:19:24.721294+0000","last_deep_scrub":"19'332","last_deep_scrub_stamp":"2024-04-25T02:19:24.721294+0000","last_clean_scrub_stamp":"2024-04-25T02:19:24.721294+0000","log_size":332,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'113","reported_seq":131,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.807276+0000","last_change":"2024-04-25T02:19:16.807276+0000","last_active":"2024-04-25T02:19:16.807276+0000","last_peered":"2024-04-25T02:19:16.807276+0000","last_clean":"2024-04-25T02:19:16.807276+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:19:16.807276+0000","last_undegraded":"2024-04-25T02:19:16.807276+0000","last_fullsized":"2024-04-25T02:19:16.807276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'113","last_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_deep_scrub":"19'113","last_deep_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.807162+0000","log_size":113,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'328","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:38.577551+0000","last_change":"2024-04-25T02:19:38.577551+0000","last_active":"2024-04-25T02:19:38.577551+0000","last_peered":"2024-04-25T02:19:38.577551+0000","last_clean":"2024-04-25T02:19:38.577551+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:19:38.577551+0000","last_undegraded":"2024-04-25T02:19:38.577551+0000","last_fullsized":"2024-04-25T02:19:38.577551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'328","last_scrub_stamp":"2024-04-25T02:19:38.577424+0000","last_deep_scrub":"19'328","last_deep_scrub_stamp":"2024-04-25T02:19:38.577424+0000","last_clean_scrub_stamp":"2024-04-25T02:19:38.577424+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.467431+0000","last_change":"2024-04-25T02:19:02.467431+0000","last_active":"2024-04-25T02:19:02.467431+0000","last_peered":"2024-04-25T02:19:02.467431+0000","last_clean":"2024-04-25T02:19:02.467431+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:19:02.467431+0000","last_undegraded":"2024-04-25T02:19:02.467431+0000","last_fullsized":"2024-04-25T02:19:02.467431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.467334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'95","reported_seq":113,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.615993+0000","last_change":"2024-04-25T02:19:11.615993+0000","last_active":"2024-04-25T02:19:11.615993+0000","last_peered":"2024-04-25T02:19:11.615993+0000","last_clean":"2024-04-25T02:19:11.615993+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:19:11.615993+0000","last_undegraded":"2024-04-25T02:19:11.615993+0000","last_fullsized":"2024-04-25T02:19:11.615993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'95","last_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_deep_scrub":"19'95","last_deep_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.615813+0000","log_size":95,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:26.561694+0000","last_change":"2024-04-25T02:19:26.561694+0000","last_active":"2024-04-25T02:19:26.561694+0000","last_peered":"2024-04-25T02:19:26.561694+0000","last_clean":"2024-04-25T02:19:26.561694+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:19:26.561694+0000","last_undegraded":"2024-04-25T02:19:26.561694+0000","last_fullsized":"2024-04-25T02:19:26.561694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:26.561581+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:26.561581+0000","last_clean_scrub_stamp":"2024-04-25T02:19:26.561581+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:06.911064+0000","last_change":"2024-04-25T02:19:06.911064+0000","last_active":"2024-04-25T02:19:06.911064+0000","last_peered":"2024-04-25T02:19:06.911064+0000","last_clean":"2024-04-25T02:19:06.911064+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:19:06.911064+0000","last_undegraded":"2024-04-25T02:19:06.911064+0000","last_fullsized":"2024-04-25T02:19:06.911064+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_clean_scrub_stamp":"2024-04-25T02:19:06.910932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'16","reported_seq":34,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.302362+0000","last_change":"2024-04-25T02:19:05.302362+0000","last_active":"2024-04-25T02:19:05.302362+0000","last_peered":"2024-04-25T02:19:05.302362+0000","last_clean":"2024-04-25T02:19:05.302362+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:19:05.302362+0000","last_undegraded":"2024-04-25T02:19:05.302362+0000","last_fullsized":"2024-04-25T02:19:05.302362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'16","last_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_deep_scrub":"19'16","last_deep_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.302256+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'326","reported_seq":343,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.576881+0000","last_change":"2024-04-25T02:19:27.576881+0000","last_active":"2024-04-25T02:19:27.576881+0000","last_peered":"2024-04-25T02:19:27.576881+0000","last_clean":"2024-04-25T02:19:27.576881+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:19:27.576881+0000","last_undegraded":"2024-04-25T02:19:27.576881+0000","last_fullsized":"2024-04-25T02:19:27.576881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'326","last_scrub_stamp":"2024-04-25T02:19:27.576765+0000","last_deep_scrub":"19'326","last_deep_scrub_stamp":"2024-04-25T02:19:27.576765+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.576765+0000","log_size":326,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.564824+0000","last_change":"2024-04-25T02:19:01.564824+0000","last_active":"2024-04-25T02:19:01.564824+0000","last_peered":"2024-04-25T02:19:01.564824+0000","last_clean":"2024-04-25T02:19:01.564824+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:19:01.564824+0000","last_undegraded":"2024-04-25T02:19:01.564824+0000","last_fullsized":"2024-04-25T02:19:01.564824+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.564726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'243","reported_seq":261,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.526240+0000","last_change":"2024-04-25T02:19:08.526240+0000","last_active":"2024-04-25T02:19:08.526240+0000","last_peered":"2024-04-25T02:19:08.526240+0000","last_clean":"2024-04-25T02:19:08.526240+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:19:08.526240+0000","last_undegraded":"2024-04-25T02:19:08.526240+0000","last_fullsized":"2024-04-25T02:19:08.526240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'243","last_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_deep_scrub":"19'243","last_deep_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.526107+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":12388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'331","reported_seq":348,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:29.573912+0000","last_change":"2024-04-25T02:19:29.573912+0000","last_active":"2024-04-25T02:19:29.573912+0000","last_peered":"2024-04-25T02:19:29.573912+0000","last_clean":"2024-04-25T02:19:29.573912+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:19:29.573912+0000","last_undegraded":"2024-04-25T02:19:29.573912+0000","last_fullsized":"2024-04-25T02:19:29.573912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'331","last_scrub_stamp":"2024-04-25T02:19:29.573769+0000","last_deep_scrub":"19'331","last_deep_scrub_stamp":"2024-04-25T02:19:29.573769+0000","last_clean_scrub_stamp":"2024-04-25T02:19:29.573769+0000","log_size":331,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":2335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.862881+0000","last_change":"2024-04-25T02:19:07.862881+0000","last_active":"2024-04-25T02:19:07.862881+0000","last_peered":"2024-04-25T02:19:07.862881+0000","last_clean":"2024-04-25T02:19:07.862881+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:19:07.862881+0000","last_undegraded":"2024-04-25T02:19:07.862881+0000","last_fullsized":"2024-04-25T02:19:07.862881+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.862746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.436078+0000","last_change":"2024-04-25T02:19:01.436078+0000","last_active":"2024-04-25T02:19:01.436078+0000","last_peered":"2024-04-25T02:19:01.436078+0000","last_clean":"2024-04-25T02:19:01.436078+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:19:01.436078+0000","last_undegraded":"2024-04-25T02:19:01.436078+0000","last_fullsized":"2024-04-25T02:19:01.436078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.435931+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'162","reported_seq":180,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.898853+0000","last_change":"2024-04-25T02:19:11.898853+0000","last_active":"2024-04-25T02:19:11.898853+0000","last_peered":"2024-04-25T02:19:11.898853+0000","last_clean":"2024-04-25T02:19:11.898853+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:19:11.898853+0000","last_undegraded":"2024-04-25T02:19:11.898853+0000","last_fullsized":"2024-04-25T02:19:11.898853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'162","last_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_deep_scrub":"19'162","last_deep_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.898758+0000","log_size":162,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'344","reported_seq":356,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268567+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:18:51.268567+0000","last_peered":"2024-04-25T02:18:51.268567+0000","last_clean":"2024-04-25T02:18:51.268567+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:18:51.268567+0000","last_undegraded":"2024-04-25T02:18:51.268567+0000","last_fullsized":"2024-04-25T02:18:51.268567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.879508+0000","last_change":"2024-04-25T02:19:05.879508+0000","last_active":"2024-04-25T02:19:05.879508+0000","last_peered":"2024-04-25T02:19:05.879508+0000","last_clean":"2024-04-25T02:19:05.879508+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:19:05.879508+0000","last_undegraded":"2024-04-25T02:19:05.879508+0000","last_fullsized":"2024-04-25T02:19:05.879508+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.879394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'626","reported_seq":1266,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.344141+0000","last_change":"2024-04-25T02:19:02.344141+0000","last_active":"2024-04-25T02:19:02.344141+0000","last_peered":"2024-04-25T02:19:02.344141+0000","last_clean":"2024-04-25T02:19:02.344141+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:19:02.344141+0000","last_undegraded":"2024-04-25T02:19:02.344141+0000","last_fullsized":"2024-04-25T02:19:02.344141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'626","last_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_deep_scrub":"19'626","last_deep_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.344043+0000","log_size":626,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1113626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":622,"num_write_kb":1507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'415","reported_seq":427,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.263065+0000","last_change":"2024-04-25T02:10:02.738756+0000","last_active":"2024-04-25T02:18:51.263065+0000","last_peered":"2024-04-25T02:18:51.263065+0000","last_clean":"2024-04-25T02:18:51.263065+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:18:51.263065+0000","last_undegraded":"2024-04-25T02:18:51.263065+0000","last_fullsized":"2024-04-25T02:18:51.263065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.840625+0000","last_change":"2024-04-25T02:19:08.840625+0000","last_active":"2024-04-25T02:19:08.840625+0000","last_peered":"2024-04-25T02:19:08.840625+0000","last_clean":"2024-04-25T02:19:08.840625+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:19:08.840625+0000","last_undegraded":"2024-04-25T02:19:08.840625+0000","last_fullsized":"2024-04-25T02:19:08.840625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.840520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'45","reported_seq":63,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.518176+0000","last_change":"2024-04-25T02:19:09.518176+0000","last_active":"2024-04-25T02:19:09.518176+0000","last_peered":"2024-04-25T02:19:09.518176+0000","last_clean":"2024-04-25T02:19:09.518176+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:19:09.518176+0000","last_undegraded":"2024-04-25T02:19:09.518176+0000","last_fullsized":"2024-04-25T02:19:09.518176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'45","last_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_deep_scrub":"19'45","last_deep_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.518059+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'343","reported_seq":355,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.271627+0000","last_change":"2024-04-25T02:10:02.727375+0000","last_active":"2024-04-25T02:18:51.271627+0000","last_peered":"2024-04-25T02:18:51.271627+0000","last_clean":"2024-04-25T02:18:51.271627+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:18:51.271627+0000","last_undegraded":"2024-04-25T02:18:51.271627+0000","last_fullsized":"2024-04-25T02:18:51.271627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'65","reported_seq":83,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.839509+0000","last_change":"2024-04-25T02:19:13.839509+0000","last_active":"2024-04-25T02:19:13.839509+0000","last_peered":"2024-04-25T02:19:13.839509+0000","last_clean":"2024-04-25T02:19:13.839509+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:19:13.839509+0000","last_undegraded":"2024-04-25T02:19:13.839509+0000","last_fullsized":"2024-04-25T02:19:13.839509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'65","last_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_deep_scrub":"19'65","last_deep_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.839408+0000","log_size":65,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:03.479134+0000","last_change":"2024-04-25T02:19:03.479134+0000","last_active":"2024-04-25T02:19:03.479134+0000","last_peered":"2024-04-25T02:19:03.479134+0000","last_clean":"2024-04-25T02:19:03.479134+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:19:03.479134+0000","last_undegraded":"2024-04-25T02:19:03.479134+0000","last_fullsized":"2024-04-25T02:19:03.479134+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_clean_scrub_stamp":"2024-04-25T02:19:03.479027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273457+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:18:51.273457+0000","last_peered":"2024-04-25T02:18:51.273457+0000","last_clean":"2024-04-25T02:18:51.273457+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:18:51.273457+0000","last_undegraded":"2024-04-25T02:18:51.273457+0000","last_fullsized":"2024-04-25T02:18:51.273457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:10.845393+0000","last_change":"2024-04-25T02:19:10.845393+0000","last_active":"2024-04-25T02:19:10.845393+0000","last_peered":"2024-04-25T02:19:10.845393+0000","last_clean":"2024-04-25T02:19:10.845393+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:19:10.845393+0000","last_undegraded":"2024-04-25T02:19:10.845393+0000","last_fullsized":"2024-04-25T02:19:10.845393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_clean_scrub_stamp":"2024-04-25T02:19:10.845259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'72","reported_seq":90,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.244226+0000","last_change":"2024-04-25T02:19:07.244226+0000","last_active":"2024-04-25T02:19:07.244226+0000","last_peered":"2024-04-25T02:19:07.244226+0000","last_clean":"2024-04-25T02:19:07.244226+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:19:07.244226+0000","last_undegraded":"2024-04-25T02:19:07.244226+0000","last_fullsized":"2024-04-25T02:19:07.244226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'72","last_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_deep_scrub":"19'72","last_deep_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.244087+0000","log_size":72,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'336","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.688927+0000","last_change":"2024-04-25T02:19:16.688927+0000","last_active":"2024-04-25T02:19:16.688927+0000","last_peered":"2024-04-25T02:19:16.688927+0000","last_clean":"2024-04-25T02:19:16.688927+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:19:16.688927+0000","last_undegraded":"2024-04-25T02:19:16.688927+0000","last_fullsized":"2024-04-25T02:19:16.688927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'336","last_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_deep_scrub":"19'336","last_deep_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.688815+0000","log_size":336,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'30","reported_seq":48,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:30.310189+0000","last_change":"2024-04-25T02:19:30.310189+0000","last_active":"2024-04-25T02:19:30.310189+0000","last_peered":"2024-04-25T02:19:30.310189+0000","last_clean":"2024-04-25T02:19:30.310189+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:19:30.310189+0000","last_undegraded":"2024-04-25T02:19:30.310189+0000","last_fullsized":"2024-04-25T02:19:30.310189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'30","last_scrub_stamp":"2024-04-25T02:19:30.310064+0000","last_deep_scrub":"19'30","last_deep_scrub_stamp":"2024-04-25T02:19:30.310064+0000","last_clean_scrub_stamp":"2024-04-25T02:19:30.310064+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:38.812597+0000","last_change":"2024-04-25T02:19:38.812597+0000","last_active":"2024-04-25T02:19:38.812597+0000","last_peered":"2024-04-25T02:19:38.812597+0000","last_clean":"2024-04-25T02:19:38.812597+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:19:38.812597+0000","last_undegraded":"2024-04-25T02:19:38.812597+0000","last_fullsized":"2024-04-25T02:19:38.812597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:38.812488+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:38.812488+0000","last_clean_scrub_stamp":"2024-04-25T02:19:38.812488+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'48","reported_seq":66,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.575977+0000","last_change":"2024-04-25T02:19:25.575977+0000","last_active":"2024-04-25T02:19:25.575977+0000","last_peered":"2024-04-25T02:19:25.575977+0000","last_clean":"2024-04-25T02:19:25.575977+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:19:25.575977+0000","last_undegraded":"2024-04-25T02:19:25.575977+0000","last_fullsized":"2024-04-25T02:19:25.575977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'48","last_scrub_stamp":"2024-04-25T02:19:25.575846+0000","last_deep_scrub":"19'48","last_deep_scrub_stamp":"2024-04-25T02:19:25.575846+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.575846+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'335","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:36.792418+0000","last_change":"2024-04-25T02:19:36.792418+0000","last_active":"2024-04-25T02:19:36.792418+0000","last_peered":"2024-04-25T02:19:36.792418+0000","last_clean":"2024-04-25T02:19:36.792418+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:19:36.792418+0000","last_undegraded":"2024-04-25T02:19:36.792418+0000","last_fullsized":"2024-04-25T02:19:36.792418+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'335","last_scrub_stamp":"2024-04-25T02:19:36.792293+0000","last_deep_scrub":"19'335","last_deep_scrub_stamp":"2024-04-25T02:19:36.792293+0000","last_clean_scrub_stamp":"2024-04-25T02:19:36.792293+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":2199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'244","reported_seq":257,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:48.342289+0000","last_change":"2024-04-25T02:10:02.373184+0000","last_active":"2024-04-25T02:18:48.342289+0000","last_peered":"2024-04-25T02:18:48.342289+0000","last_clean":"2024-04-25T02:18:48.342289+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:18:48.342289+0000","last_undegraded":"2024-04-25T02:18:48.342289+0000","last_fullsized":"2024-04-25T02:18:48.342289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":244,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'358","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:34.856685+0000","last_change":"2024-04-25T02:19:34.856685+0000","last_active":"2024-04-25T02:19:34.856685+0000","last_peered":"2024-04-25T02:19:34.856685+0000","last_clean":"2024-04-25T02:19:34.856685+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:19:34.856685+0000","last_undegraded":"2024-04-25T02:19:34.856685+0000","last_fullsized":"2024-04-25T02:19:34.856685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'358","last_scrub_stamp":"2024-04-25T02:19:34.856571+0000","last_deep_scrub":"19'358","last_deep_scrub_stamp":"2024-04-25T02:19:34.856571+0000","last_clean_scrub_stamp":"2024-04-25T02:19:34.856571+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'110","reported_seq":123,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:45.799634+0000","last_change":"2024-04-25T02:10:02.366176+0000","last_active":"2024-04-25T02:18:45.799634+0000","last_peered":"2024-04-25T02:18:45.799634+0000","last_clean":"2024-04-25T02:18:45.799634+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:18:45.799634+0000","last_undegraded":"2024-04-25T02:18:45.799634+0000","last_fullsized":"2024-04-25T02:18:45.799634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:01.331885+0000","last_clean_scrub_stamp":"2024-04-25T02:10:01.331885+0000","log_size":110,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'370","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280559+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:18:51.280559+0000","last_peered":"2024-04-25T02:18:51.280559+0000","last_clean":"2024-04-25T02:18:51.280559+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:18:51.280559+0000","last_undegraded":"2024-04-25T02:18:51.280559+0000","last_fullsized":"2024-04-25T02:18:51.280559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":370,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'58","reported_seq":76,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:33.337408+0000","last_change":"2024-04-25T02:19:33.337408+0000","last_active":"2024-04-25T02:19:33.337408+0000","last_peered":"2024-04-25T02:19:33.337408+0000","last_clean":"2024-04-25T02:19:33.337408+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:19:33.337408+0000","last_undegraded":"2024-04-25T02:19:33.337408+0000","last_fullsized":"2024-04-25T02:19:33.337408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'58","last_scrub_stamp":"2024-04-25T02:19:33.337308+0000","last_deep_scrub":"19'58","last_deep_scrub_stamp":"2024-04-25T02:19:33.337308+0000","last_clean_scrub_stamp":"2024-04-25T02:19:33.337308+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'414","reported_seq":431,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:32.829574+0000","last_change":"2024-04-25T02:19:32.829574+0000","last_active":"2024-04-25T02:19:32.829574+0000","last_peered":"2024-04-25T02:19:32.829574+0000","last_clean":"2024-04-25T02:19:32.829574+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:19:32.829574+0000","last_undegraded":"2024-04-25T02:19:32.829574+0000","last_fullsized":"2024-04-25T02:19:32.829574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'414","last_scrub_stamp":"2024-04-25T02:19:32.829454+0000","last_deep_scrub":"19'414","last_deep_scrub_stamp":"2024-04-25T02:19:32.829454+0000","last_clean_scrub_stamp":"2024-04-25T02:19:32.829454+0000","log_size":414,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'413","reported_seq":425,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281808+0000","last_change":"2024-04-25T02:10:02.732802+0000","last_active":"2024-04-25T02:18:51.281808+0000","last_peered":"2024-04-25T02:18:51.281808+0000","last_clean":"2024-04-25T02:18:51.281808+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:18:51.281808+0000","last_undegraded":"2024-04-25T02:18:51.281808+0000","last_fullsized":"2024-04-25T02:18:51.281808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":413,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":2919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276676+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:18:51.276676+0000","last_peered":"2024-04-25T02:18:51.276676+0000","last_clean":"2024-04-25T02:18:51.276676+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:18:51.276676+0000","last_undegraded":"2024-04-25T02:18:51.276676+0000","last_fullsized":"2024-04-25T02:18:51.276676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":3172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'394","reported_seq":406,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.251643+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:18:51.251643+0000","last_peered":"2024-04-25T02:18:51.251643+0000","last_clean":"2024-04-25T02:18:51.251643+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:18:51.251643+0000","last_undegraded":"2024-04-25T02:18:51.251643+0000","last_fullsized":"2024-04-25T02:18:51.251643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":394,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.259897+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:18:51.259897+0000","last_peered":"2024-04-25T02:18:51.259897+0000","last_clean":"2024-04-25T02:18:51.259897+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:18:51.259897+0000","last_undegraded":"2024-04-25T02:18:51.259897+0000","last_fullsized":"2024-04-25T02:18:51.259897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.281654+0000","last_change":"2024-04-25T02:10:02.732821+0000","last_active":"2024-04-25T02:18:51.281654+0000","last_peered":"2024-04-25T02:18:51.281654+0000","last_clean":"2024-04-25T02:18:51.281654+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:18:51.281654+0000","last_undegraded":"2024-04-25T02:18:51.281654+0000","last_fullsized":"2024-04-25T02:18:51.281654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":167505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23216,"ondisk_log_size":23216,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":3994,"num_write_kb":199381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":450,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316645376,"data_stored":316588690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3928,"ondisk_log_size":3928,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705785,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370056,"kb_used_data":72832,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94001784,"statfs":{"total":96636764160,"available":96257826816,"internally_reserved":0,"allocated":74579968,"data_stored":74464209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.23799999999999999,"15min":0.26800000000000002},"min":{"1min":0.156,"5min":0.156,"15min":0.14599999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.253,"15min":0.29299999999999998},"min":{"1min":0.17599999999999999,"5min":0.16500000000000001,"15min":0.16300000000000001},"max":{"1min":0.45900000000000002,"5min":0.50900000000000001,"15min":0.53400000000000003},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.27600000000000002,"5min":0.26400000000000001,"15min":0.29899999999999999},"min":{"1min":0.19,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.45200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.29999999999999999},"min":{"1min":0.192,"5min":0.186,"15min":0.186},"max":{"1min":0.441,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.25600000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.28899999999999998,"15min":0.32500000000000001},"min":{"1min":0.223,"5min":0.192,"15min":0.192},"max":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":0.47899999999999998,"5min":0.628,"15min":0.628},"last":0.29399999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705784,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405844,"kb_used_data":100428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93965996,"statfs":{"total":96636764160,"available":96221179904,"internally_reserved":0,"allocated":102838272,"data_stored":102710905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.28599999999999998},"min":{"1min":0.182,"5min":0.13200000000000001,"15min":0.13200000000000001},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.49299999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.252,"15min":0.29399999999999998},"min":{"1min":0.19500000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.315},"min":{"1min":0.182,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.314},{"interface":"front","average":{"1min":0.307,"5min":0.27400000000000002,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.53400000000000003},"last":0.253}]},{"osd":2,"last update":"Thu Apr 25 02:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.32800000000000001},"min":{"1min":0.22,"5min":0.186,"15min":0.186},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.496,"5min":0.496,"15min":0.51900000000000002},"last":0.33900000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705784,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364024,"kb_used_data":66800,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94007816,"statfs":{"total":96636764160,"available":96264003584,"internally_reserved":0,"allocated":68403200,"data_stored":68279904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:19:15 2024","interfaces":[{"interface":"back","average":{"1min":2.452,"5min":0.66600000000000004,"15min":0.43099999999999999},"min":{"1min":0.19400000000000001,"5min":0.156,"15min":0.14399999999999999},"max":{"1min":34.734000000000002,"5min":34.734000000000002,"15min":34.734000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.32700000000000001,"15min":0.32200000000000001},"min":{"1min":0.20699999999999999,"5min":0.16700000000000001,"15min":0.16300000000000001},"max":{"1min":4.8769999999999998,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.39300000000000002,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":9.0670000000000002,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.39400000000000002,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.192,"15min":0.192},"max":{"1min":9.2899999999999991,"5min":9.2899999999999991,"15min":9.2899999999999991},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:19:15 2024","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":0.66500000000000004,"15min":0.45900000000000002},"min":{"1min":0.252,"5min":0.182,"15min":0.182},"max":{"1min":29.867999999999999,"5min":29.867999999999999,"15min":29.867999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":1.6060000000000001,"5min":0.54200000000000004,"15min":0.40999999999999998},"min":{"1min":0.26000000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":20.276,"5min":20.276,"15min":20.276},"last":0.40899999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705785,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371124,"kb_used_data":69804,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94000716,"statfs":{"total":96636764160,"available":96256733184,"internally_reserved":0,"allocated":71479296,"data_stored":71360528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.224,"15min":0.27100000000000002},"min":{"1min":0.16600000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.246,"15min":0.28899999999999998},"min":{"1min":0.191,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.311},"min":{"1min":0.20599999999999999,"5min":0.154,"15min":0.153},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.57799999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.28599999999999998,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.317}]},{"osd":3,"last update":"Thu Apr 25 02:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.27300000000000002,"15min":0.31},"min":{"1min":0.22700000000000001,"5min":0.17999999999999999,"15min":0.17799999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.28399999999999997,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.308}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68239360,"data_stored":68223190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74416128,"data_stored":74407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102674432,"data_stored":102654191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:19:42.984 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.984 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.985 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.985 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.985 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.985 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.985 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.985 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.985 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.985 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.985 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.986 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.986 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.986 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.986 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.986 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.986 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.986 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.986 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.986 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.987 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.987 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.987 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.987 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.987 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.987 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.987 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.987 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.987 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.988 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.988 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.988 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.988 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.988 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.988 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.988 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.988 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.989 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.989 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.989 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.989 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.989 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.989 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.990 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.990 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T02:10:01.331885+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.990 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.990 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.990 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.990 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.990 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.990 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:19:42.991 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:20:02.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:20:03.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.118+0000 7f84b6c6a700 1 Processor -- start 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.118+0000 7f84b6c6a700 1 -- start start 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b6c6a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84b0124000 0x7f84b00961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b6c6a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b00937a0 0x7f84b01243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b6c6a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0127990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b6c6a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b0096cf0 con 0x7f84b0124000 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b6c6a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0093ba0 con 0x7f84b00937a0 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b6c6a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0092d00 con 0x7f84b01274e0 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b5207700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84affff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b00937a0 0x7f84b01243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b4a06700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84b0124000 0x7f84b00961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b4a06700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84b0124000 0x7f84b00961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45052/0 (socket says 172.21.15.78:45052) 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b5207700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0127990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:55074/0 (socket says 172.21.15.78:55074) 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84affff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b00937a0 0x7f84b01243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:34334/0 (socket says 172.21.15.78:34334) 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b4a06700 1 -- 172.21.15.78:0/2985213442 learned_addr learned my addr 172.21.15.78:0/2985213442 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b5207700 1 -- 172.21.15.78:0/2985213442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b00937a0 msgr2=0x7f84b01243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b5207700 1 --2- 172.21.15.78:0/2985213442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b00937a0 0x7f84b01243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b5207700 1 -- 172.21.15.78:0/2985213442 >> v2:172.21.15.78:3300/0 conn(0x7f84b0124000 msgr2=0x7f84b00961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b5207700 1 --2- 172.21.15.78:0/2985213442 >> v2:172.21.15.78:3300/0 conn(0x7f84b0124000 0x7f84b00961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b5207700 1 -- 172.21.15.78:0/2985213442 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00933a0 con 0x7f84b01274e0 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b4a06700 1 --2- 172.21.15.78:0/2985213442 >> v2:172.21.15.78:3300/0 conn(0x7f84b0124000 0x7f84b00961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84affff700 1 --2- 172.21.15.78:0/2985213442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b00937a0 0x7f84b01243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84b5207700 1 --2- 172.21.15.78:0/2985213442 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0127990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f84a800f330 tx=0x7f84a800db90).ready entity=mon.2 client_cookie=f2cb637c42b742ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84af7fe700 1 -- 172.21.15.78:0/2985213442 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8012070 con 0x7f84b01274e0 2024-04-25T02:20:03.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84af7fe700 1 -- 172.21.15.78:0/2985213442 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a800fe70 con 0x7f84b01274e0 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.119+0000 7f84af7fe700 1 -- 172.21.15.78:0/2985213442 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a800d2e0 con 0x7f84b01274e0 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.120+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2985213442 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 msgr2=0x7f84b0127990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.120+0000 7f84b6c6a700 1 --2- 172.21.15.78:0/2985213442 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0127990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f84a800f330 tx=0x7f84a800db90).stop 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.120+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2985213442 shutdown_connections 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.120+0000 7f84b6c6a700 1 --2- 172.21.15.78:0/2985213442 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0127990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.120+0000 7f84b6c6a700 1 --2- 172.21.15.78:0/2985213442 >> v2:172.21.15.78:3300/0 conn(0x7f84b0124000 0x7f84b00961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.120+0000 7f84b6c6a700 1 --2- 172.21.15.78:0/2985213442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b00937a0 0x7f84b01243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.120+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2985213442 >> 172.21.15.78:0/2985213442 conn(0x7f84b0097450 msgr2=0x7f84b0097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.120+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2985213442 shutdown_connections 2024-04-25T02:20:03.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.120+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2985213442 wait complete. 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.121+0000 7f84b6c6a700 1 Processor -- start 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.121+0000 7f84b6c6a700 1 -- start start 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b6c6a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b00937a0 0x7f84b0112e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b6c6a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b0124000 0x7f84b0068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b6c6a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b6c6a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0113540 con 0x7f84b00937a0 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b6c6a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0095210 con 0x7f84b0124000 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b6c6a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0092440 con 0x7f84b01274e0 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b4a06700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b00937a0 0x7f84b0112e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b4a06700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b00937a0 0x7f84b0112e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45062/0 (socket says 172.21.15.78:45062) 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b4a06700 1 -- 172.21.15.78:0/2902744185 learned_addr learned my addr 172.21.15.78:0/2902744185 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:03.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84affff700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b0124000 0x7f84b0068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b5207700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b4a06700 1 -- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 msgr2=0x7f84b0068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b4a06700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b4a06700 1 -- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b0124000 msgr2=0x7f84b0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b4a06700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b0124000 0x7f84b0068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b4a06700 1 -- 172.21.15.78:0/2902744185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c0092a0 con 0x7f84b00937a0 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84affff700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b0124000 0x7f84b0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b5207700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b4a06700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b00937a0 0x7f84b0112e60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f84a400fe50 tx=0x7f84a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84ad7fa700 1 -- 172.21.15.78:0/2902744185 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400be40 con 0x7f84b00937a0 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84ad7fa700 1 -- 172.21.15.78:0/2902744185 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a400dd30 con 0x7f84b00937a0 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a400b420 con 0x7f84b00937a0 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84ad7fa700 1 -- 172.21.15.78:0/2902744185 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400dea0 con 0x7f84b00937a0 2024-04-25T02:20:03.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.122+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a800de30 con 0x7f84b00937a0 2024-04-25T02:20:03.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.123+0000 7f84ad7fa700 1 -- 172.21.15.78:0/2902744185 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f84a4016070 con 0x7f84b00937a0 2024-04-25T02:20:03.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.123+0000 7f84ad7fa700 1 -- 172.21.15.78:0/2902744185 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f84a403b8d0 con 0x7f84b00937a0 2024-04-25T02:20:03.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.123+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b0097f70 con 0x7f84b00937a0 2024-04-25T02:20:03.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.128+0000 7f84ad7fa700 1 -- 172.21.15.78:0/2902744185 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f84a40223f0 con 0x7f84b00937a0 2024-04-25T02:20:03.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.285+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84b0091b30 con 0x7f849402bd00 2024-04-25T02:20:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.291+0000 7f84ad7fa700 1 -- 172.21.15.78:0/2902744185 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256823 (unknown 2965378022 0 3497476634) 0x7f84b0091b30 con 0x7f849402bd00 2024-04-25T02:20:03.298 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:20:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 >> v1:172.21.15.78:6816/46507 conn(0x7f849402bd00 legacy=0x7f849402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b00937a0 msgr2=0x7f84b0112e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b00937a0 0x7f84b0112e60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f84a400fe50 tx=0x7f84a4008040).stop 2024-04-25T02:20:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 shutdown_connections 2024-04-25T02:20:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f84b01274e0 0x7f84b0068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84b00937a0 0x7f84b0112e60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 --2- 172.21.15.78:0/2902744185 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84b0124000 0x7f84b0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 >> 172.21.15.78:0/2902744185 conn(0x7f84b0097450 msgr2=0x7f84b00641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 shutdown_connections 2024-04-25T02:20:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:03.294+0000 7f84b6c6a700 1 -- 172.21.15.78:0/2902744185 wait complete. 2024-04-25T02:20:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:20:03.310 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-04-25T02:20:02.319754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":27629,"num_write_kb":366886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5330,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27158,"ondisk_log_size":27158,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1511048,"kb_used_data":309864,"kb_used_omap":0,"kb_used_meta":1201152,"kb_avail":375976312,"statfs":{"total":386547056640,"available":384999743488,"internally_reserved":0,"allocated":317300736,"data_stored":316815546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1229979648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002930"},"pg_stats":[{"pgid":"4.3f","version":"19'354","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:52.933304+0000","last_change":"2024-04-25T02:19:52.933304+0000","last_active":"2024-04-25T02:19:52.933304+0000","last_peered":"2024-04-25T02:19:52.933304+0000","last_clean":"2024-04-25T02:19:52.933304+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:19:52.933304+0000","last_undegraded":"2024-04-25T02:19:52.933304+0000","last_fullsized":"2024-04-25T02:19:52.933304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'354","last_scrub_stamp":"2024-04-25T02:19:52.933192+0000","last_deep_scrub":"19'354","last_deep_scrub_stamp":"2024-04-25T02:19:52.933192+0000","last_clean_scrub_stamp":"2024-04-25T02:19:52.933192+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'368","reported_seq":385,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:50.924366+0000","last_change":"2024-04-25T02:19:50.924366+0000","last_active":"2024-04-25T02:19:50.924366+0000","last_peered":"2024-04-25T02:19:50.924366+0000","last_clean":"2024-04-25T02:19:50.924366+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:19:50.924366+0000","last_undegraded":"2024-04-25T02:19:50.924366+0000","last_fullsized":"2024-04-25T02:19:50.924366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'368","last_scrub_stamp":"2024-04-25T02:19:50.924244+0000","last_deep_scrub":"19'368","last_deep_scrub_stamp":"2024-04-25T02:19:50.924244+0000","last_clean_scrub_stamp":"2024-04-25T02:19:50.924244+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267056+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:18:51.267056+0000","last_peered":"2024-04-25T02:18:51.267056+0000","last_clean":"2024-04-25T02:18:51.267056+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:18:51.267056+0000","last_undegraded":"2024-04-25T02:18:51.267056+0000","last_fullsized":"2024-04-25T02:18:51.267056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267040+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:18:51.267040+0000","last_peered":"2024-04-25T02:18:51.267040+0000","last_clean":"2024-04-25T02:18:51.267040+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:18:51.267040+0000","last_undegraded":"2024-04-25T02:18:51.267040+0000","last_fullsized":"2024-04-25T02:18:51.267040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269216+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:18:51.269216+0000","last_peered":"2024-04-25T02:18:51.269216+0000","last_clean":"2024-04-25T02:18:51.269216+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:18:51.269216+0000","last_undegraded":"2024-04-25T02:18:51.269216+0000","last_fullsized":"2024-04-25T02:18:51.269216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278782+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:18:51.278782+0000","last_peered":"2024-04-25T02:18:51.278782+0000","last_clean":"2024-04-25T02:18:51.278782+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:18:51.278782+0000","last_undegraded":"2024-04-25T02:18:51.278782+0000","last_fullsized":"2024-04-25T02:18:51.278782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'376","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272984+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:18:51.272984+0000","last_peered":"2024-04-25T02:18:51.272984+0000","last_clean":"2024-04-25T02:18:51.272984+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:18:51.272984+0000","last_undegraded":"2024-04-25T02:18:51.272984+0000","last_fullsized":"2024-04-25T02:18:51.272984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":376,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":3216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'297","reported_seq":309,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272124+0000","last_change":"2024-04-25T02:10:02.732293+0000","last_active":"2024-04-25T02:18:51.272124+0000","last_peered":"2024-04-25T02:18:51.272124+0000","last_clean":"2024-04-25T02:18:51.272124+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:18:51.272124+0000","last_undegraded":"2024-04-25T02:18:51.272124+0000","last_fullsized":"2024-04-25T02:18:51.272124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":297,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":2172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'371","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269598+0000","last_change":"2024-04-25T02:10:02.748047+0000","last_active":"2024-04-25T02:18:51.269598+0000","last_peered":"2024-04-25T02:18:51.269598+0000","last_clean":"2024-04-25T02:18:51.269598+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:18:51.269598+0000","last_undegraded":"2024-04-25T02:18:51.269598+0000","last_fullsized":"2024-04-25T02:18:51.269598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'351","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267201+0000","last_change":"2024-04-25T02:10:02.730087+0000","last_active":"2024-04-25T02:18:51.267201+0000","last_peered":"2024-04-25T02:18:51.267201+0000","last_clean":"2024-04-25T02:18:51.267201+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:18:51.267201+0000","last_undegraded":"2024-04-25T02:18:51.267201+0000","last_fullsized":"2024-04-25T02:18:51.267201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.256733+0000","last_change":"2024-04-25T02:10:02.730064+0000","last_active":"2024-04-25T02:18:51.256733+0000","last_peered":"2024-04-25T02:18:51.256733+0000","last_clean":"2024-04-25T02:18:51.256733+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:18:51.256733+0000","last_undegraded":"2024-04-25T02:18:51.256733+0000","last_fullsized":"2024-04-25T02:18:51.256733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":2530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'322","reported_seq":339,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:49.936957+0000","last_change":"2024-04-25T02:19:49.936957+0000","last_active":"2024-04-25T02:19:49.936957+0000","last_peered":"2024-04-25T02:19:49.936957+0000","last_clean":"2024-04-25T02:19:49.936957+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:19:49.936957+0000","last_undegraded":"2024-04-25T02:19:49.936957+0000","last_fullsized":"2024-04-25T02:19:49.936957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'322","last_scrub_stamp":"2024-04-25T02:19:49.936817+0000","last_deep_scrub":"19'322","last_deep_scrub_stamp":"2024-04-25T02:19:49.936817+0000","last_clean_scrub_stamp":"2024-04-25T02:19:49.936817+0000","log_size":322,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'359","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:48.915067+0000","last_change":"2024-04-25T02:19:48.915067+0000","last_active":"2024-04-25T02:19:48.915067+0000","last_peered":"2024-04-25T02:19:48.915067+0000","last_clean":"2024-04-25T02:19:48.915067+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:19:48.915067+0000","last_undegraded":"2024-04-25T02:19:48.915067+0000","last_fullsized":"2024-04-25T02:19:48.915067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'359","last_scrub_stamp":"2024-04-25T02:19:48.914957+0000","last_deep_scrub":"19'359","last_deep_scrub_stamp":"2024-04-25T02:19:48.914957+0000","last_clean_scrub_stamp":"2024-04-25T02:19:48.914957+0000","log_size":359,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":2645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'371","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:00.497023+0000","last_change":"2024-04-25T02:20:00.497023+0000","last_active":"2024-04-25T02:20:00.497023+0000","last_peered":"2024-04-25T02:20:00.497023+0000","last_clean":"2024-04-25T02:20:00.497023+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:20:00.497023+0000","last_undegraded":"2024-04-25T02:20:00.497023+0000","last_fullsized":"2024-04-25T02:20:00.497023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'371","last_scrub_stamp":"2024-04-25T02:20:00.496897+0000","last_deep_scrub":"19'371","last_deep_scrub_stamp":"2024-04-25T02:20:00.496897+0000","last_clean_scrub_stamp":"2024-04-25T02:20:00.496897+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'363","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253088+0000","last_change":"2024-04-25T02:10:02.732577+0000","last_active":"2024-04-25T02:18:51.253088+0000","last_peered":"2024-04-25T02:18:51.253088+0000","last_clean":"2024-04-25T02:18:51.253088+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:18:51.253088+0000","last_undegraded":"2024-04-25T02:18:51.253088+0000","last_fullsized":"2024-04-25T02:18:51.253088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'380","reported_seq":394,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:42.871312+0000","last_change":"2024-04-25T02:19:42.871312+0000","last_active":"2024-04-25T02:19:42.871312+0000","last_peered":"2024-04-25T02:19:42.871312+0000","last_clean":"2024-04-25T02:19:42.871312+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:19:42.871312+0000","last_undegraded":"2024-04-25T02:19:42.871312+0000","last_fullsized":"2024-04-25T02:19:42.871312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'380","last_scrub_stamp":"2024-04-25T02:19:42.871220+0000","last_deep_scrub":"19'380","last_deep_scrub_stamp":"2024-04-25T02:19:42.871220+0000","last_clean_scrub_stamp":"2024-04-25T02:19:42.871220+0000","log_size":380,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"19'367","reported_seq":379,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.264403+0000","last_change":"2024-04-25T02:10:02.748055+0000","last_active":"2024-04-25T02:18:51.264403+0000","last_peered":"2024-04-25T02:18:51.264403+0000","last_clean":"2024-04-25T02:18:51.264403+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:18:51.264403+0000","last_undegraded":"2024-04-25T02:18:51.264403+0000","last_fullsized":"2024-04-25T02:18:51.264403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'340","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.253849+0000","last_change":"2024-04-25T02:10:02.727747+0000","last_active":"2024-04-25T02:18:51.253849+0000","last_peered":"2024-04-25T02:18:51.253849+0000","last_clean":"2024-04-25T02:18:51.253849+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:18:51.253849+0000","last_undegraded":"2024-04-25T02:18:51.253849+0000","last_fullsized":"2024-04-25T02:18:51.253849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'356","reported_seq":373,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:40.854714+0000","last_change":"2024-04-25T02:19:40.854714+0000","last_active":"2024-04-25T02:19:40.854714+0000","last_peered":"2024-04-25T02:19:40.854714+0000","last_clean":"2024-04-25T02:19:40.854714+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:19:40.854714+0000","last_undegraded":"2024-04-25T02:19:40.854714+0000","last_fullsized":"2024-04-25T02:19:40.854714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'356","last_scrub_stamp":"2024-04-25T02:19:40.854586+0000","last_deep_scrub":"19'356","last_deep_scrub_stamp":"2024-04-25T02:19:40.854586+0000","last_clean_scrub_stamp":"2024-04-25T02:19:40.854586+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'401","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:59.508453+0000","last_change":"2024-04-25T02:19:59.508453+0000","last_active":"2024-04-25T02:19:59.508453+0000","last_peered":"2024-04-25T02:19:59.508453+0000","last_clean":"2024-04-25T02:19:59.508453+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:19:59.508453+0000","last_undegraded":"2024-04-25T02:19:59.508453+0000","last_fullsized":"2024-04-25T02:19:59.508453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'401","last_scrub_stamp":"2024-04-25T02:19:59.508346+0000","last_deep_scrub":"19'401","last_deep_scrub_stamp":"2024-04-25T02:19:59.508346+0000","last_clean_scrub_stamp":"2024-04-25T02:19:59.508346+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'344","reported_seq":358,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:39.836256+0000","last_change":"2024-04-25T02:19:39.836256+0000","last_active":"2024-04-25T02:19:39.836256+0000","last_peered":"2024-04-25T02:19:39.836256+0000","last_clean":"2024-04-25T02:19:39.836256+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:19:39.836256+0000","last_undegraded":"2024-04-25T02:19:39.836256+0000","last_fullsized":"2024-04-25T02:19:39.836256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'344","last_scrub_stamp":"2024-04-25T02:19:39.836145+0000","last_deep_scrub":"19'344","last_deep_scrub_stamp":"2024-04-25T02:19:39.836145+0000","last_clean_scrub_stamp":"2024-04-25T02:19:39.836145+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'383","reported_seq":395,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267045+0000","last_change":"2024-04-25T02:10:02.731846+0000","last_active":"2024-04-25T02:18:51.267045+0000","last_peered":"2024-04-25T02:18:51.267045+0000","last_clean":"2024-04-25T02:18:51.267045+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:18:51.267045+0000","last_undegraded":"2024-04-25T02:18:51.267045+0000","last_fullsized":"2024-04-25T02:18:51.267045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":2481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'350","reported_seq":362,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273435+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:18:51.273435+0000","last_peered":"2024-04-25T02:18:51.273435+0000","last_clean":"2024-04-25T02:18:51.273435+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:18:51.273435+0000","last_undegraded":"2024-04-25T02:18:51.273435+0000","last_fullsized":"2024-04-25T02:18:51.273435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":350,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'367","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:55.557095+0000","last_change":"2024-04-25T02:19:55.557095+0000","last_active":"2024-04-25T02:19:55.557095+0000","last_peered":"2024-04-25T02:19:55.557095+0000","last_clean":"2024-04-25T02:19:55.557095+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:19:55.557095+0000","last_undegraded":"2024-04-25T02:19:55.557095+0000","last_fullsized":"2024-04-25T02:19:55.557095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'367","last_scrub_stamp":"2024-04-25T02:19:55.556990+0000","last_deep_scrub":"19'367","last_deep_scrub_stamp":"2024-04-25T02:19:55.556990+0000","last_clean_scrub_stamp":"2024-04-25T02:19:55.556990+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'386","reported_seq":403,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:54.545557+0000","last_change":"2024-04-25T02:19:54.545557+0000","last_active":"2024-04-25T02:19:54.545557+0000","last_peered":"2024-04-25T02:19:54.545557+0000","last_clean":"2024-04-25T02:19:54.545557+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:19:54.545557+0000","last_undegraded":"2024-04-25T02:19:54.545557+0000","last_fullsized":"2024-04-25T02:19:54.545557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'386","last_scrub_stamp":"2024-04-25T02:19:54.545439+0000","last_deep_scrub":"19'386","last_deep_scrub_stamp":"2024-04-25T02:19:54.545439+0000","last_clean_scrub_stamp":"2024-04-25T02:19:54.545439+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'421","reported_seq":438,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:51.548406+0000","last_change":"2024-04-25T02:19:51.548406+0000","last_active":"2024-04-25T02:19:51.548406+0000","last_peered":"2024-04-25T02:19:51.548406+0000","last_clean":"2024-04-25T02:19:51.548406+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:19:51.548406+0000","last_undegraded":"2024-04-25T02:19:51.548406+0000","last_fullsized":"2024-04-25T02:19:51.548406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'421","last_scrub_stamp":"2024-04-25T02:19:51.548298+0000","last_deep_scrub":"19'421","last_deep_scrub_stamp":"2024-04-25T02:19:51.548298+0000","last_clean_scrub_stamp":"2024-04-25T02:19:51.548298+0000","log_size":421,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268411+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:18:51.268411+0000","last_peered":"2024-04-25T02:18:51.268411+0000","last_clean":"2024-04-25T02:18:51.268411+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:18:51.268411+0000","last_undegraded":"2024-04-25T02:18:51.268411+0000","last_fullsized":"2024-04-25T02:18:51.268411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'157","reported_seq":175,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:22.516024+0000","last_change":"2024-04-25T02:19:22.516024+0000","last_active":"2024-04-25T02:19:22.516024+0000","last_peered":"2024-04-25T02:19:22.516024+0000","last_clean":"2024-04-25T02:19:22.516024+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:19:22.516024+0000","last_undegraded":"2024-04-25T02:19:22.516024+0000","last_fullsized":"2024-04-25T02:19:22.516024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'157","last_scrub_stamp":"2024-04-25T02:19:22.515900+0000","last_deep_scrub":"19'157","last_deep_scrub_stamp":"2024-04-25T02:19:22.515900+0000","last_clean_scrub_stamp":"2024-04-25T02:19:22.515900+0000","log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":16455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'334","reported_seq":346,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272426+0000","last_change":"2024-04-25T02:10:02.732829+0000","last_active":"2024-04-25T02:18:51.272426+0000","last_peered":"2024-04-25T02:18:51.272426+0000","last_clean":"2024-04-25T02:18:51.272426+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:18:51.272426+0000","last_undegraded":"2024-04-25T02:18:51.272426+0000","last_fullsized":"2024-04-25T02:18:51.272426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":334,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'77","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.512649+0000","last_change":"2024-04-25T02:19:19.512649+0000","last_active":"2024-04-25T02:19:19.512649+0000","last_peered":"2024-04-25T02:19:19.512649+0000","last_clean":"2024-04-25T02:19:19.512649+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:19:19.512649+0000","last_undegraded":"2024-04-25T02:19:19.512649+0000","last_fullsized":"2024-04-25T02:19:19.512649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'77","last_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_deep_scrub":"19'77","last_deep_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.512541+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'347","reported_seq":364,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:59.343505+0000","last_change":"2024-04-25T02:19:59.343505+0000","last_active":"2024-04-25T02:19:59.343505+0000","last_peered":"2024-04-25T02:19:59.343505+0000","last_clean":"2024-04-25T02:19:59.343505+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:19:59.343505+0000","last_undegraded":"2024-04-25T02:19:59.343505+0000","last_fullsized":"2024-04-25T02:19:59.343505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'347","last_scrub_stamp":"2024-04-25T02:19:59.343384+0000","last_deep_scrub":"19'347","last_deep_scrub_stamp":"2024-04-25T02:19:59.343384+0000","last_clean_scrub_stamp":"2024-04-25T02:19:59.343384+0000","log_size":347,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'246","reported_seq":264,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:52.823739+0000","last_change":"2024-04-25T02:19:52.823739+0000","last_active":"2024-04-25T02:19:52.823739+0000","last_peered":"2024-04-25T02:19:52.823739+0000","last_clean":"2024-04-25T02:19:52.823739+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:19:52.823739+0000","last_undegraded":"2024-04-25T02:19:52.823739+0000","last_fullsized":"2024-04-25T02:19:52.823739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'246","last_scrub_stamp":"2024-04-25T02:19:52.823636+0000","last_deep_scrub":"19'246","last_deep_scrub_stamp":"2024-04-25T02:19:52.823636+0000","last_clean_scrub_stamp":"2024-04-25T02:19:52.823636+0000","log_size":246,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'333","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.270570+0000","last_change":"2024-04-25T02:10:02.744274+0000","last_active":"2024-04-25T02:18:51.270570+0000","last_peered":"2024-04-25T02:18:51.270570+0000","last_clean":"2024-04-25T02:18:51.270570+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:18:51.270570+0000","last_undegraded":"2024-04-25T02:18:51.270570+0000","last_fullsized":"2024-04-25T02:18:51.270570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'6","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.290157+0000","last_change":"2024-04-25T02:19:27.290157+0000","last_active":"2024-04-25T02:19:27.290157+0000","last_peered":"2024-04-25T02:19:27.290157+0000","last_clean":"2024-04-25T02:19:27.290157+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:19:27.290157+0000","last_undegraded":"2024-04-25T02:19:27.290157+0000","last_fullsized":"2024-04-25T02:19:27.290157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-25T02:19:27.290042+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-25T02:19:27.290042+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.290042+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'377","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273185+0000","last_change":"2024-04-25T02:10:02.731876+0000","last_active":"2024-04-25T02:18:51.273185+0000","last_peered":"2024-04-25T02:18:51.273185+0000","last_clean":"2024-04-25T02:18:51.273185+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:18:51.273185+0000","last_undegraded":"2024-04-25T02:18:51.273185+0000","last_fullsized":"2024-04-25T02:18:51.273185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":377,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":2757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'81","reported_seq":99,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:15.705733+0000","last_change":"2024-04-25T02:19:15.705733+0000","last_active":"2024-04-25T02:19:15.705733+0000","last_peered":"2024-04-25T02:19:15.705733+0000","last_clean":"2024-04-25T02:19:15.705733+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:19:15.705733+0000","last_undegraded":"2024-04-25T02:19:15.705733+0000","last_fullsized":"2024-04-25T02:19:15.705733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'81","last_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_deep_scrub":"19'81","last_deep_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_clean_scrub_stamp":"2024-04-25T02:19:15.705635+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6184361,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'412","reported_seq":424,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273256+0000","last_change":"2024-04-25T02:10:02.740903+0000","last_active":"2024-04-25T02:18:51.273256+0000","last_peered":"2024-04-25T02:18:51.273256+0000","last_clean":"2024-04-25T02:18:51.273256+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:18:51.273256+0000","last_undegraded":"2024-04-25T02:18:51.273256+0000","last_fullsized":"2024-04-25T02:18:51.273256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":412,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'364","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.364468+0000","last_change":"2024-04-25T02:19:25.364468+0000","last_active":"2024-04-25T02:19:25.364468+0000","last_peered":"2024-04-25T02:19:25.364468+0000","last_clean":"2024-04-25T02:19:25.364468+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:19:25.364468+0000","last_undegraded":"2024-04-25T02:19:25.364468+0000","last_fullsized":"2024-04-25T02:19:25.364468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'364","last_scrub_stamp":"2024-04-25T02:19:25.364369+0000","last_deep_scrub":"19'364","last_deep_scrub_stamp":"2024-04-25T02:19:25.364369+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.364369+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'363","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:42.550756+0000","last_change":"2024-04-25T02:19:42.550756+0000","last_active":"2024-04-25T02:19:42.550756+0000","last_peered":"2024-04-25T02:19:42.550756+0000","last_clean":"2024-04-25T02:19:42.550756+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:19:42.550756+0000","last_undegraded":"2024-04-25T02:19:42.550756+0000","last_fullsized":"2024-04-25T02:19:42.550756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'363","last_scrub_stamp":"2024-04-25T02:19:42.550634+0000","last_deep_scrub":"19'363","last_deep_scrub_stamp":"2024-04-25T02:19:42.550634+0000","last_clean_scrub_stamp":"2024-04-25T02:19:42.550634+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'310","reported_seq":328,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:44.851470+0000","last_change":"2024-04-25T02:19:44.851470+0000","last_active":"2024-04-25T02:19:44.851470+0000","last_peered":"2024-04-25T02:19:44.851470+0000","last_clean":"2024-04-25T02:19:44.851470+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:19:44.851470+0000","last_undegraded":"2024-04-25T02:19:44.851470+0000","last_fullsized":"2024-04-25T02:19:44.851470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'310","last_scrub_stamp":"2024-04-25T02:19:44.851352+0000","last_deep_scrub":"19'310","last_deep_scrub_stamp":"2024-04-25T02:19:44.851352+0000","last_clean_scrub_stamp":"2024-04-25T02:19:44.851352+0000","log_size":310,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8389252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":12434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'364","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:26.735843+0000","last_change":"2024-04-25T02:19:26.735843+0000","last_active":"2024-04-25T02:19:26.735843+0000","last_peered":"2024-04-25T02:19:26.735843+0000","last_clean":"2024-04-25T02:19:26.735843+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:19:26.735843+0000","last_undegraded":"2024-04-25T02:19:26.735843+0000","last_fullsized":"2024-04-25T02:19:26.735843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'364","last_scrub_stamp":"2024-04-25T02:19:26.735719+0000","last_deep_scrub":"19'364","last_deep_scrub_stamp":"2024-04-25T02:19:26.735719+0000","last_clean_scrub_stamp":"2024-04-25T02:19:26.735719+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'129","reported_seq":147,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:43.842800+0000","last_change":"2024-04-25T02:19:43.842800+0000","last_active":"2024-04-25T02:19:43.842800+0000","last_peered":"2024-04-25T02:19:43.842800+0000","last_clean":"2024-04-25T02:19:43.842800+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:19:43.842800+0000","last_undegraded":"2024-04-25T02:19:43.842800+0000","last_fullsized":"2024-04-25T02:19:43.842800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'129","last_scrub_stamp":"2024-04-25T02:19:43.842706+0000","last_deep_scrub":"19'129","last_deep_scrub_stamp":"2024-04-25T02:19:43.842706+0000","last_clean_scrub_stamp":"2024-04-25T02:19:43.842706+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'333","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.771910+0000","last_change":"2024-04-25T02:19:27.771910+0000","last_active":"2024-04-25T02:19:27.771910+0000","last_peered":"2024-04-25T02:19:27.771910+0000","last_clean":"2024-04-25T02:19:27.771910+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:19:27.771910+0000","last_undegraded":"2024-04-25T02:19:27.771910+0000","last_fullsized":"2024-04-25T02:19:27.771910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:27.771815+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:27.771815+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.771815+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.296955+0000","last_change":"2024-04-25T02:19:21.296955+0000","last_active":"2024-04-25T02:19:21.296955+0000","last_peered":"2024-04-25T02:19:21.296955+0000","last_clean":"2024-04-25T02:19:21.296955+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:19:21.296955+0000","last_undegraded":"2024-04-25T02:19:21.296955+0000","last_fullsized":"2024-04-25T02:19:21.296955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.296829+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'353","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268219+0000","last_change":"2024-04-25T02:10:02.746945+0000","last_active":"2024-04-25T02:18:51.268219+0000","last_peered":"2024-04-25T02:18:51.268219+0000","last_clean":"2024-04-25T02:18:51.268219+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:18:51.268219+0000","last_undegraded":"2024-04-25T02:18:51.268219+0000","last_fullsized":"2024-04-25T02:18:51.268219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":353,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'3","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:31.773766+0000","last_change":"2024-04-25T02:19:31.773766+0000","last_active":"2024-04-25T02:19:31.773766+0000","last_peered":"2024-04-25T02:19:31.773766+0000","last_clean":"2024-04-25T02:19:31.773766+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:19:31.773766+0000","last_undegraded":"2024-04-25T02:19:31.773766+0000","last_fullsized":"2024-04-25T02:19:31.773766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-25T02:19:31.773623+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-25T02:19:31.773623+0000","last_clean_scrub_stamp":"2024-04-25T02:19:31.773623+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'406","reported_seq":423,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:56.431591+0000","last_change":"2024-04-25T02:19:56.431591+0000","last_active":"2024-04-25T02:19:56.431591+0000","last_peered":"2024-04-25T02:19:56.431591+0000","last_clean":"2024-04-25T02:19:56.431591+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:19:56.431591+0000","last_undegraded":"2024-04-25T02:19:56.431591+0000","last_fullsized":"2024-04-25T02:19:56.431591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'406","last_scrub_stamp":"2024-04-25T02:19:56.431479+0000","last_deep_scrub":"19'406","last_deep_scrub_stamp":"2024-04-25T02:19:56.431479+0000","last_clean_scrub_stamp":"2024-04-25T02:19:56.431479+0000","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":2547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'140","reported_seq":158,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.491862+0000","last_change":"2024-04-25T02:19:11.491862+0000","last_active":"2024-04-25T02:19:11.491862+0000","last_peered":"2024-04-25T02:19:11.491862+0000","last_clean":"2024-04-25T02:19:11.491862+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:19:11.491862+0000","last_undegraded":"2024-04-25T02:19:11.491862+0000","last_fullsized":"2024-04-25T02:19:11.491862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'140","last_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_deep_scrub":"19'140","last_deep_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.491759+0000","log_size":140,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'351","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:30.803636+0000","last_change":"2024-04-25T02:19:30.803636+0000","last_active":"2024-04-25T02:19:30.803636+0000","last_peered":"2024-04-25T02:19:30.803636+0000","last_clean":"2024-04-25T02:19:30.803636+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:19:30.803636+0000","last_undegraded":"2024-04-25T02:19:30.803636+0000","last_fullsized":"2024-04-25T02:19:30.803636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'351","last_scrub_stamp":"2024-04-25T02:19:30.803487+0000","last_deep_scrub":"19'351","last_deep_scrub_stamp":"2024-04-25T02:19:30.803487+0000","last_clean_scrub_stamp":"2024-04-25T02:19:30.803487+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'48","reported_seq":66,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.281870+0000","last_change":"2024-04-25T02:19:19.281870+0000","last_active":"2024-04-25T02:19:19.281870+0000","last_peered":"2024-04-25T02:19:19.281870+0000","last_clean":"2024-04-25T02:19:19.281870+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:19:19.281870+0000","last_undegraded":"2024-04-25T02:19:19.281870+0000","last_fullsized":"2024-04-25T02:19:19.281870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'48","last_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_deep_scrub":"19'48","last_deep_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.281770+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'375","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273633+0000","last_change":"2024-04-25T02:10:02.732646+0000","last_active":"2024-04-25T02:18:51.273633+0000","last_peered":"2024-04-25T02:18:51.273633+0000","last_clean":"2024-04-25T02:18:51.273633+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:18:51.273633+0000","last_undegraded":"2024-04-25T02:18:51.273633+0000","last_fullsized":"2024-04-25T02:18:51.273633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":375,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'109","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.663012+0000","last_change":"2024-04-25T02:19:13.663012+0000","last_active":"2024-04-25T02:19:13.663012+0000","last_peered":"2024-04-25T02:19:13.663012+0000","last_clean":"2024-04-25T02:19:13.663012+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:19:13.663012+0000","last_undegraded":"2024-04-25T02:19:13.663012+0000","last_fullsized":"2024-04-25T02:19:13.663012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'109","last_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_deep_scrub":"19'109","last_deep_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.662909+0000","log_size":109,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'396","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:35.607004+0000","last_change":"2024-04-25T02:19:35.607004+0000","last_active":"2024-04-25T02:19:35.607004+0000","last_peered":"2024-04-25T02:19:35.607004+0000","last_clean":"2024-04-25T02:19:35.607004+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:19:35.607004+0000","last_undegraded":"2024-04-25T02:19:35.607004+0000","last_fullsized":"2024-04-25T02:19:35.607004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'396","last_scrub_stamp":"2024-04-25T02:19:35.606880+0000","last_deep_scrub":"19'396","last_deep_scrub_stamp":"2024-04-25T02:19:35.606880+0000","last_clean_scrub_stamp":"2024-04-25T02:19:35.606880+0000","log_size":396,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'84","reported_seq":102,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:29.801974+0000","last_change":"2024-04-25T02:19:29.801974+0000","last_active":"2024-04-25T02:19:29.801974+0000","last_peered":"2024-04-25T02:19:29.801974+0000","last_clean":"2024-04-25T02:19:29.801974+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:19:29.801974+0000","last_undegraded":"2024-04-25T02:19:29.801974+0000","last_fullsized":"2024-04-25T02:19:29.801974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'84","last_scrub_stamp":"2024-04-25T02:19:29.801721+0000","last_deep_scrub":"19'84","last_deep_scrub_stamp":"2024-04-25T02:19:29.801721+0000","last_clean_scrub_stamp":"2024-04-25T02:19:29.801721+0000","log_size":84,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'356","reported_seq":373,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.666077+0000","last_change":"2024-04-25T02:19:19.666077+0000","last_active":"2024-04-25T02:19:19.666077+0000","last_peered":"2024-04-25T02:19:19.666077+0000","last_clean":"2024-04-25T02:19:19.666077+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:19:19.666077+0000","last_undegraded":"2024-04-25T02:19:19.666077+0000","last_fullsized":"2024-04-25T02:19:19.666077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'356","last_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_deep_scrub":"19'356","last_deep_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.665961+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'33","reported_seq":51,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.244079+0000","last_change":"2024-04-25T02:19:09.244079+0000","last_active":"2024-04-25T02:19:09.244079+0000","last_peered":"2024-04-25T02:19:09.244079+0000","last_clean":"2024-04-25T02:19:09.244079+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:19:09.244079+0000","last_undegraded":"2024-04-25T02:19:09.244079+0000","last_fullsized":"2024-04-25T02:19:09.244079+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'33","last_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_deep_scrub":"19'33","last_deep_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.243976+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'398","reported_seq":415,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:51.347108+0000","last_change":"2024-04-25T02:19:51.347108+0000","last_active":"2024-04-25T02:19:51.347108+0000","last_peered":"2024-04-25T02:19:51.347108+0000","last_clean":"2024-04-25T02:19:51.347108+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:19:51.347108+0000","last_undegraded":"2024-04-25T02:19:51.347108+0000","last_fullsized":"2024-04-25T02:19:51.347108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'398","last_scrub_stamp":"2024-04-25T02:19:51.346998+0000","last_deep_scrub":"19'398","last_deep_scrub_stamp":"2024-04-25T02:19:51.346998+0000","last_clean_scrub_stamp":"2024-04-25T02:19:51.346998+0000","log_size":398,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'117","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.843685+0000","last_change":"2024-04-25T02:19:25.843685+0000","last_active":"2024-04-25T02:19:25.843685+0000","last_peered":"2024-04-25T02:19:25.843685+0000","last_clean":"2024-04-25T02:19:25.843685+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:19:25.843685+0000","last_undegraded":"2024-04-25T02:19:25.843685+0000","last_fullsized":"2024-04-25T02:19:25.843685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'117","last_scrub_stamp":"2024-04-25T02:19:25.843568+0000","last_deep_scrub":"19'117","last_deep_scrub_stamp":"2024-04-25T02:19:25.843568+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.843568+0000","log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":12332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":450,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'459","reported_seq":476,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:54.392846+0000","last_change":"2024-04-25T02:19:54.392846+0000","last_active":"2024-04-25T02:19:54.392846+0000","last_peered":"2024-04-25T02:19:54.392846+0000","last_clean":"2024-04-25T02:19:54.392846+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:19:54.392846+0000","last_undegraded":"2024-04-25T02:19:54.392846+0000","last_fullsized":"2024-04-25T02:19:54.392846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'459","last_scrub_stamp":"2024-04-25T02:19:54.392702+0000","last_deep_scrub":"19'459","last_deep_scrub_stamp":"2024-04-25T02:19:54.392702+0000","last_clean_scrub_stamp":"2024-04-25T02:19:54.392702+0000","log_size":459,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'76","reported_seq":94,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.854739+0000","last_change":"2024-04-25T02:19:21.854739+0000","last_active":"2024-04-25T02:19:21.854739+0000","last_peered":"2024-04-25T02:19:21.854739+0000","last_clean":"2024-04-25T02:19:21.854739+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:19:21.854739+0000","last_undegraded":"2024-04-25T02:19:21.854739+0000","last_fullsized":"2024-04-25T02:19:21.854739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'76","last_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_deep_scrub":"19'76","last_deep_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.854641+0000","log_size":76,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'354","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.708606+0000","last_change":"2024-04-25T02:19:21.708606+0000","last_active":"2024-04-25T02:19:21.708606+0000","last_peered":"2024-04-25T02:19:21.708606+0000","last_clean":"2024-04-25T02:19:21.708606+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:19:21.708606+0000","last_undegraded":"2024-04-25T02:19:21.708606+0000","last_fullsized":"2024-04-25T02:19:21.708606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'354","last_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_deep_scrub":"19'354","last_deep_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.708495+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"19'32","reported_seq":50,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:17.789878+0000","last_change":"2024-04-25T02:19:17.789878+0000","last_active":"2024-04-25T02:19:17.789878+0000","last_peered":"2024-04-25T02:19:17.789878+0000","last_clean":"2024-04-25T02:19:17.789878+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:19:17.789878+0000","last_undegraded":"2024-04-25T02:19:17.789878+0000","last_fullsized":"2024-04-25T02:19:17.789878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'32","last_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_deep_scrub":"19'32","last_deep_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_clean_scrub_stamp":"2024-04-25T02:19:17.789779+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'332","reported_seq":349,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:24.721403+0000","last_change":"2024-04-25T02:19:24.721403+0000","last_active":"2024-04-25T02:19:24.721403+0000","last_peered":"2024-04-25T02:19:24.721403+0000","last_clean":"2024-04-25T02:19:24.721403+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:19:24.721403+0000","last_undegraded":"2024-04-25T02:19:24.721403+0000","last_fullsized":"2024-04-25T02:19:24.721403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'332","last_scrub_stamp":"2024-04-25T02:19:24.721294+0000","last_deep_scrub":"19'332","last_deep_scrub_stamp":"2024-04-25T02:19:24.721294+0000","last_clean_scrub_stamp":"2024-04-25T02:19:24.721294+0000","log_size":332,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'113","reported_seq":131,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.807276+0000","last_change":"2024-04-25T02:19:16.807276+0000","last_active":"2024-04-25T02:19:16.807276+0000","last_peered":"2024-04-25T02:19:16.807276+0000","last_clean":"2024-04-25T02:19:16.807276+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:19:16.807276+0000","last_undegraded":"2024-04-25T02:19:16.807276+0000","last_fullsized":"2024-04-25T02:19:16.807276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'113","last_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_deep_scrub":"19'113","last_deep_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.807162+0000","log_size":113,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'328","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:38.577551+0000","last_change":"2024-04-25T02:19:38.577551+0000","last_active":"2024-04-25T02:19:38.577551+0000","last_peered":"2024-04-25T02:19:38.577551+0000","last_clean":"2024-04-25T02:19:38.577551+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:19:38.577551+0000","last_undegraded":"2024-04-25T02:19:38.577551+0000","last_fullsized":"2024-04-25T02:19:38.577551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'328","last_scrub_stamp":"2024-04-25T02:19:38.577424+0000","last_deep_scrub":"19'328","last_deep_scrub_stamp":"2024-04-25T02:19:38.577424+0000","last_clean_scrub_stamp":"2024-04-25T02:19:38.577424+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.467431+0000","last_change":"2024-04-25T02:19:02.467431+0000","last_active":"2024-04-25T02:19:02.467431+0000","last_peered":"2024-04-25T02:19:02.467431+0000","last_clean":"2024-04-25T02:19:02.467431+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:19:02.467431+0000","last_undegraded":"2024-04-25T02:19:02.467431+0000","last_fullsized":"2024-04-25T02:19:02.467431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.467334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'95","reported_seq":113,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.615993+0000","last_change":"2024-04-25T02:19:11.615993+0000","last_active":"2024-04-25T02:19:11.615993+0000","last_peered":"2024-04-25T02:19:11.615993+0000","last_clean":"2024-04-25T02:19:11.615993+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:19:11.615993+0000","last_undegraded":"2024-04-25T02:19:11.615993+0000","last_fullsized":"2024-04-25T02:19:11.615993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'95","last_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_deep_scrub":"19'95","last_deep_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.615813+0000","log_size":95,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:26.561694+0000","last_change":"2024-04-25T02:19:26.561694+0000","last_active":"2024-04-25T02:19:26.561694+0000","last_peered":"2024-04-25T02:19:26.561694+0000","last_clean":"2024-04-25T02:19:26.561694+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:19:26.561694+0000","last_undegraded":"2024-04-25T02:19:26.561694+0000","last_fullsized":"2024-04-25T02:19:26.561694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:26.561581+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:26.561581+0000","last_clean_scrub_stamp":"2024-04-25T02:19:26.561581+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:06.911064+0000","last_change":"2024-04-25T02:19:06.911064+0000","last_active":"2024-04-25T02:19:06.911064+0000","last_peered":"2024-04-25T02:19:06.911064+0000","last_clean":"2024-04-25T02:19:06.911064+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:19:06.911064+0000","last_undegraded":"2024-04-25T02:19:06.911064+0000","last_fullsized":"2024-04-25T02:19:06.911064+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_clean_scrub_stamp":"2024-04-25T02:19:06.910932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'16","reported_seq":34,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.302362+0000","last_change":"2024-04-25T02:19:05.302362+0000","last_active":"2024-04-25T02:19:05.302362+0000","last_peered":"2024-04-25T02:19:05.302362+0000","last_clean":"2024-04-25T02:19:05.302362+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:19:05.302362+0000","last_undegraded":"2024-04-25T02:19:05.302362+0000","last_fullsized":"2024-04-25T02:19:05.302362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'16","last_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_deep_scrub":"19'16","last_deep_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.302256+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'326","reported_seq":343,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.576881+0000","last_change":"2024-04-25T02:19:27.576881+0000","last_active":"2024-04-25T02:19:27.576881+0000","last_peered":"2024-04-25T02:19:27.576881+0000","last_clean":"2024-04-25T02:19:27.576881+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:19:27.576881+0000","last_undegraded":"2024-04-25T02:19:27.576881+0000","last_fullsized":"2024-04-25T02:19:27.576881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'326","last_scrub_stamp":"2024-04-25T02:19:27.576765+0000","last_deep_scrub":"19'326","last_deep_scrub_stamp":"2024-04-25T02:19:27.576765+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.576765+0000","log_size":326,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.564824+0000","last_change":"2024-04-25T02:19:01.564824+0000","last_active":"2024-04-25T02:19:01.564824+0000","last_peered":"2024-04-25T02:19:01.564824+0000","last_clean":"2024-04-25T02:19:01.564824+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:19:01.564824+0000","last_undegraded":"2024-04-25T02:19:01.564824+0000","last_fullsized":"2024-04-25T02:19:01.564824+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.564726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'243","reported_seq":261,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.526240+0000","last_change":"2024-04-25T02:19:08.526240+0000","last_active":"2024-04-25T02:19:08.526240+0000","last_peered":"2024-04-25T02:19:08.526240+0000","last_clean":"2024-04-25T02:19:08.526240+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:19:08.526240+0000","last_undegraded":"2024-04-25T02:19:08.526240+0000","last_fullsized":"2024-04-25T02:19:08.526240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'243","last_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_deep_scrub":"19'243","last_deep_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.526107+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":12388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'331","reported_seq":348,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:29.573912+0000","last_change":"2024-04-25T02:19:29.573912+0000","last_active":"2024-04-25T02:19:29.573912+0000","last_peered":"2024-04-25T02:19:29.573912+0000","last_clean":"2024-04-25T02:19:29.573912+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:19:29.573912+0000","last_undegraded":"2024-04-25T02:19:29.573912+0000","last_fullsized":"2024-04-25T02:19:29.573912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'331","last_scrub_stamp":"2024-04-25T02:19:29.573769+0000","last_deep_scrub":"19'331","last_deep_scrub_stamp":"2024-04-25T02:19:29.573769+0000","last_clean_scrub_stamp":"2024-04-25T02:19:29.573769+0000","log_size":331,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":2335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.862881+0000","last_change":"2024-04-25T02:19:07.862881+0000","last_active":"2024-04-25T02:19:07.862881+0000","last_peered":"2024-04-25T02:19:07.862881+0000","last_clean":"2024-04-25T02:19:07.862881+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:19:07.862881+0000","last_undegraded":"2024-04-25T02:19:07.862881+0000","last_fullsized":"2024-04-25T02:19:07.862881+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.862746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.436078+0000","last_change":"2024-04-25T02:19:01.436078+0000","last_active":"2024-04-25T02:19:01.436078+0000","last_peered":"2024-04-25T02:19:01.436078+0000","last_clean":"2024-04-25T02:19:01.436078+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:19:01.436078+0000","last_undegraded":"2024-04-25T02:19:01.436078+0000","last_fullsized":"2024-04-25T02:19:01.436078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.435931+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'162","reported_seq":180,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.898853+0000","last_change":"2024-04-25T02:19:11.898853+0000","last_active":"2024-04-25T02:19:11.898853+0000","last_peered":"2024-04-25T02:19:11.898853+0000","last_clean":"2024-04-25T02:19:11.898853+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:19:11.898853+0000","last_undegraded":"2024-04-25T02:19:11.898853+0000","last_fullsized":"2024-04-25T02:19:11.898853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'162","last_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_deep_scrub":"19'162","last_deep_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.898758+0000","log_size":162,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'344","reported_seq":356,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268567+0000","last_change":"2024-04-25T02:10:02.738780+0000","last_active":"2024-04-25T02:18:51.268567+0000","last_peered":"2024-04-25T02:18:51.268567+0000","last_clean":"2024-04-25T02:18:51.268567+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:18:51.268567+0000","last_undegraded":"2024-04-25T02:18:51.268567+0000","last_fullsized":"2024-04-25T02:18:51.268567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.879508+0000","last_change":"2024-04-25T02:19:05.879508+0000","last_active":"2024-04-25T02:19:05.879508+0000","last_peered":"2024-04-25T02:19:05.879508+0000","last_clean":"2024-04-25T02:19:05.879508+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:19:05.879508+0000","last_undegraded":"2024-04-25T02:19:05.879508+0000","last_fullsized":"2024-04-25T02:19:05.879508+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.879394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'626","reported_seq":1266,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.344141+0000","last_change":"2024-04-25T02:19:02.344141+0000","last_active":"2024-04-25T02:19:02.344141+0000","last_peered":"2024-04-25T02:19:02.344141+0000","last_clean":"2024-04-25T02:19:02.344141+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:19:02.344141+0000","last_undegraded":"2024-04-25T02:19:02.344141+0000","last_fullsized":"2024-04-25T02:19:02.344141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'626","last_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_deep_scrub":"19'626","last_deep_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.344043+0000","log_size":626,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1113626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":622,"num_write_kb":1507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'415","reported_seq":432,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:49.328465+0000","last_change":"2024-04-25T02:19:49.328465+0000","last_active":"2024-04-25T02:19:49.328465+0000","last_peered":"2024-04-25T02:19:49.328465+0000","last_clean":"2024-04-25T02:19:49.328465+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:19:49.328465+0000","last_undegraded":"2024-04-25T02:19:49.328465+0000","last_fullsized":"2024-04-25T02:19:49.328465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'415","last_scrub_stamp":"2024-04-25T02:19:49.328361+0000","last_deep_scrub":"19'415","last_deep_scrub_stamp":"2024-04-25T02:19:49.328361+0000","last_clean_scrub_stamp":"2024-04-25T02:19:49.328361+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.840625+0000","last_change":"2024-04-25T02:19:08.840625+0000","last_active":"2024-04-25T02:19:08.840625+0000","last_peered":"2024-04-25T02:19:08.840625+0000","last_clean":"2024-04-25T02:19:08.840625+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:19:08.840625+0000","last_undegraded":"2024-04-25T02:19:08.840625+0000","last_fullsized":"2024-04-25T02:19:08.840625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.840520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'45","reported_seq":63,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.518176+0000","last_change":"2024-04-25T02:19:09.518176+0000","last_active":"2024-04-25T02:19:09.518176+0000","last_peered":"2024-04-25T02:19:09.518176+0000","last_clean":"2024-04-25T02:19:09.518176+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:19:09.518176+0000","last_undegraded":"2024-04-25T02:19:09.518176+0000","last_fullsized":"2024-04-25T02:19:09.518176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'45","last_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_deep_scrub":"19'45","last_deep_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.518059+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'343","reported_seq":360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:42.360853+0000","last_change":"2024-04-25T02:19:42.360853+0000","last_active":"2024-04-25T02:19:42.360853+0000","last_peered":"2024-04-25T02:19:42.360853+0000","last_clean":"2024-04-25T02:19:42.360853+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:19:42.360853+0000","last_undegraded":"2024-04-25T02:19:42.360853+0000","last_fullsized":"2024-04-25T02:19:42.360853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'343","last_scrub_stamp":"2024-04-25T02:19:42.360731+0000","last_deep_scrub":"19'343","last_deep_scrub_stamp":"2024-04-25T02:19:42.360731+0000","last_clean_scrub_stamp":"2024-04-25T02:19:42.360731+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'65","reported_seq":83,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.839509+0000","last_change":"2024-04-25T02:19:13.839509+0000","last_active":"2024-04-25T02:19:13.839509+0000","last_peered":"2024-04-25T02:19:13.839509+0000","last_clean":"2024-04-25T02:19:13.839509+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:19:13.839509+0000","last_undegraded":"2024-04-25T02:19:13.839509+0000","last_fullsized":"2024-04-25T02:19:13.839509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'65","last_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_deep_scrub":"19'65","last_deep_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.839408+0000","log_size":65,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:03.479134+0000","last_change":"2024-04-25T02:19:03.479134+0000","last_active":"2024-04-25T02:19:03.479134+0000","last_peered":"2024-04-25T02:19:03.479134+0000","last_clean":"2024-04-25T02:19:03.479134+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:19:03.479134+0000","last_undegraded":"2024-04-25T02:19:03.479134+0000","last_fullsized":"2024-04-25T02:19:03.479134+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_clean_scrub_stamp":"2024-04-25T02:19:03.479027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'368","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273457+0000","last_change":"2024-04-25T02:10:02.731717+0000","last_active":"2024-04-25T02:18:51.273457+0000","last_peered":"2024-04-25T02:18:51.273457+0000","last_clean":"2024-04-25T02:18:51.273457+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:18:51.273457+0000","last_undegraded":"2024-04-25T02:18:51.273457+0000","last_fullsized":"2024-04-25T02:18:51.273457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:10.845393+0000","last_change":"2024-04-25T02:19:10.845393+0000","last_active":"2024-04-25T02:19:10.845393+0000","last_peered":"2024-04-25T02:19:10.845393+0000","last_clean":"2024-04-25T02:19:10.845393+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:19:10.845393+0000","last_undegraded":"2024-04-25T02:19:10.845393+0000","last_fullsized":"2024-04-25T02:19:10.845393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_clean_scrub_stamp":"2024-04-25T02:19:10.845259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'72","reported_seq":90,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.244226+0000","last_change":"2024-04-25T02:19:07.244226+0000","last_active":"2024-04-25T02:19:07.244226+0000","last_peered":"2024-04-25T02:19:07.244226+0000","last_clean":"2024-04-25T02:19:07.244226+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:19:07.244226+0000","last_undegraded":"2024-04-25T02:19:07.244226+0000","last_fullsized":"2024-04-25T02:19:07.244226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'72","last_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_deep_scrub":"19'72","last_deep_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.244087+0000","log_size":72,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'336","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.688927+0000","last_change":"2024-04-25T02:19:16.688927+0000","last_active":"2024-04-25T02:19:16.688927+0000","last_peered":"2024-04-25T02:19:16.688927+0000","last_clean":"2024-04-25T02:19:16.688927+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:19:16.688927+0000","last_undegraded":"2024-04-25T02:19:16.688927+0000","last_fullsized":"2024-04-25T02:19:16.688927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'336","last_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_deep_scrub":"19'336","last_deep_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.688815+0000","log_size":336,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'30","reported_seq":48,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:30.310189+0000","last_change":"2024-04-25T02:19:30.310189+0000","last_active":"2024-04-25T02:19:30.310189+0000","last_peered":"2024-04-25T02:19:30.310189+0000","last_clean":"2024-04-25T02:19:30.310189+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:19:30.310189+0000","last_undegraded":"2024-04-25T02:19:30.310189+0000","last_fullsized":"2024-04-25T02:19:30.310189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'30","last_scrub_stamp":"2024-04-25T02:19:30.310064+0000","last_deep_scrub":"19'30","last_deep_scrub_stamp":"2024-04-25T02:19:30.310064+0000","last_clean_scrub_stamp":"2024-04-25T02:19:30.310064+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:38.812597+0000","last_change":"2024-04-25T02:19:38.812597+0000","last_active":"2024-04-25T02:19:38.812597+0000","last_peered":"2024-04-25T02:19:38.812597+0000","last_clean":"2024-04-25T02:19:38.812597+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:19:38.812597+0000","last_undegraded":"2024-04-25T02:19:38.812597+0000","last_fullsized":"2024-04-25T02:19:38.812597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:38.812488+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:38.812488+0000","last_clean_scrub_stamp":"2024-04-25T02:19:38.812488+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'48","reported_seq":66,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.575977+0000","last_change":"2024-04-25T02:19:25.575977+0000","last_active":"2024-04-25T02:19:25.575977+0000","last_peered":"2024-04-25T02:19:25.575977+0000","last_clean":"2024-04-25T02:19:25.575977+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:19:25.575977+0000","last_undegraded":"2024-04-25T02:19:25.575977+0000","last_fullsized":"2024-04-25T02:19:25.575977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'48","last_scrub_stamp":"2024-04-25T02:19:25.575846+0000","last_deep_scrub":"19'48","last_deep_scrub_stamp":"2024-04-25T02:19:25.575846+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.575846+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'335","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:36.792418+0000","last_change":"2024-04-25T02:19:36.792418+0000","last_active":"2024-04-25T02:19:36.792418+0000","last_peered":"2024-04-25T02:19:36.792418+0000","last_clean":"2024-04-25T02:19:36.792418+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:19:36.792418+0000","last_undegraded":"2024-04-25T02:19:36.792418+0000","last_fullsized":"2024-04-25T02:19:36.792418+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'335","last_scrub_stamp":"2024-04-25T02:19:36.792293+0000","last_deep_scrub":"19'335","last_deep_scrub_stamp":"2024-04-25T02:19:36.792293+0000","last_clean_scrub_stamp":"2024-04-25T02:19:36.792293+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":2199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'246","reported_seq":264,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:57.854639+0000","last_change":"2024-04-25T02:19:57.854639+0000","last_active":"2024-04-25T02:19:57.854639+0000","last_peered":"2024-04-25T02:19:57.854639+0000","last_clean":"2024-04-25T02:19:57.854639+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:19:57.854639+0000","last_undegraded":"2024-04-25T02:19:57.854639+0000","last_fullsized":"2024-04-25T02:19:57.854639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'246","last_scrub_stamp":"2024-04-25T02:19:57.854529+0000","last_deep_scrub":"19'246","last_deep_scrub_stamp":"2024-04-25T02:19:57.854529+0000","last_clean_scrub_stamp":"2024-04-25T02:19:57.854529+0000","log_size":246,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'358","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:34.856685+0000","last_change":"2024-04-25T02:19:34.856685+0000","last_active":"2024-04-25T02:19:34.856685+0000","last_peered":"2024-04-25T02:19:34.856685+0000","last_clean":"2024-04-25T02:19:34.856685+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:19:34.856685+0000","last_undegraded":"2024-04-25T02:19:34.856685+0000","last_fullsized":"2024-04-25T02:19:34.856685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'358","last_scrub_stamp":"2024-04-25T02:19:34.856571+0000","last_deep_scrub":"19'358","last_deep_scrub_stamp":"2024-04-25T02:19:34.856571+0000","last_clean_scrub_stamp":"2024-04-25T02:19:34.856571+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'111","reported_seq":129,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:00.870849+0000","last_change":"2024-04-25T02:20:00.870849+0000","last_active":"2024-04-25T02:20:00.870849+0000","last_peered":"2024-04-25T02:20:00.870849+0000","last_clean":"2024-04-25T02:20:00.870849+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:20:00.870849+0000","last_undegraded":"2024-04-25T02:20:00.870849+0000","last_fullsized":"2024-04-25T02:20:00.870849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'111","last_scrub_stamp":"2024-04-25T02:20:00.870745+0000","last_deep_scrub":"19'111","last_deep_scrub_stamp":"2024-04-25T02:20:00.870745+0000","last_clean_scrub_stamp":"2024-04-25T02:20:00.870745+0000","log_size":111,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'370","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.280559+0000","last_change":"2024-04-25T02:10:02.741054+0000","last_active":"2024-04-25T02:18:51.280559+0000","last_peered":"2024-04-25T02:18:51.280559+0000","last_clean":"2024-04-25T02:18:51.280559+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:18:51.280559+0000","last_undegraded":"2024-04-25T02:18:51.280559+0000","last_fullsized":"2024-04-25T02:18:51.280559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":370,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'58","reported_seq":76,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:33.337408+0000","last_change":"2024-04-25T02:19:33.337408+0000","last_active":"2024-04-25T02:19:33.337408+0000","last_peered":"2024-04-25T02:19:33.337408+0000","last_clean":"2024-04-25T02:19:33.337408+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:19:33.337408+0000","last_undegraded":"2024-04-25T02:19:33.337408+0000","last_fullsized":"2024-04-25T02:19:33.337408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'58","last_scrub_stamp":"2024-04-25T02:19:33.337308+0000","last_deep_scrub":"19'58","last_deep_scrub_stamp":"2024-04-25T02:19:33.337308+0000","last_clean_scrub_stamp":"2024-04-25T02:19:33.337308+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'414","reported_seq":431,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:32.829574+0000","last_change":"2024-04-25T02:19:32.829574+0000","last_active":"2024-04-25T02:19:32.829574+0000","last_peered":"2024-04-25T02:19:32.829574+0000","last_clean":"2024-04-25T02:19:32.829574+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:19:32.829574+0000","last_undegraded":"2024-04-25T02:19:32.829574+0000","last_fullsized":"2024-04-25T02:19:32.829574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'414","last_scrub_stamp":"2024-04-25T02:19:32.829454+0000","last_deep_scrub":"19'414","last_deep_scrub_stamp":"2024-04-25T02:19:32.829454+0000","last_clean_scrub_stamp":"2024-04-25T02:19:32.829454+0000","log_size":414,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'413","reported_seq":430,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:44.539813+0000","last_change":"2024-04-25T02:19:44.539813+0000","last_active":"2024-04-25T02:19:44.539813+0000","last_peered":"2024-04-25T02:19:44.539813+0000","last_clean":"2024-04-25T02:19:44.539813+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:19:44.539813+0000","last_undegraded":"2024-04-25T02:19:44.539813+0000","last_fullsized":"2024-04-25T02:19:44.539813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'413","last_scrub_stamp":"2024-04-25T02:19:44.539696+0000","last_deep_scrub":"19'413","last_deep_scrub_stamp":"2024-04-25T02:19:44.539696+0000","last_clean_scrub_stamp":"2024-04-25T02:19:44.539696+0000","log_size":413,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":2919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276676+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:18:51.276676+0000","last_peered":"2024-04-25T02:18:51.276676+0000","last_clean":"2024-04-25T02:18:51.276676+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:18:51.276676+0000","last_undegraded":"2024-04-25T02:18:51.276676+0000","last_fullsized":"2024-04-25T02:18:51.276676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":3172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'394","reported_seq":406,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.251643+0000","last_change":"2024-04-25T02:10:02.743697+0000","last_active":"2024-04-25T02:18:51.251643+0000","last_peered":"2024-04-25T02:18:51.251643+0000","last_clean":"2024-04-25T02:18:51.251643+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:18:51.251643+0000","last_undegraded":"2024-04-25T02:18:51.251643+0000","last_fullsized":"2024-04-25T02:18:51.251643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":394,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.259897+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:18:51.259897+0000","last_peered":"2024-04-25T02:18:51.259897+0000","last_clean":"2024-04-25T02:18:51.259897+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:18:51.259897+0000","last_undegraded":"2024-04-25T02:18:51.259897+0000","last_fullsized":"2024-04-25T02:18:51.259897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:50.505906+0000","last_change":"2024-04-25T02:19:50.505906+0000","last_active":"2024-04-25T02:19:50.505906+0000","last_peered":"2024-04-25T02:19:50.505906+0000","last_clean":"2024-04-25T02:19:50.505906+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:19:50.505906+0000","last_undegraded":"2024-04-25T02:19:50.505906+0000","last_fullsized":"2024-04-25T02:19:50.505906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:50.505793+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:50.505793+0000","last_clean_scrub_stamp":"2024-04-25T02:19:50.505793+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":167505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23216,"ondisk_log_size":23216,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":3994,"num_write_kb":199381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5330,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316645376,"data_stored":316588690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3942,"ondisk_log_size":3942,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705789,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370056,"kb_used_data":72832,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94001784,"statfs":{"total":96636764160,"available":96257826816,"internally_reserved":0,"allocated":74579968,"data_stored":74464209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.23799999999999999,"15min":0.26800000000000002},"min":{"1min":0.156,"5min":0.156,"15min":0.14599999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.253,"15min":0.29299999999999998},"min":{"1min":0.17599999999999999,"5min":0.16500000000000001,"15min":0.16300000000000001},"max":{"1min":0.45900000000000002,"5min":0.50900000000000001,"15min":0.53400000000000003},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.27600000000000002,"5min":0.26400000000000001,"15min":0.29899999999999999},"min":{"1min":0.19,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.45200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.29999999999999999},"min":{"1min":0.192,"5min":0.186,"15min":0.186},"max":{"1min":0.441,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.28899999999999998,"15min":0.32500000000000001},"min":{"1min":0.223,"5min":0.192,"15min":0.192},"max":{"1min":0.49099999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.377},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":0.47899999999999998,"5min":0.628,"15min":0.628},"last":0.36199999999999999}]}]},{"osd":3,"up_from":9,"seq":38654705788,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405844,"kb_used_data":100428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93965996,"statfs":{"total":96636764160,"available":96221179904,"internally_reserved":0,"allocated":102838272,"data_stored":102710905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.27000000000000002,"5min":0.23999999999999999,"15min":0.28599999999999998},"min":{"1min":0.182,"5min":0.13200000000000001,"15min":0.13200000000000001},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.49299999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.252,"15min":0.29399999999999998},"min":{"1min":0.19500000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.315},"min":{"1min":0.182,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.307,"5min":0.27400000000000002,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.53400000000000003},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.32800000000000001},"min":{"1min":0.22,"5min":0.186,"15min":0.186},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.496,"5min":0.496,"15min":0.51900000000000002},"last":0.41499999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705788,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364024,"kb_used_data":66800,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94007816,"statfs":{"total":96636764160,"available":96264003584,"internally_reserved":0,"allocated":68403200,"data_stored":68279904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:19:15 2024","interfaces":[{"interface":"back","average":{"1min":2.452,"5min":0.66600000000000004,"15min":0.43099999999999999},"min":{"1min":0.19400000000000001,"5min":0.156,"15min":0.14399999999999999},"max":{"1min":34.734000000000002,"5min":34.734000000000002,"15min":34.734000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.32700000000000001,"15min":0.32200000000000001},"min":{"1min":0.20699999999999999,"5min":0.16700000000000001,"15min":0.16300000000000001},"max":{"1min":4.8769999999999998,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:19:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.39300000000000002,"15min":0.35699999999999998},"min":{"1min":0.246,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":9.0670000000000002,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.309},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.39400000000000002,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.192,"15min":0.192},"max":{"1min":9.2899999999999991,"5min":9.2899999999999991,"15min":9.2899999999999991},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:19:15 2024","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":0.66500000000000004,"15min":0.45900000000000002},"min":{"1min":0.252,"5min":0.182,"15min":0.182},"max":{"1min":29.867999999999999,"5min":29.867999999999999,"15min":29.867999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.6060000000000001,"5min":0.54200000000000004,"15min":0.40999999999999998},"min":{"1min":0.26000000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":20.276,"5min":20.276,"15min":20.276},"last":0.28399999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705789,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371124,"kb_used_data":69804,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94000716,"statfs":{"total":96636764160,"available":96256733184,"internally_reserved":0,"allocated":71479296,"data_stored":71360528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":0.224,"15min":0.27100000000000002},"min":{"1min":0.16600000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.246,"15min":0.28899999999999998},"min":{"1min":0.191,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Apr 25 02:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.311},"min":{"1min":0.20599999999999999,"5min":0.154,"15min":0.153},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.57799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.28599999999999998,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.27300000000000002,"15min":0.31},"min":{"1min":0.22700000000000001,"5min":0.17999999999999999,"15min":0.17799999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.432},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.28399999999999997,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68239360,"data_stored":68223190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74416128,"data_stored":74407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102674432,"data_stored":102654191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:20:03.314 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.314 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.314 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.315 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.315 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.315 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.315 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.315 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.315 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.315 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.315 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.315 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.316 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.316 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.316 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.316 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.316 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.316 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.316 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.316 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.317 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.317 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.317 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.317 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.318 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.318 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.318 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:03.318 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:20:23.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:20:23.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.443+0000 7fd0afa5f700 1 Processor -- start 2024-04-25T02:20:23.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.443+0000 7fd0afa5f700 1 -- start start 2024-04-25T02:20:23.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.443+0000 7fd0afa5f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0a812a750 0x7fd0a812b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:23.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.443+0000 7fd0afa5f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8131eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.443+0000 7fd0afa5f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a8065750 con 0x7fd0a8064ad0 2024-04-25T02:20:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.443+0000 7fd0afa5f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a8064eb0 con 0x7fd0a812a750 2024-04-25T02:20:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.443+0000 7fd0afa5f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8099930 con 0x7fd0a812fac0 2024-04-25T02:20:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0adffc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8131eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0acffa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0a812a750 0x7fd0a812b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0ad7fb700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd0a8064ad0 0x7fd0a812abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48158/0 (socket says 172.21.15.78:48158) 2024-04-25T02:20:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0ad7fb700 1 -- 172.21.15.78:0/3637420844 learned_addr learned my addr 172.21.15.78:0/3637420844 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:20:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0acffa700 1 -- 172.21.15.78:0/3637420844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 msgr2=0x7fd0a8131eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0acffa700 1 --2- 172.21.15.78:0/3637420844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8131eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0acffa700 1 -- 172.21.15.78:0/3637420844 >> v1:172.21.15.78:6789/0 conn(0x7fd0a8064ad0 legacy=0x7fd0a812abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd09ffff700 1 -- 172.21.15.78:0/3637420844 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855339842 0 0) 0x7fd0a8065750 con 0x7fd0a8064ad0 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0acffa700 1 -- 172.21.15.78:0/3637420844 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8065b40 con 0x7fd0a812a750 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0adffc700 1 --2- 172.21.15.78:0/3637420844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8131eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd0acffa700 1 --2- 172.21.15.78:0/3637420844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a812a750 0x7fd0a812b2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fd098009790 tx=0x7fd098009060).ready entity=mon.0 client_cookie=e8d4b79d27762b58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd09ffff700 1 -- 172.21.15.78:0/3637420844 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0980090d0 con 0x7fd0a812a750 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd09ffff700 1 -- 172.21.15.78:0/3637420844 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800f510 con 0x7fd0a812a750 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.444+0000 7fd09ffff700 1 -- 172.21.15.78:0/3637420844 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800f890 con 0x7fd0a812a750 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.445+0000 7fd0afa5f700 1 -- 172.21.15.78:0/3637420844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a812a750 msgr2=0x7fd0a812b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.445+0000 7fd0afa5f700 1 --2- 172.21.15.78:0/3637420844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a812a750 0x7fd0a812b2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fd098009790 tx=0x7fd098009060).stop 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.445+0000 7fd0afa5f700 1 -- 172.21.15.78:0/3637420844 shutdown_connections 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.445+0000 7fd0afa5f700 1 --2- 172.21.15.78:0/3637420844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8131eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.445+0000 7fd0afa5f700 1 --2- 172.21.15.78:0/3637420844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a812a750 0x7fd0a812b2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.445+0000 7fd0afa5f700 1 -- 172.21.15.78:0/3637420844 >> 172.21.15.78:0/3637420844 conn(0x7fd0a809a630 msgr2=0x7fd0a809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.445+0000 7fd0afa5f700 1 -- 172.21.15.78:0/3637420844 shutdown_connections 2024-04-25T02:20:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.445+0000 7fd0afa5f700 1 -- 172.21.15.78:0/3637420844 wait complete. 2024-04-25T02:20:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0afa5f700 1 Processor -- start 2024-04-25T02:20:23.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0afa5f700 1 -- start start 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0afa5f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a8064ad0 0x7fd0a8093a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0afa5f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8093f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0afa5f700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a8094450 0x7fd0a8094890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0afa5f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8099ab0 con 0x7fd0a8064ad0 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0afa5f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8096ae0 con 0x7fd0a812fac0 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0afa5f700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8097470 con 0x7fd0a8094450 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0ad7fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a8064ad0 0x7fd0a8093a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0acffa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8093f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0acffa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8093f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:48992/0 (socket says 172.21.15.78:48992) 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0ad7fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a8064ad0 0x7fd0a8093a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33886/0 (socket says 172.21.15.78:33886) 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0acffa700 1 -- 172.21.15.78:0/2600764165 learned_addr learned my addr 172.21.15.78:0/2600764165 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:23.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.446+0000 7fd0adffc700 1 --2- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a8094450 0x7fd0a8094890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd0ad7fb700 1 -- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a8094450 msgr2=0x7fd0a8094890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd0ad7fb700 1 --2- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a8094450 0x7fd0a8094890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd0ad7fb700 1 -- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 msgr2=0x7fd0a8093f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd0ad7fb700 1 --2- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8093f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd0ad7fb700 1 -- 172.21.15.78:0/2600764165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0009a20 con 0x7fd0a8064ad0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd0ad7fb700 1 --2- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a8064ad0 0x7fd0a8093a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fd0a4000c00 tx=0x7fd0a4007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd09dffb700 1 -- 172.21.15.78:0/2600764165 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a40070d0 con 0x7fd0a8064ad0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd09dffb700 1 -- 172.21.15.78:0/2600764165 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a4007250 con 0x7fd0a8064ad0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0980092a0 con 0x7fd0a8064ad0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd09dffb700 1 -- 172.21.15.78:0/2600764165 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4007610 con 0x7fd0a8064ad0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.447+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a8096f20 con 0x7fd0a8064ad0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.448+0000 7fd09dffb700 1 -- 172.21.15.78:0/2600764165 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fd0a40059b0 con 0x7fd0a8064ad0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.448+0000 7fd09dffb700 1 -- 172.21.15.78:0/2600764165 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fd0a403a7e0 con 0x7fd0a8064ad0 2024-04-25T02:20:23.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.448+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a80970b0 con 0x7fd0a8064ad0 2024-04-25T02:20:23.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.453+0000 7fd09dffb700 1 -- 172.21.15.78:0/2600764165 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fd0a4013970 con 0x7fd0a8064ad0 2024-04-25T02:20:23.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.608+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0a809b150 con 0x7fd08c02bd30 2024-04-25T02:20:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.615+0000 7fd09dffb700 1 -- 172.21.15.78:0/2600764165 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256923 (unknown 2965378022 0 811333886) 0x7fd0a809b150 con 0x7fd08c02bd30 2024-04-25T02:20:23.622 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:20:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 >> v1:172.21.15.78:6816/46507 conn(0x7fd08c02bd30 legacy=0x7fd08c02e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a8064ad0 msgr2=0x7fd0a8093a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 --2- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a8064ad0 0x7fd0a8093a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fd0a4000c00 tx=0x7fd0a4007b90).stop 2024-04-25T02:20:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 shutdown_connections 2024-04-25T02:20:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 --2- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fd0a8094450 0x7fd0a8094890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 --2- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a8064ad0 0x7fd0a8093a70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 --2- 172.21.15.78:0/2600764165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a812fac0 0x7fd0a8093f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 >> 172.21.15.78:0/2600764165 conn(0x7fd0a809a630 msgr2=0x7fd0a809b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:23.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 shutdown_connections 2024-04-25T02:20:23.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:23.618+0000 7fd0afa5f700 1 -- 172.21.15.78:0/2600764165 wait complete. 2024-04-25T02:20:23.625 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:20:23.634 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-04-25T02:20:22.324415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":27629,"num_write_kb":366886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5330,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27158,"ondisk_log_size":27158,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1511048,"kb_used_data":309864,"kb_used_omap":0,"kb_used_meta":1201152,"kb_avail":375976312,"statfs":{"total":386547056640,"available":384999743488,"internally_reserved":0,"allocated":317300736,"data_stored":316815546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1229979648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002733"},"pg_stats":[{"pgid":"4.3f","version":"19'354","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:52.933304+0000","last_change":"2024-04-25T02:19:52.933304+0000","last_active":"2024-04-25T02:19:52.933304+0000","last_peered":"2024-04-25T02:19:52.933304+0000","last_clean":"2024-04-25T02:19:52.933304+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:19:52.933304+0000","last_undegraded":"2024-04-25T02:19:52.933304+0000","last_fullsized":"2024-04-25T02:19:52.933304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'354","last_scrub_stamp":"2024-04-25T02:19:52.933192+0000","last_deep_scrub":"19'354","last_deep_scrub_stamp":"2024-04-25T02:19:52.933192+0000","last_clean_scrub_stamp":"2024-04-25T02:19:52.933192+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'368","reported_seq":385,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:50.924366+0000","last_change":"2024-04-25T02:19:50.924366+0000","last_active":"2024-04-25T02:19:50.924366+0000","last_peered":"2024-04-25T02:19:50.924366+0000","last_clean":"2024-04-25T02:19:50.924366+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:19:50.924366+0000","last_undegraded":"2024-04-25T02:19:50.924366+0000","last_fullsized":"2024-04-25T02:19:50.924366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'368","last_scrub_stamp":"2024-04-25T02:19:50.924244+0000","last_deep_scrub":"19'368","last_deep_scrub_stamp":"2024-04-25T02:19:50.924244+0000","last_clean_scrub_stamp":"2024-04-25T02:19:50.924244+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267056+0000","last_change":"2024-04-25T02:10:02.737886+0000","last_active":"2024-04-25T02:18:51.267056+0000","last_peered":"2024-04-25T02:18:51.267056+0000","last_clean":"2024-04-25T02:18:51.267056+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:18:51.267056+0000","last_undegraded":"2024-04-25T02:18:51.267056+0000","last_fullsized":"2024-04-25T02:18:51.267056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'335","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.267040+0000","last_change":"2024-04-25T02:10:02.744825+0000","last_active":"2024-04-25T02:18:51.267040+0000","last_peered":"2024-04-25T02:18:51.267040+0000","last_clean":"2024-04-25T02:18:51.267040+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:18:51.267040+0000","last_undegraded":"2024-04-25T02:18:51.267040+0000","last_fullsized":"2024-04-25T02:18:51.267040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.269216+0000","last_change":"2024-04-25T02:10:02.742653+0000","last_active":"2024-04-25T02:18:51.269216+0000","last_peered":"2024-04-25T02:18:51.269216+0000","last_clean":"2024-04-25T02:18:51.269216+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:18:51.269216+0000","last_undegraded":"2024-04-25T02:18:51.269216+0000","last_fullsized":"2024-04-25T02:18:51.269216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.278782+0000","last_change":"2024-04-25T02:10:02.731951+0000","last_active":"2024-04-25T02:18:51.278782+0000","last_peered":"2024-04-25T02:18:51.278782+0000","last_clean":"2024-04-25T02:18:51.278782+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:18:51.278782+0000","last_undegraded":"2024-04-25T02:18:51.278782+0000","last_fullsized":"2024-04-25T02:18:51.278782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'376","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.272984+0000","last_change":"2024-04-25T02:10:02.735037+0000","last_active":"2024-04-25T02:18:51.272984+0000","last_peered":"2024-04-25T02:18:51.272984+0000","last_clean":"2024-04-25T02:18:51.272984+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:18:51.272984+0000","last_undegraded":"2024-04-25T02:18:51.272984+0000","last_fullsized":"2024-04-25T02:18:51.272984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":376,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":3216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'297","reported_seq":314,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:08.409247+0000","last_change":"2024-04-25T02:20:08.409247+0000","last_active":"2024-04-25T02:20:08.409247+0000","last_peered":"2024-04-25T02:20:08.409247+0000","last_clean":"2024-04-25T02:20:08.409247+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:20:08.409247+0000","last_undegraded":"2024-04-25T02:20:08.409247+0000","last_fullsized":"2024-04-25T02:20:08.409247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'297","last_scrub_stamp":"2024-04-25T02:20:08.409144+0000","last_deep_scrub":"19'297","last_deep_scrub_stamp":"2024-04-25T02:20:08.409144+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.409144+0000","log_size":297,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":2172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'371","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:20.357994+0000","last_change":"2024-04-25T02:20:20.357994+0000","last_active":"2024-04-25T02:20:20.357994+0000","last_peered":"2024-04-25T02:20:20.357994+0000","last_clean":"2024-04-25T02:20:20.357994+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:20:20.357994+0000","last_undegraded":"2024-04-25T02:20:20.357994+0000","last_fullsized":"2024-04-25T02:20:20.357994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'371","last_scrub_stamp":"2024-04-25T02:20:20.357892+0000","last_deep_scrub":"19'371","last_deep_scrub_stamp":"2024-04-25T02:20:20.357892+0000","last_clean_scrub_stamp":"2024-04-25T02:20:20.357892+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'351","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:05.364784+0000","last_change":"2024-04-25T02:20:05.364784+0000","last_active":"2024-04-25T02:20:05.364784+0000","last_peered":"2024-04-25T02:20:05.364784+0000","last_clean":"2024-04-25T02:20:05.364784+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:20:05.364784+0000","last_undegraded":"2024-04-25T02:20:05.364784+0000","last_fullsized":"2024-04-25T02:20:05.364784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'351","last_scrub_stamp":"2024-04-25T02:20:05.364633+0000","last_deep_scrub":"19'351","last_deep_scrub_stamp":"2024-04-25T02:20:05.364633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:05.364633+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'341","reported_seq":358,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:02.489243+0000","last_change":"2024-04-25T02:20:02.489243+0000","last_active":"2024-04-25T02:20:02.489243+0000","last_peered":"2024-04-25T02:20:02.489243+0000","last_clean":"2024-04-25T02:20:02.489243+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:20:02.489243+0000","last_undegraded":"2024-04-25T02:20:02.489243+0000","last_fullsized":"2024-04-25T02:20:02.489243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'341","last_scrub_stamp":"2024-04-25T02:20:02.489132+0000","last_deep_scrub":"19'341","last_deep_scrub_stamp":"2024-04-25T02:20:02.489132+0000","last_clean_scrub_stamp":"2024-04-25T02:20:02.489132+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":2530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'322","reported_seq":339,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:49.936957+0000","last_change":"2024-04-25T02:19:49.936957+0000","last_active":"2024-04-25T02:19:49.936957+0000","last_peered":"2024-04-25T02:19:49.936957+0000","last_clean":"2024-04-25T02:19:49.936957+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:19:49.936957+0000","last_undegraded":"2024-04-25T02:19:49.936957+0000","last_fullsized":"2024-04-25T02:19:49.936957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'322","last_scrub_stamp":"2024-04-25T02:19:49.936817+0000","last_deep_scrub":"19'322","last_deep_scrub_stamp":"2024-04-25T02:19:49.936817+0000","last_clean_scrub_stamp":"2024-04-25T02:19:49.936817+0000","log_size":322,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'359","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:48.915067+0000","last_change":"2024-04-25T02:19:48.915067+0000","last_active":"2024-04-25T02:19:48.915067+0000","last_peered":"2024-04-25T02:19:48.915067+0000","last_clean":"2024-04-25T02:19:48.915067+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:19:48.915067+0000","last_undegraded":"2024-04-25T02:19:48.915067+0000","last_fullsized":"2024-04-25T02:19:48.915067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'359","last_scrub_stamp":"2024-04-25T02:19:48.914957+0000","last_deep_scrub":"19'359","last_deep_scrub_stamp":"2024-04-25T02:19:48.914957+0000","last_clean_scrub_stamp":"2024-04-25T02:19:48.914957+0000","log_size":359,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":2645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'371","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:00.497023+0000","last_change":"2024-04-25T02:20:00.497023+0000","last_active":"2024-04-25T02:20:00.497023+0000","last_peered":"2024-04-25T02:20:00.497023+0000","last_clean":"2024-04-25T02:20:00.497023+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:20:00.497023+0000","last_undegraded":"2024-04-25T02:20:00.497023+0000","last_fullsized":"2024-04-25T02:20:00.497023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'371","last_scrub_stamp":"2024-04-25T02:20:00.496897+0000","last_deep_scrub":"19'371","last_deep_scrub_stamp":"2024-04-25T02:20:00.496897+0000","last_clean_scrub_stamp":"2024-04-25T02:20:00.496897+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'363","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:17.309351+0000","last_change":"2024-04-25T02:20:17.309351+0000","last_active":"2024-04-25T02:20:17.309351+0000","last_peered":"2024-04-25T02:20:17.309351+0000","last_clean":"2024-04-25T02:20:17.309351+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:20:17.309351+0000","last_undegraded":"2024-04-25T02:20:17.309351+0000","last_fullsized":"2024-04-25T02:20:17.309351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'363","last_scrub_stamp":"2024-04-25T02:20:17.309221+0000","last_deep_scrub":"19'363","last_deep_scrub_stamp":"2024-04-25T02:20:17.309221+0000","last_clean_scrub_stamp":"2024-04-25T02:20:17.309221+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'380","reported_seq":394,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:42.871312+0000","last_change":"2024-04-25T02:19:42.871312+0000","last_active":"2024-04-25T02:19:42.871312+0000","last_peered":"2024-04-25T02:19:42.871312+0000","last_clean":"2024-04-25T02:19:42.871312+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:19:42.871312+0000","last_undegraded":"2024-04-25T02:19:42.871312+0000","last_fullsized":"2024-04-25T02:19:42.871312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'380","last_scrub_stamp":"2024-04-25T02:19:42.871220+0000","last_deep_scrub":"19'380","last_deep_scrub_stamp":"2024-04-25T02:19:42.871220+0000","last_clean_scrub_stamp":"2024-04-25T02:19:42.871220+0000","log_size":380,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"19'367","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:14.380942+0000","last_change":"2024-04-25T02:20:14.380942+0000","last_active":"2024-04-25T02:20:14.380942+0000","last_peered":"2024-04-25T02:20:14.380942+0000","last_clean":"2024-04-25T02:20:14.380942+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:20:14.380942+0000","last_undegraded":"2024-04-25T02:20:14.380942+0000","last_fullsized":"2024-04-25T02:20:14.380942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'367","last_scrub_stamp":"2024-04-25T02:20:14.380829+0000","last_deep_scrub":"19'367","last_deep_scrub_stamp":"2024-04-25T02:20:14.380829+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.380829+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'340","reported_seq":357,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:07.471137+0000","last_change":"2024-04-25T02:20:07.471137+0000","last_active":"2024-04-25T02:20:07.471137+0000","last_peered":"2024-04-25T02:20:07.471137+0000","last_clean":"2024-04-25T02:20:07.471137+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:20:07.471137+0000","last_undegraded":"2024-04-25T02:20:07.471137+0000","last_fullsized":"2024-04-25T02:20:07.471137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'340","last_scrub_stamp":"2024-04-25T02:20:07.471014+0000","last_deep_scrub":"19'340","last_deep_scrub_stamp":"2024-04-25T02:20:07.471014+0000","last_clean_scrub_stamp":"2024-04-25T02:20:07.471014+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'356","reported_seq":373,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:40.854714+0000","last_change":"2024-04-25T02:19:40.854714+0000","last_active":"2024-04-25T02:19:40.854714+0000","last_peered":"2024-04-25T02:19:40.854714+0000","last_clean":"2024-04-25T02:19:40.854714+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:19:40.854714+0000","last_undegraded":"2024-04-25T02:19:40.854714+0000","last_fullsized":"2024-04-25T02:19:40.854714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'356","last_scrub_stamp":"2024-04-25T02:19:40.854586+0000","last_deep_scrub":"19'356","last_deep_scrub_stamp":"2024-04-25T02:19:40.854586+0000","last_clean_scrub_stamp":"2024-04-25T02:19:40.854586+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'401","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:59.508453+0000","last_change":"2024-04-25T02:19:59.508453+0000","last_active":"2024-04-25T02:19:59.508453+0000","last_peered":"2024-04-25T02:19:59.508453+0000","last_clean":"2024-04-25T02:19:59.508453+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:19:59.508453+0000","last_undegraded":"2024-04-25T02:19:59.508453+0000","last_fullsized":"2024-04-25T02:19:59.508453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'401","last_scrub_stamp":"2024-04-25T02:19:59.508346+0000","last_deep_scrub":"19'401","last_deep_scrub_stamp":"2024-04-25T02:19:59.508346+0000","last_clean_scrub_stamp":"2024-04-25T02:19:59.508346+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'344","reported_seq":358,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:39.836256+0000","last_change":"2024-04-25T02:19:39.836256+0000","last_active":"2024-04-25T02:19:39.836256+0000","last_peered":"2024-04-25T02:19:39.836256+0000","last_clean":"2024-04-25T02:19:39.836256+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:19:39.836256+0000","last_undegraded":"2024-04-25T02:19:39.836256+0000","last_fullsized":"2024-04-25T02:19:39.836256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'344","last_scrub_stamp":"2024-04-25T02:19:39.836145+0000","last_deep_scrub":"19'344","last_deep_scrub_stamp":"2024-04-25T02:19:39.836145+0000","last_clean_scrub_stamp":"2024-04-25T02:19:39.836145+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'383","reported_seq":400,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:04.410252+0000","last_change":"2024-04-25T02:20:04.410252+0000","last_active":"2024-04-25T02:20:04.410252+0000","last_peered":"2024-04-25T02:20:04.410252+0000","last_clean":"2024-04-25T02:20:04.410252+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:20:04.410252+0000","last_undegraded":"2024-04-25T02:20:04.410252+0000","last_fullsized":"2024-04-25T02:20:04.410252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'383","last_scrub_stamp":"2024-04-25T02:20:04.410115+0000","last_deep_scrub":"19'383","last_deep_scrub_stamp":"2024-04-25T02:20:04.410115+0000","last_clean_scrub_stamp":"2024-04-25T02:20:04.410115+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":2481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'350","reported_seq":362,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.273435+0000","last_change":"2024-04-25T02:10:02.741208+0000","last_active":"2024-04-25T02:18:51.273435+0000","last_peered":"2024-04-25T02:18:51.273435+0000","last_clean":"2024-04-25T02:18:51.273435+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:18:51.273435+0000","last_undegraded":"2024-04-25T02:18:51.273435+0000","last_fullsized":"2024-04-25T02:18:51.273435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":350,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'367","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:55.557095+0000","last_change":"2024-04-25T02:19:55.557095+0000","last_active":"2024-04-25T02:19:55.557095+0000","last_peered":"2024-04-25T02:19:55.557095+0000","last_clean":"2024-04-25T02:19:55.557095+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:19:55.557095+0000","last_undegraded":"2024-04-25T02:19:55.557095+0000","last_fullsized":"2024-04-25T02:19:55.557095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'367","last_scrub_stamp":"2024-04-25T02:19:55.556990+0000","last_deep_scrub":"19'367","last_deep_scrub_stamp":"2024-04-25T02:19:55.556990+0000","last_clean_scrub_stamp":"2024-04-25T02:19:55.556990+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'386","reported_seq":403,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:54.545557+0000","last_change":"2024-04-25T02:19:54.545557+0000","last_active":"2024-04-25T02:19:54.545557+0000","last_peered":"2024-04-25T02:19:54.545557+0000","last_clean":"2024-04-25T02:19:54.545557+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:19:54.545557+0000","last_undegraded":"2024-04-25T02:19:54.545557+0000","last_fullsized":"2024-04-25T02:19:54.545557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'386","last_scrub_stamp":"2024-04-25T02:19:54.545439+0000","last_deep_scrub":"19'386","last_deep_scrub_stamp":"2024-04-25T02:19:54.545439+0000","last_clean_scrub_stamp":"2024-04-25T02:19:54.545439+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'421","reported_seq":438,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:51.548406+0000","last_change":"2024-04-25T02:19:51.548406+0000","last_active":"2024-04-25T02:19:51.548406+0000","last_peered":"2024-04-25T02:19:51.548406+0000","last_clean":"2024-04-25T02:19:51.548406+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:19:51.548406+0000","last_undegraded":"2024-04-25T02:19:51.548406+0000","last_fullsized":"2024-04-25T02:19:51.548406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'421","last_scrub_stamp":"2024-04-25T02:19:51.548298+0000","last_deep_scrub":"19'421","last_deep_scrub_stamp":"2024-04-25T02:19:51.548298+0000","last_clean_scrub_stamp":"2024-04-25T02:19:51.548298+0000","log_size":421,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'341","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.268411+0000","last_change":"2024-04-25T02:10:02.746772+0000","last_active":"2024-04-25T02:18:51.268411+0000","last_peered":"2024-04-25T02:18:51.268411+0000","last_clean":"2024-04-25T02:18:51.268411+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:18:51.268411+0000","last_undegraded":"2024-04-25T02:18:51.268411+0000","last_fullsized":"2024-04-25T02:18:51.268411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'157","reported_seq":175,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:22.516024+0000","last_change":"2024-04-25T02:19:22.516024+0000","last_active":"2024-04-25T02:19:22.516024+0000","last_peered":"2024-04-25T02:19:22.516024+0000","last_clean":"2024-04-25T02:19:22.516024+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:19:22.516024+0000","last_undegraded":"2024-04-25T02:19:22.516024+0000","last_fullsized":"2024-04-25T02:19:22.516024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'157","last_scrub_stamp":"2024-04-25T02:19:22.515900+0000","last_deep_scrub":"19'157","last_deep_scrub_stamp":"2024-04-25T02:19:22.515900+0000","last_clean_scrub_stamp":"2024-04-25T02:19:22.515900+0000","log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":16455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'334","reported_seq":351,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:19.721820+0000","last_change":"2024-04-25T02:20:19.721820+0000","last_active":"2024-04-25T02:20:19.721820+0000","last_peered":"2024-04-25T02:20:19.721820+0000","last_clean":"2024-04-25T02:20:19.721820+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:20:19.721820+0000","last_undegraded":"2024-04-25T02:20:19.721820+0000","last_fullsized":"2024-04-25T02:20:19.721820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'334","last_scrub_stamp":"2024-04-25T02:20:19.721706+0000","last_deep_scrub":"19'334","last_deep_scrub_stamp":"2024-04-25T02:20:19.721706+0000","last_clean_scrub_stamp":"2024-04-25T02:20:19.721706+0000","log_size":334,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'77","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.512649+0000","last_change":"2024-04-25T02:19:19.512649+0000","last_active":"2024-04-25T02:19:19.512649+0000","last_peered":"2024-04-25T02:19:19.512649+0000","last_clean":"2024-04-25T02:19:19.512649+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:19:19.512649+0000","last_undegraded":"2024-04-25T02:19:19.512649+0000","last_fullsized":"2024-04-25T02:19:19.512649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'77","last_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_deep_scrub":"19'77","last_deep_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.512541+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'347","reported_seq":364,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:59.343505+0000","last_change":"2024-04-25T02:19:59.343505+0000","last_active":"2024-04-25T02:19:59.343505+0000","last_peered":"2024-04-25T02:19:59.343505+0000","last_clean":"2024-04-25T02:19:59.343505+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:19:59.343505+0000","last_undegraded":"2024-04-25T02:19:59.343505+0000","last_fullsized":"2024-04-25T02:19:59.343505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'347","last_scrub_stamp":"2024-04-25T02:19:59.343384+0000","last_deep_scrub":"19'347","last_deep_scrub_stamp":"2024-04-25T02:19:59.343384+0000","last_clean_scrub_stamp":"2024-04-25T02:19:59.343384+0000","log_size":347,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'246","reported_seq":264,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:52.823739+0000","last_change":"2024-04-25T02:19:52.823739+0000","last_active":"2024-04-25T02:19:52.823739+0000","last_peered":"2024-04-25T02:19:52.823739+0000","last_clean":"2024-04-25T02:19:52.823739+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:19:52.823739+0000","last_undegraded":"2024-04-25T02:19:52.823739+0000","last_fullsized":"2024-04-25T02:19:52.823739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'246","last_scrub_stamp":"2024-04-25T02:19:52.823636+0000","last_deep_scrub":"19'246","last_deep_scrub_stamp":"2024-04-25T02:19:52.823636+0000","last_clean_scrub_stamp":"2024-04-25T02:19:52.823636+0000","log_size":246,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:20.688299+0000","last_change":"2024-04-25T02:20:20.688299+0000","last_active":"2024-04-25T02:20:20.688299+0000","last_peered":"2024-04-25T02:20:20.688299+0000","last_clean":"2024-04-25T02:20:20.688299+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:20:20.688299+0000","last_undegraded":"2024-04-25T02:20:20.688299+0000","last_fullsized":"2024-04-25T02:20:20.688299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:20:20.688162+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:20:20.688162+0000","last_clean_scrub_stamp":"2024-04-25T02:20:20.688162+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'6","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.290157+0000","last_change":"2024-04-25T02:19:27.290157+0000","last_active":"2024-04-25T02:19:27.290157+0000","last_peered":"2024-04-25T02:19:27.290157+0000","last_clean":"2024-04-25T02:19:27.290157+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:19:27.290157+0000","last_undegraded":"2024-04-25T02:19:27.290157+0000","last_fullsized":"2024-04-25T02:19:27.290157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-25T02:19:27.290042+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-25T02:19:27.290042+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.290042+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'377","reported_seq":394,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:09.794740+0000","last_change":"2024-04-25T02:20:09.794740+0000","last_active":"2024-04-25T02:20:09.794740+0000","last_peered":"2024-04-25T02:20:09.794740+0000","last_clean":"2024-04-25T02:20:09.794740+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:20:09.794740+0000","last_undegraded":"2024-04-25T02:20:09.794740+0000","last_fullsized":"2024-04-25T02:20:09.794740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'377","last_scrub_stamp":"2024-04-25T02:20:09.794627+0000","last_deep_scrub":"19'377","last_deep_scrub_stamp":"2024-04-25T02:20:09.794627+0000","last_clean_scrub_stamp":"2024-04-25T02:20:09.794627+0000","log_size":377,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":2757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'81","reported_seq":99,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:15.705733+0000","last_change":"2024-04-25T02:19:15.705733+0000","last_active":"2024-04-25T02:19:15.705733+0000","last_peered":"2024-04-25T02:19:15.705733+0000","last_clean":"2024-04-25T02:19:15.705733+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:19:15.705733+0000","last_undegraded":"2024-04-25T02:19:15.705733+0000","last_fullsized":"2024-04-25T02:19:15.705733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'81","last_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_deep_scrub":"19'81","last_deep_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_clean_scrub_stamp":"2024-04-25T02:19:15.705635+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6184361,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'412","reported_seq":429,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:10.759375+0000","last_change":"2024-04-25T02:20:10.759375+0000","last_active":"2024-04-25T02:20:10.759375+0000","last_peered":"2024-04-25T02:20:10.759375+0000","last_clean":"2024-04-25T02:20:10.759375+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:20:10.759375+0000","last_undegraded":"2024-04-25T02:20:10.759375+0000","last_fullsized":"2024-04-25T02:20:10.759375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'412","last_scrub_stamp":"2024-04-25T02:20:10.759237+0000","last_deep_scrub":"19'412","last_deep_scrub_stamp":"2024-04-25T02:20:10.759237+0000","last_clean_scrub_stamp":"2024-04-25T02:20:10.759237+0000","log_size":412,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'364","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.364468+0000","last_change":"2024-04-25T02:19:25.364468+0000","last_active":"2024-04-25T02:19:25.364468+0000","last_peered":"2024-04-25T02:19:25.364468+0000","last_clean":"2024-04-25T02:19:25.364468+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:19:25.364468+0000","last_undegraded":"2024-04-25T02:19:25.364468+0000","last_fullsized":"2024-04-25T02:19:25.364468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'364","last_scrub_stamp":"2024-04-25T02:19:25.364369+0000","last_deep_scrub":"19'364","last_deep_scrub_stamp":"2024-04-25T02:19:25.364369+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.364369+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'363","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:42.550756+0000","last_change":"2024-04-25T02:19:42.550756+0000","last_active":"2024-04-25T02:19:42.550756+0000","last_peered":"2024-04-25T02:19:42.550756+0000","last_clean":"2024-04-25T02:19:42.550756+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:19:42.550756+0000","last_undegraded":"2024-04-25T02:19:42.550756+0000","last_fullsized":"2024-04-25T02:19:42.550756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'363","last_scrub_stamp":"2024-04-25T02:19:42.550634+0000","last_deep_scrub":"19'363","last_deep_scrub_stamp":"2024-04-25T02:19:42.550634+0000","last_clean_scrub_stamp":"2024-04-25T02:19:42.550634+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'310","reported_seq":328,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:44.851470+0000","last_change":"2024-04-25T02:19:44.851470+0000","last_active":"2024-04-25T02:19:44.851470+0000","last_peered":"2024-04-25T02:19:44.851470+0000","last_clean":"2024-04-25T02:19:44.851470+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:19:44.851470+0000","last_undegraded":"2024-04-25T02:19:44.851470+0000","last_fullsized":"2024-04-25T02:19:44.851470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'310","last_scrub_stamp":"2024-04-25T02:19:44.851352+0000","last_deep_scrub":"19'310","last_deep_scrub_stamp":"2024-04-25T02:19:44.851352+0000","last_clean_scrub_stamp":"2024-04-25T02:19:44.851352+0000","log_size":310,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8389252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":12434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'364","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:26.735843+0000","last_change":"2024-04-25T02:19:26.735843+0000","last_active":"2024-04-25T02:19:26.735843+0000","last_peered":"2024-04-25T02:19:26.735843+0000","last_clean":"2024-04-25T02:19:26.735843+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:19:26.735843+0000","last_undegraded":"2024-04-25T02:19:26.735843+0000","last_fullsized":"2024-04-25T02:19:26.735843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'364","last_scrub_stamp":"2024-04-25T02:19:26.735719+0000","last_deep_scrub":"19'364","last_deep_scrub_stamp":"2024-04-25T02:19:26.735719+0000","last_clean_scrub_stamp":"2024-04-25T02:19:26.735719+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'129","reported_seq":147,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:43.842800+0000","last_change":"2024-04-25T02:19:43.842800+0000","last_active":"2024-04-25T02:19:43.842800+0000","last_peered":"2024-04-25T02:19:43.842800+0000","last_clean":"2024-04-25T02:19:43.842800+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:19:43.842800+0000","last_undegraded":"2024-04-25T02:19:43.842800+0000","last_fullsized":"2024-04-25T02:19:43.842800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'129","last_scrub_stamp":"2024-04-25T02:19:43.842706+0000","last_deep_scrub":"19'129","last_deep_scrub_stamp":"2024-04-25T02:19:43.842706+0000","last_clean_scrub_stamp":"2024-04-25T02:19:43.842706+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'333","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.771910+0000","last_change":"2024-04-25T02:19:27.771910+0000","last_active":"2024-04-25T02:19:27.771910+0000","last_peered":"2024-04-25T02:19:27.771910+0000","last_clean":"2024-04-25T02:19:27.771910+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:19:27.771910+0000","last_undegraded":"2024-04-25T02:19:27.771910+0000","last_fullsized":"2024-04-25T02:19:27.771910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:27.771815+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:27.771815+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.771815+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.296955+0000","last_change":"2024-04-25T02:19:21.296955+0000","last_active":"2024-04-25T02:19:21.296955+0000","last_peered":"2024-04-25T02:19:21.296955+0000","last_clean":"2024-04-25T02:19:21.296955+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:19:21.296955+0000","last_undegraded":"2024-04-25T02:19:21.296955+0000","last_fullsized":"2024-04-25T02:19:21.296955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.296829+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'353","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:13.727323+0000","last_change":"2024-04-25T02:20:13.727323+0000","last_active":"2024-04-25T02:20:13.727323+0000","last_peered":"2024-04-25T02:20:13.727323+0000","last_clean":"2024-04-25T02:20:13.727323+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:20:13.727323+0000","last_undegraded":"2024-04-25T02:20:13.727323+0000","last_fullsized":"2024-04-25T02:20:13.727323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'353","last_scrub_stamp":"2024-04-25T02:20:13.727198+0000","last_deep_scrub":"19'353","last_deep_scrub_stamp":"2024-04-25T02:20:13.727198+0000","last_clean_scrub_stamp":"2024-04-25T02:20:13.727198+0000","log_size":353,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'3","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:31.773766+0000","last_change":"2024-04-25T02:19:31.773766+0000","last_active":"2024-04-25T02:19:31.773766+0000","last_peered":"2024-04-25T02:19:31.773766+0000","last_clean":"2024-04-25T02:19:31.773766+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:19:31.773766+0000","last_undegraded":"2024-04-25T02:19:31.773766+0000","last_fullsized":"2024-04-25T02:19:31.773766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-25T02:19:31.773623+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-25T02:19:31.773623+0000","last_clean_scrub_stamp":"2024-04-25T02:19:31.773623+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'406","reported_seq":423,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:56.431591+0000","last_change":"2024-04-25T02:19:56.431591+0000","last_active":"2024-04-25T02:19:56.431591+0000","last_peered":"2024-04-25T02:19:56.431591+0000","last_clean":"2024-04-25T02:19:56.431591+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:19:56.431591+0000","last_undegraded":"2024-04-25T02:19:56.431591+0000","last_fullsized":"2024-04-25T02:19:56.431591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'406","last_scrub_stamp":"2024-04-25T02:19:56.431479+0000","last_deep_scrub":"19'406","last_deep_scrub_stamp":"2024-04-25T02:19:56.431479+0000","last_clean_scrub_stamp":"2024-04-25T02:19:56.431479+0000","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":2547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'140","reported_seq":158,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.491862+0000","last_change":"2024-04-25T02:19:11.491862+0000","last_active":"2024-04-25T02:19:11.491862+0000","last_peered":"2024-04-25T02:19:11.491862+0000","last_clean":"2024-04-25T02:19:11.491862+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:19:11.491862+0000","last_undegraded":"2024-04-25T02:19:11.491862+0000","last_fullsized":"2024-04-25T02:19:11.491862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'140","last_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_deep_scrub":"19'140","last_deep_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.491759+0000","log_size":140,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'351","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:30.803636+0000","last_change":"2024-04-25T02:19:30.803636+0000","last_active":"2024-04-25T02:19:30.803636+0000","last_peered":"2024-04-25T02:19:30.803636+0000","last_clean":"2024-04-25T02:19:30.803636+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:19:30.803636+0000","last_undegraded":"2024-04-25T02:19:30.803636+0000","last_fullsized":"2024-04-25T02:19:30.803636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'351","last_scrub_stamp":"2024-04-25T02:19:30.803487+0000","last_deep_scrub":"19'351","last_deep_scrub_stamp":"2024-04-25T02:19:30.803487+0000","last_clean_scrub_stamp":"2024-04-25T02:19:30.803487+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'48","reported_seq":66,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.281870+0000","last_change":"2024-04-25T02:19:19.281870+0000","last_active":"2024-04-25T02:19:19.281870+0000","last_peered":"2024-04-25T02:19:19.281870+0000","last_clean":"2024-04-25T02:19:19.281870+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:19:19.281870+0000","last_undegraded":"2024-04-25T02:19:19.281870+0000","last_fullsized":"2024-04-25T02:19:19.281870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'48","last_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_deep_scrub":"19'48","last_deep_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.281770+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'375","reported_seq":392,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:05.765806+0000","last_change":"2024-04-25T02:20:05.765806+0000","last_active":"2024-04-25T02:20:05.765806+0000","last_peered":"2024-04-25T02:20:05.765806+0000","last_clean":"2024-04-25T02:20:05.765806+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:20:05.765806+0000","last_undegraded":"2024-04-25T02:20:05.765806+0000","last_fullsized":"2024-04-25T02:20:05.765806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-04-25T02:20:05.765699+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-04-25T02:20:05.765699+0000","last_clean_scrub_stamp":"2024-04-25T02:20:05.765699+0000","log_size":375,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'109","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.663012+0000","last_change":"2024-04-25T02:19:13.663012+0000","last_active":"2024-04-25T02:19:13.663012+0000","last_peered":"2024-04-25T02:19:13.663012+0000","last_clean":"2024-04-25T02:19:13.663012+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:19:13.663012+0000","last_undegraded":"2024-04-25T02:19:13.663012+0000","last_fullsized":"2024-04-25T02:19:13.663012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'109","last_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_deep_scrub":"19'109","last_deep_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.662909+0000","log_size":109,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'396","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:35.607004+0000","last_change":"2024-04-25T02:19:35.607004+0000","last_active":"2024-04-25T02:19:35.607004+0000","last_peered":"2024-04-25T02:19:35.607004+0000","last_clean":"2024-04-25T02:19:35.607004+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:19:35.607004+0000","last_undegraded":"2024-04-25T02:19:35.607004+0000","last_fullsized":"2024-04-25T02:19:35.607004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'396","last_scrub_stamp":"2024-04-25T02:19:35.606880+0000","last_deep_scrub":"19'396","last_deep_scrub_stamp":"2024-04-25T02:19:35.606880+0000","last_clean_scrub_stamp":"2024-04-25T02:19:35.606880+0000","log_size":396,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'84","reported_seq":102,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:29.801974+0000","last_change":"2024-04-25T02:19:29.801974+0000","last_active":"2024-04-25T02:19:29.801974+0000","last_peered":"2024-04-25T02:19:29.801974+0000","last_clean":"2024-04-25T02:19:29.801974+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:19:29.801974+0000","last_undegraded":"2024-04-25T02:19:29.801974+0000","last_fullsized":"2024-04-25T02:19:29.801974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'84","last_scrub_stamp":"2024-04-25T02:19:29.801721+0000","last_deep_scrub":"19'84","last_deep_scrub_stamp":"2024-04-25T02:19:29.801721+0000","last_clean_scrub_stamp":"2024-04-25T02:19:29.801721+0000","log_size":84,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'356","reported_seq":373,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.666077+0000","last_change":"2024-04-25T02:19:19.666077+0000","last_active":"2024-04-25T02:19:19.666077+0000","last_peered":"2024-04-25T02:19:19.666077+0000","last_clean":"2024-04-25T02:19:19.666077+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:19:19.666077+0000","last_undegraded":"2024-04-25T02:19:19.666077+0000","last_fullsized":"2024-04-25T02:19:19.666077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'356","last_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_deep_scrub":"19'356","last_deep_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.665961+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'33","reported_seq":51,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.244079+0000","last_change":"2024-04-25T02:19:09.244079+0000","last_active":"2024-04-25T02:19:09.244079+0000","last_peered":"2024-04-25T02:19:09.244079+0000","last_clean":"2024-04-25T02:19:09.244079+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:19:09.244079+0000","last_undegraded":"2024-04-25T02:19:09.244079+0000","last_fullsized":"2024-04-25T02:19:09.244079+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'33","last_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_deep_scrub":"19'33","last_deep_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.243976+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'398","reported_seq":415,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:51.347108+0000","last_change":"2024-04-25T02:19:51.347108+0000","last_active":"2024-04-25T02:19:51.347108+0000","last_peered":"2024-04-25T02:19:51.347108+0000","last_clean":"2024-04-25T02:19:51.347108+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:19:51.347108+0000","last_undegraded":"2024-04-25T02:19:51.347108+0000","last_fullsized":"2024-04-25T02:19:51.347108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'398","last_scrub_stamp":"2024-04-25T02:19:51.346998+0000","last_deep_scrub":"19'398","last_deep_scrub_stamp":"2024-04-25T02:19:51.346998+0000","last_clean_scrub_stamp":"2024-04-25T02:19:51.346998+0000","log_size":398,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'117","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.843685+0000","last_change":"2024-04-25T02:19:25.843685+0000","last_active":"2024-04-25T02:19:25.843685+0000","last_peered":"2024-04-25T02:19:25.843685+0000","last_clean":"2024-04-25T02:19:25.843685+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:19:25.843685+0000","last_undegraded":"2024-04-25T02:19:25.843685+0000","last_fullsized":"2024-04-25T02:19:25.843685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'117","last_scrub_stamp":"2024-04-25T02:19:25.843568+0000","last_deep_scrub":"19'117","last_deep_scrub_stamp":"2024-04-25T02:19:25.843568+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.843568+0000","log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":12332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":450,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'459","reported_seq":476,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:54.392846+0000","last_change":"2024-04-25T02:19:54.392846+0000","last_active":"2024-04-25T02:19:54.392846+0000","last_peered":"2024-04-25T02:19:54.392846+0000","last_clean":"2024-04-25T02:19:54.392846+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:19:54.392846+0000","last_undegraded":"2024-04-25T02:19:54.392846+0000","last_fullsized":"2024-04-25T02:19:54.392846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'459","last_scrub_stamp":"2024-04-25T02:19:54.392702+0000","last_deep_scrub":"19'459","last_deep_scrub_stamp":"2024-04-25T02:19:54.392702+0000","last_clean_scrub_stamp":"2024-04-25T02:19:54.392702+0000","log_size":459,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'76","reported_seq":94,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.854739+0000","last_change":"2024-04-25T02:19:21.854739+0000","last_active":"2024-04-25T02:19:21.854739+0000","last_peered":"2024-04-25T02:19:21.854739+0000","last_clean":"2024-04-25T02:19:21.854739+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:19:21.854739+0000","last_undegraded":"2024-04-25T02:19:21.854739+0000","last_fullsized":"2024-04-25T02:19:21.854739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'76","last_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_deep_scrub":"19'76","last_deep_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.854641+0000","log_size":76,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'354","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.708606+0000","last_change":"2024-04-25T02:19:21.708606+0000","last_active":"2024-04-25T02:19:21.708606+0000","last_peered":"2024-04-25T02:19:21.708606+0000","last_clean":"2024-04-25T02:19:21.708606+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:19:21.708606+0000","last_undegraded":"2024-04-25T02:19:21.708606+0000","last_fullsized":"2024-04-25T02:19:21.708606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'354","last_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_deep_scrub":"19'354","last_deep_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.708495+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"19'32","reported_seq":50,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:17.789878+0000","last_change":"2024-04-25T02:19:17.789878+0000","last_active":"2024-04-25T02:19:17.789878+0000","last_peered":"2024-04-25T02:19:17.789878+0000","last_clean":"2024-04-25T02:19:17.789878+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:19:17.789878+0000","last_undegraded":"2024-04-25T02:19:17.789878+0000","last_fullsized":"2024-04-25T02:19:17.789878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'32","last_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_deep_scrub":"19'32","last_deep_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_clean_scrub_stamp":"2024-04-25T02:19:17.789779+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'332","reported_seq":349,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:24.721403+0000","last_change":"2024-04-25T02:19:24.721403+0000","last_active":"2024-04-25T02:19:24.721403+0000","last_peered":"2024-04-25T02:19:24.721403+0000","last_clean":"2024-04-25T02:19:24.721403+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:19:24.721403+0000","last_undegraded":"2024-04-25T02:19:24.721403+0000","last_fullsized":"2024-04-25T02:19:24.721403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'332","last_scrub_stamp":"2024-04-25T02:19:24.721294+0000","last_deep_scrub":"19'332","last_deep_scrub_stamp":"2024-04-25T02:19:24.721294+0000","last_clean_scrub_stamp":"2024-04-25T02:19:24.721294+0000","log_size":332,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'113","reported_seq":131,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.807276+0000","last_change":"2024-04-25T02:19:16.807276+0000","last_active":"2024-04-25T02:19:16.807276+0000","last_peered":"2024-04-25T02:19:16.807276+0000","last_clean":"2024-04-25T02:19:16.807276+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:19:16.807276+0000","last_undegraded":"2024-04-25T02:19:16.807276+0000","last_fullsized":"2024-04-25T02:19:16.807276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'113","last_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_deep_scrub":"19'113","last_deep_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.807162+0000","log_size":113,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'328","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:38.577551+0000","last_change":"2024-04-25T02:19:38.577551+0000","last_active":"2024-04-25T02:19:38.577551+0000","last_peered":"2024-04-25T02:19:38.577551+0000","last_clean":"2024-04-25T02:19:38.577551+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:19:38.577551+0000","last_undegraded":"2024-04-25T02:19:38.577551+0000","last_fullsized":"2024-04-25T02:19:38.577551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'328","last_scrub_stamp":"2024-04-25T02:19:38.577424+0000","last_deep_scrub":"19'328","last_deep_scrub_stamp":"2024-04-25T02:19:38.577424+0000","last_clean_scrub_stamp":"2024-04-25T02:19:38.577424+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.467431+0000","last_change":"2024-04-25T02:19:02.467431+0000","last_active":"2024-04-25T02:19:02.467431+0000","last_peered":"2024-04-25T02:19:02.467431+0000","last_clean":"2024-04-25T02:19:02.467431+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:19:02.467431+0000","last_undegraded":"2024-04-25T02:19:02.467431+0000","last_fullsized":"2024-04-25T02:19:02.467431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.467334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'95","reported_seq":113,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.615993+0000","last_change":"2024-04-25T02:19:11.615993+0000","last_active":"2024-04-25T02:19:11.615993+0000","last_peered":"2024-04-25T02:19:11.615993+0000","last_clean":"2024-04-25T02:19:11.615993+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:19:11.615993+0000","last_undegraded":"2024-04-25T02:19:11.615993+0000","last_fullsized":"2024-04-25T02:19:11.615993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'95","last_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_deep_scrub":"19'95","last_deep_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.615813+0000","log_size":95,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:26.561694+0000","last_change":"2024-04-25T02:19:26.561694+0000","last_active":"2024-04-25T02:19:26.561694+0000","last_peered":"2024-04-25T02:19:26.561694+0000","last_clean":"2024-04-25T02:19:26.561694+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:19:26.561694+0000","last_undegraded":"2024-04-25T02:19:26.561694+0000","last_fullsized":"2024-04-25T02:19:26.561694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:26.561581+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:26.561581+0000","last_clean_scrub_stamp":"2024-04-25T02:19:26.561581+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:06.911064+0000","last_change":"2024-04-25T02:19:06.911064+0000","last_active":"2024-04-25T02:19:06.911064+0000","last_peered":"2024-04-25T02:19:06.911064+0000","last_clean":"2024-04-25T02:19:06.911064+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:19:06.911064+0000","last_undegraded":"2024-04-25T02:19:06.911064+0000","last_fullsized":"2024-04-25T02:19:06.911064+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_clean_scrub_stamp":"2024-04-25T02:19:06.910932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'16","reported_seq":34,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.302362+0000","last_change":"2024-04-25T02:19:05.302362+0000","last_active":"2024-04-25T02:19:05.302362+0000","last_peered":"2024-04-25T02:19:05.302362+0000","last_clean":"2024-04-25T02:19:05.302362+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:19:05.302362+0000","last_undegraded":"2024-04-25T02:19:05.302362+0000","last_fullsized":"2024-04-25T02:19:05.302362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'16","last_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_deep_scrub":"19'16","last_deep_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.302256+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'326","reported_seq":343,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.576881+0000","last_change":"2024-04-25T02:19:27.576881+0000","last_active":"2024-04-25T02:19:27.576881+0000","last_peered":"2024-04-25T02:19:27.576881+0000","last_clean":"2024-04-25T02:19:27.576881+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:19:27.576881+0000","last_undegraded":"2024-04-25T02:19:27.576881+0000","last_fullsized":"2024-04-25T02:19:27.576881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'326","last_scrub_stamp":"2024-04-25T02:19:27.576765+0000","last_deep_scrub":"19'326","last_deep_scrub_stamp":"2024-04-25T02:19:27.576765+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.576765+0000","log_size":326,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.564824+0000","last_change":"2024-04-25T02:19:01.564824+0000","last_active":"2024-04-25T02:19:01.564824+0000","last_peered":"2024-04-25T02:19:01.564824+0000","last_clean":"2024-04-25T02:19:01.564824+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:19:01.564824+0000","last_undegraded":"2024-04-25T02:19:01.564824+0000","last_fullsized":"2024-04-25T02:19:01.564824+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.564726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'243","reported_seq":261,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.526240+0000","last_change":"2024-04-25T02:19:08.526240+0000","last_active":"2024-04-25T02:19:08.526240+0000","last_peered":"2024-04-25T02:19:08.526240+0000","last_clean":"2024-04-25T02:19:08.526240+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:19:08.526240+0000","last_undegraded":"2024-04-25T02:19:08.526240+0000","last_fullsized":"2024-04-25T02:19:08.526240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'243","last_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_deep_scrub":"19'243","last_deep_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.526107+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":12388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'331","reported_seq":348,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:29.573912+0000","last_change":"2024-04-25T02:19:29.573912+0000","last_active":"2024-04-25T02:19:29.573912+0000","last_peered":"2024-04-25T02:19:29.573912+0000","last_clean":"2024-04-25T02:19:29.573912+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:19:29.573912+0000","last_undegraded":"2024-04-25T02:19:29.573912+0000","last_fullsized":"2024-04-25T02:19:29.573912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'331","last_scrub_stamp":"2024-04-25T02:19:29.573769+0000","last_deep_scrub":"19'331","last_deep_scrub_stamp":"2024-04-25T02:19:29.573769+0000","last_clean_scrub_stamp":"2024-04-25T02:19:29.573769+0000","log_size":331,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":2335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.862881+0000","last_change":"2024-04-25T02:19:07.862881+0000","last_active":"2024-04-25T02:19:07.862881+0000","last_peered":"2024-04-25T02:19:07.862881+0000","last_clean":"2024-04-25T02:19:07.862881+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:19:07.862881+0000","last_undegraded":"2024-04-25T02:19:07.862881+0000","last_fullsized":"2024-04-25T02:19:07.862881+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.862746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.436078+0000","last_change":"2024-04-25T02:19:01.436078+0000","last_active":"2024-04-25T02:19:01.436078+0000","last_peered":"2024-04-25T02:19:01.436078+0000","last_clean":"2024-04-25T02:19:01.436078+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:19:01.436078+0000","last_undegraded":"2024-04-25T02:19:01.436078+0000","last_fullsized":"2024-04-25T02:19:01.436078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.435931+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'162","reported_seq":180,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.898853+0000","last_change":"2024-04-25T02:19:11.898853+0000","last_active":"2024-04-25T02:19:11.898853+0000","last_peered":"2024-04-25T02:19:11.898853+0000","last_clean":"2024-04-25T02:19:11.898853+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:19:11.898853+0000","last_undegraded":"2024-04-25T02:19:11.898853+0000","last_fullsized":"2024-04-25T02:19:11.898853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'162","last_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_deep_scrub":"19'162","last_deep_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.898758+0000","log_size":162,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'344","reported_seq":361,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:03.772638+0000","last_change":"2024-04-25T02:20:03.772638+0000","last_active":"2024-04-25T02:20:03.772638+0000","last_peered":"2024-04-25T02:20:03.772638+0000","last_clean":"2024-04-25T02:20:03.772638+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:20:03.772638+0000","last_undegraded":"2024-04-25T02:20:03.772638+0000","last_fullsized":"2024-04-25T02:20:03.772638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'344","last_scrub_stamp":"2024-04-25T02:20:03.772541+0000","last_deep_scrub":"19'344","last_deep_scrub_stamp":"2024-04-25T02:20:03.772541+0000","last_clean_scrub_stamp":"2024-04-25T02:20:03.772541+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.879508+0000","last_change":"2024-04-25T02:19:05.879508+0000","last_active":"2024-04-25T02:19:05.879508+0000","last_peered":"2024-04-25T02:19:05.879508+0000","last_clean":"2024-04-25T02:19:05.879508+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:19:05.879508+0000","last_undegraded":"2024-04-25T02:19:05.879508+0000","last_fullsized":"2024-04-25T02:19:05.879508+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.879394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'626","reported_seq":1266,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.344141+0000","last_change":"2024-04-25T02:19:02.344141+0000","last_active":"2024-04-25T02:19:02.344141+0000","last_peered":"2024-04-25T02:19:02.344141+0000","last_clean":"2024-04-25T02:19:02.344141+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:19:02.344141+0000","last_undegraded":"2024-04-25T02:19:02.344141+0000","last_fullsized":"2024-04-25T02:19:02.344141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'626","last_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_deep_scrub":"19'626","last_deep_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.344043+0000","log_size":626,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1113626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":622,"num_write_kb":1507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'415","reported_seq":432,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:49.328465+0000","last_change":"2024-04-25T02:19:49.328465+0000","last_active":"2024-04-25T02:19:49.328465+0000","last_peered":"2024-04-25T02:19:49.328465+0000","last_clean":"2024-04-25T02:19:49.328465+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:19:49.328465+0000","last_undegraded":"2024-04-25T02:19:49.328465+0000","last_fullsized":"2024-04-25T02:19:49.328465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'415","last_scrub_stamp":"2024-04-25T02:19:49.328361+0000","last_deep_scrub":"19'415","last_deep_scrub_stamp":"2024-04-25T02:19:49.328361+0000","last_clean_scrub_stamp":"2024-04-25T02:19:49.328361+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.840625+0000","last_change":"2024-04-25T02:19:08.840625+0000","last_active":"2024-04-25T02:19:08.840625+0000","last_peered":"2024-04-25T02:19:08.840625+0000","last_clean":"2024-04-25T02:19:08.840625+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:19:08.840625+0000","last_undegraded":"2024-04-25T02:19:08.840625+0000","last_fullsized":"2024-04-25T02:19:08.840625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.840520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'45","reported_seq":63,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.518176+0000","last_change":"2024-04-25T02:19:09.518176+0000","last_active":"2024-04-25T02:19:09.518176+0000","last_peered":"2024-04-25T02:19:09.518176+0000","last_clean":"2024-04-25T02:19:09.518176+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:19:09.518176+0000","last_undegraded":"2024-04-25T02:19:09.518176+0000","last_fullsized":"2024-04-25T02:19:09.518176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'45","last_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_deep_scrub":"19'45","last_deep_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.518059+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'343","reported_seq":360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:42.360853+0000","last_change":"2024-04-25T02:19:42.360853+0000","last_active":"2024-04-25T02:19:42.360853+0000","last_peered":"2024-04-25T02:19:42.360853+0000","last_clean":"2024-04-25T02:19:42.360853+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:19:42.360853+0000","last_undegraded":"2024-04-25T02:19:42.360853+0000","last_fullsized":"2024-04-25T02:19:42.360853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'343","last_scrub_stamp":"2024-04-25T02:19:42.360731+0000","last_deep_scrub":"19'343","last_deep_scrub_stamp":"2024-04-25T02:19:42.360731+0000","last_clean_scrub_stamp":"2024-04-25T02:19:42.360731+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'65","reported_seq":83,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.839509+0000","last_change":"2024-04-25T02:19:13.839509+0000","last_active":"2024-04-25T02:19:13.839509+0000","last_peered":"2024-04-25T02:19:13.839509+0000","last_clean":"2024-04-25T02:19:13.839509+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:19:13.839509+0000","last_undegraded":"2024-04-25T02:19:13.839509+0000","last_fullsized":"2024-04-25T02:19:13.839509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'65","last_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_deep_scrub":"19'65","last_deep_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.839408+0000","log_size":65,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:03.479134+0000","last_change":"2024-04-25T02:19:03.479134+0000","last_active":"2024-04-25T02:19:03.479134+0000","last_peered":"2024-04-25T02:19:03.479134+0000","last_clean":"2024-04-25T02:19:03.479134+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:19:03.479134+0000","last_undegraded":"2024-04-25T02:19:03.479134+0000","last_fullsized":"2024-04-25T02:19:03.479134+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_clean_scrub_stamp":"2024-04-25T02:19:03.479027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'368","reported_seq":385,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:02.816642+0000","last_change":"2024-04-25T02:20:02.816642+0000","last_active":"2024-04-25T02:20:02.816642+0000","last_peered":"2024-04-25T02:20:02.816642+0000","last_clean":"2024-04-25T02:20:02.816642+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:20:02.816642+0000","last_undegraded":"2024-04-25T02:20:02.816642+0000","last_fullsized":"2024-04-25T02:20:02.816642+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'368","last_scrub_stamp":"2024-04-25T02:20:02.816526+0000","last_deep_scrub":"19'368","last_deep_scrub_stamp":"2024-04-25T02:20:02.816526+0000","last_clean_scrub_stamp":"2024-04-25T02:20:02.816526+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:10.845393+0000","last_change":"2024-04-25T02:19:10.845393+0000","last_active":"2024-04-25T02:19:10.845393+0000","last_peered":"2024-04-25T02:19:10.845393+0000","last_clean":"2024-04-25T02:19:10.845393+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:19:10.845393+0000","last_undegraded":"2024-04-25T02:19:10.845393+0000","last_fullsized":"2024-04-25T02:19:10.845393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_clean_scrub_stamp":"2024-04-25T02:19:10.845259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'72","reported_seq":90,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.244226+0000","last_change":"2024-04-25T02:19:07.244226+0000","last_active":"2024-04-25T02:19:07.244226+0000","last_peered":"2024-04-25T02:19:07.244226+0000","last_clean":"2024-04-25T02:19:07.244226+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:19:07.244226+0000","last_undegraded":"2024-04-25T02:19:07.244226+0000","last_fullsized":"2024-04-25T02:19:07.244226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'72","last_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_deep_scrub":"19'72","last_deep_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.244087+0000","log_size":72,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'336","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.688927+0000","last_change":"2024-04-25T02:19:16.688927+0000","last_active":"2024-04-25T02:19:16.688927+0000","last_peered":"2024-04-25T02:19:16.688927+0000","last_clean":"2024-04-25T02:19:16.688927+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:19:16.688927+0000","last_undegraded":"2024-04-25T02:19:16.688927+0000","last_fullsized":"2024-04-25T02:19:16.688927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'336","last_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_deep_scrub":"19'336","last_deep_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.688815+0000","log_size":336,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'30","reported_seq":48,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:30.310189+0000","last_change":"2024-04-25T02:19:30.310189+0000","last_active":"2024-04-25T02:19:30.310189+0000","last_peered":"2024-04-25T02:19:30.310189+0000","last_clean":"2024-04-25T02:19:30.310189+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:19:30.310189+0000","last_undegraded":"2024-04-25T02:19:30.310189+0000","last_fullsized":"2024-04-25T02:19:30.310189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'30","last_scrub_stamp":"2024-04-25T02:19:30.310064+0000","last_deep_scrub":"19'30","last_deep_scrub_stamp":"2024-04-25T02:19:30.310064+0000","last_clean_scrub_stamp":"2024-04-25T02:19:30.310064+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:38.812597+0000","last_change":"2024-04-25T02:19:38.812597+0000","last_active":"2024-04-25T02:19:38.812597+0000","last_peered":"2024-04-25T02:19:38.812597+0000","last_clean":"2024-04-25T02:19:38.812597+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:19:38.812597+0000","last_undegraded":"2024-04-25T02:19:38.812597+0000","last_fullsized":"2024-04-25T02:19:38.812597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:38.812488+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:38.812488+0000","last_clean_scrub_stamp":"2024-04-25T02:19:38.812488+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'48","reported_seq":66,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.575977+0000","last_change":"2024-04-25T02:19:25.575977+0000","last_active":"2024-04-25T02:19:25.575977+0000","last_peered":"2024-04-25T02:19:25.575977+0000","last_clean":"2024-04-25T02:19:25.575977+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:19:25.575977+0000","last_undegraded":"2024-04-25T02:19:25.575977+0000","last_fullsized":"2024-04-25T02:19:25.575977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'48","last_scrub_stamp":"2024-04-25T02:19:25.575846+0000","last_deep_scrub":"19'48","last_deep_scrub_stamp":"2024-04-25T02:19:25.575846+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.575846+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'335","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:36.792418+0000","last_change":"2024-04-25T02:19:36.792418+0000","last_active":"2024-04-25T02:19:36.792418+0000","last_peered":"2024-04-25T02:19:36.792418+0000","last_clean":"2024-04-25T02:19:36.792418+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:19:36.792418+0000","last_undegraded":"2024-04-25T02:19:36.792418+0000","last_fullsized":"2024-04-25T02:19:36.792418+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'335","last_scrub_stamp":"2024-04-25T02:19:36.792293+0000","last_deep_scrub":"19'335","last_deep_scrub_stamp":"2024-04-25T02:19:36.792293+0000","last_clean_scrub_stamp":"2024-04-25T02:19:36.792293+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":2199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'246","reported_seq":264,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:57.854639+0000","last_change":"2024-04-25T02:19:57.854639+0000","last_active":"2024-04-25T02:19:57.854639+0000","last_peered":"2024-04-25T02:19:57.854639+0000","last_clean":"2024-04-25T02:19:57.854639+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:19:57.854639+0000","last_undegraded":"2024-04-25T02:19:57.854639+0000","last_fullsized":"2024-04-25T02:19:57.854639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'246","last_scrub_stamp":"2024-04-25T02:19:57.854529+0000","last_deep_scrub":"19'246","last_deep_scrub_stamp":"2024-04-25T02:19:57.854529+0000","last_clean_scrub_stamp":"2024-04-25T02:19:57.854529+0000","log_size":246,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'358","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:34.856685+0000","last_change":"2024-04-25T02:19:34.856685+0000","last_active":"2024-04-25T02:19:34.856685+0000","last_peered":"2024-04-25T02:19:34.856685+0000","last_clean":"2024-04-25T02:19:34.856685+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:19:34.856685+0000","last_undegraded":"2024-04-25T02:19:34.856685+0000","last_fullsized":"2024-04-25T02:19:34.856685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'358","last_scrub_stamp":"2024-04-25T02:19:34.856571+0000","last_deep_scrub":"19'358","last_deep_scrub_stamp":"2024-04-25T02:19:34.856571+0000","last_clean_scrub_stamp":"2024-04-25T02:19:34.856571+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'111","reported_seq":129,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:00.870849+0000","last_change":"2024-04-25T02:20:00.870849+0000","last_active":"2024-04-25T02:20:00.870849+0000","last_peered":"2024-04-25T02:20:00.870849+0000","last_clean":"2024-04-25T02:20:00.870849+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:20:00.870849+0000","last_undegraded":"2024-04-25T02:20:00.870849+0000","last_fullsized":"2024-04-25T02:20:00.870849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'111","last_scrub_stamp":"2024-04-25T02:20:00.870745+0000","last_deep_scrub":"19'111","last_deep_scrub_stamp":"2024-04-25T02:20:00.870745+0000","last_clean_scrub_stamp":"2024-04-25T02:20:00.870745+0000","log_size":111,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'370","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:17.718343+0000","last_change":"2024-04-25T02:20:17.718343+0000","last_active":"2024-04-25T02:20:17.718343+0000","last_peered":"2024-04-25T02:20:17.718343+0000","last_clean":"2024-04-25T02:20:17.718343+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:20:17.718343+0000","last_undegraded":"2024-04-25T02:20:17.718343+0000","last_fullsized":"2024-04-25T02:20:17.718343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'370","last_scrub_stamp":"2024-04-25T02:20:17.718225+0000","last_deep_scrub":"19'370","last_deep_scrub_stamp":"2024-04-25T02:20:17.718225+0000","last_clean_scrub_stamp":"2024-04-25T02:20:17.718225+0000","log_size":370,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'58","reported_seq":76,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:33.337408+0000","last_change":"2024-04-25T02:19:33.337408+0000","last_active":"2024-04-25T02:19:33.337408+0000","last_peered":"2024-04-25T02:19:33.337408+0000","last_clean":"2024-04-25T02:19:33.337408+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:19:33.337408+0000","last_undegraded":"2024-04-25T02:19:33.337408+0000","last_fullsized":"2024-04-25T02:19:33.337408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'58","last_scrub_stamp":"2024-04-25T02:19:33.337308+0000","last_deep_scrub":"19'58","last_deep_scrub_stamp":"2024-04-25T02:19:33.337308+0000","last_clean_scrub_stamp":"2024-04-25T02:19:33.337308+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'414","reported_seq":431,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:32.829574+0000","last_change":"2024-04-25T02:19:32.829574+0000","last_active":"2024-04-25T02:19:32.829574+0000","last_peered":"2024-04-25T02:19:32.829574+0000","last_clean":"2024-04-25T02:19:32.829574+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:19:32.829574+0000","last_undegraded":"2024-04-25T02:19:32.829574+0000","last_fullsized":"2024-04-25T02:19:32.829574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'414","last_scrub_stamp":"2024-04-25T02:19:32.829454+0000","last_deep_scrub":"19'414","last_deep_scrub_stamp":"2024-04-25T02:19:32.829454+0000","last_clean_scrub_stamp":"2024-04-25T02:19:32.829454+0000","log_size":414,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'413","reported_seq":430,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:44.539813+0000","last_change":"2024-04-25T02:19:44.539813+0000","last_active":"2024-04-25T02:19:44.539813+0000","last_peered":"2024-04-25T02:19:44.539813+0000","last_clean":"2024-04-25T02:19:44.539813+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:19:44.539813+0000","last_undegraded":"2024-04-25T02:19:44.539813+0000","last_fullsized":"2024-04-25T02:19:44.539813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'413","last_scrub_stamp":"2024-04-25T02:19:44.539696+0000","last_deep_scrub":"19'413","last_deep_scrub_stamp":"2024-04-25T02:19:44.539696+0000","last_clean_scrub_stamp":"2024-04-25T02:19:44.539696+0000","log_size":413,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":2919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'401","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.276676+0000","last_change":"2024-04-25T02:10:02.740725+0000","last_active":"2024-04-25T02:18:51.276676+0000","last_peered":"2024-04-25T02:18:51.276676+0000","last_clean":"2024-04-25T02:18:51.276676+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:18:51.276676+0000","last_undegraded":"2024-04-25T02:18:51.276676+0000","last_fullsized":"2024-04-25T02:18:51.276676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":3172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'394","reported_seq":411,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:02.325169+0000","last_change":"2024-04-25T02:20:02.325169+0000","last_active":"2024-04-25T02:20:02.325169+0000","last_peered":"2024-04-25T02:20:02.325169+0000","last_clean":"2024-04-25T02:20:02.325169+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:20:02.325169+0000","last_undegraded":"2024-04-25T02:20:02.325169+0000","last_fullsized":"2024-04-25T02:20:02.325169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'394","last_scrub_stamp":"2024-04-25T02:20:02.325045+0000","last_deep_scrub":"19'394","last_deep_scrub_stamp":"2024-04-25T02:20:02.325045+0000","last_clean_scrub_stamp":"2024-04-25T02:20:02.325045+0000","log_size":394,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'366","reported_seq":378,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:18:51.259897+0000","last_change":"2024-04-25T02:10:02.737682+0000","last_active":"2024-04-25T02:18:51.259897+0000","last_peered":"2024-04-25T02:18:51.259897+0000","last_clean":"2024-04-25T02:18:51.259897+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:18:51.259897+0000","last_undegraded":"2024-04-25T02:18:51.259897+0000","last_fullsized":"2024-04-25T02:18:51.259897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:10:02.336284+0000","last_clean_scrub_stamp":"2024-04-25T02:10:02.336284+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:50.505906+0000","last_change":"2024-04-25T02:19:50.505906+0000","last_active":"2024-04-25T02:19:50.505906+0000","last_peered":"2024-04-25T02:19:50.505906+0000","last_clean":"2024-04-25T02:19:50.505906+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:19:50.505906+0000","last_undegraded":"2024-04-25T02:19:50.505906+0000","last_fullsized":"2024-04-25T02:19:50.505906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:50.505793+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:50.505793+0000","last_clean_scrub_stamp":"2024-04-25T02:19:50.505793+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":167505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23216,"ondisk_log_size":23216,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":3994,"num_write_kb":199381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5330,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316645376,"data_stored":316588690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3942,"ondisk_log_size":3942,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705793,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370056,"kb_used_data":72832,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94001784,"statfs":{"total":96636764160,"available":96257826816,"internally_reserved":0,"allocated":74579968,"data_stored":74464209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.253,"15min":0.26900000000000002},"min":{"1min":0.17799999999999999,"5min":0.156,"15min":0.14599999999999999},"max":{"1min":0.46899999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.29399999999999998},"min":{"1min":0.20000000000000001,"5min":0.16500000000000001,"15min":0.16300000000000001},"max":{"1min":0.495,"5min":0.50900000000000001,"15min":0.53400000000000003},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.27900000000000003,"15min":0.30099999999999999},"min":{"1min":0.24299999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.28399999999999997,"15min":0.30099999999999999},"min":{"1min":0.246,"5min":0.186,"15min":0.186},"max":{"1min":0.55300000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.37}]},{"osd":3,"last update":"Thu Apr 25 02:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.30499999999999999,"15min":0.32700000000000001},"min":{"1min":0.24199999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.307,"15min":0.32400000000000001},"min":{"1min":0.28699999999999998,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":0.54600000000000004,"5min":0.628,"15min":0.628},"last":0.32600000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705792,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405844,"kb_used_data":100428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93965996,"statfs":{"total":96636764160,"available":96221179904,"internally_reserved":0,"allocated":102838272,"data_stored":102710905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.251,"15min":0.28599999999999998},"min":{"1min":0.20999999999999999,"5min":0.153,"15min":0.13200000000000001},"max":{"1min":0.44,"5min":0.44900000000000001,"15min":0.49299999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.26300000000000001,"15min":0.29399999999999998},"min":{"1min":0.23499999999999999,"5min":0.16700000000000001,"15min":0.155},"max":{"1min":0.45200000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.307}]},{"osd":1,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.28199999999999997,"15min":0.315},"min":{"1min":0.28699999999999998,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.28599999999999998,"15min":0.314},"min":{"1min":0.253,"5min":0.19400000000000001,"15min":0.16700000000000001},"max":{"1min":0.48299999999999998,"5min":0.50700000000000001,"15min":0.53400000000000003},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.29799999999999999,"15min":0.32800000000000001},"min":{"1min":0.315,"5min":0.186,"15min":0.186},"max":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.32800000000000001},"min":{"1min":0.28499999999999998,"5min":0.19400000000000001,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.51900000000000002},"last":0.29099999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705792,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364024,"kb_used_data":66800,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94007816,"statfs":{"total":96636764160,"available":96264003584,"internally_reserved":0,"allocated":68403200,"data_stored":68279904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.68400000000000005,"15min":0.42999999999999999},"min":{"1min":0.23200000000000001,"5min":0.156,"15min":0.14399999999999999},"max":{"1min":0.42799999999999999,"5min":34.734000000000002,"15min":34.734000000000002},"last":0.317},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.254,"5min":0.16700000000000001,"15min":0.16300000000000001},"max":{"1min":0.46999999999999997,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41299999999999998,"15min":0.35699999999999998},"min":{"1min":0.23699999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.51900000000000002,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.40999999999999998,"15min":0.35599999999999998},"min":{"1min":0.28499999999999998,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":0.498,"5min":9.2899999999999991,"15min":9.2899999999999991},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.68300000000000005,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.182,"15min":0.182},"max":{"1min":0.49199999999999999,"5min":29.867999999999999,"15min":29.867999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.55900000000000005,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":0.501,"5min":20.276,"15min":20.276},"last":0.39900000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705793,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371124,"kb_used_data":69804,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94000716,"statfs":{"total":96636764160,"available":96256733184,"internally_reserved":0,"allocated":71479296,"data_stored":71360528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.246,"15min":0.27200000000000002},"min":{"1min":0.22900000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.443,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.313},{"interface":"front","average":{"1min":0.314,"5min":0.26700000000000002,"15min":0.28899999999999998},"min":{"1min":0.22700000000000001,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":0.48899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.246}]},{"osd":2,"last update":"Thu Apr 25 02:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.28699999999999998,"15min":0.311},"min":{"1min":0.25900000000000001,"5min":0.154,"15min":0.153},"max":{"1min":0.504,"5min":0.53300000000000003,"15min":0.57799999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.309,"15min":0.33300000000000002},"min":{"1min":0.255,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.52000000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.311},"min":{"1min":0.26000000000000001,"5min":0.17999999999999999,"15min":0.17799999999999999},"max":{"1min":0.53800000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.308,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.27800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68239360,"data_stored":68223190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74416128,"data_stored":74407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102674432,"data_stored":102654191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:20:23.638 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:23.638 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:23.638 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:23.639 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:23.639 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:23.639 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:23.639 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:23.640 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:23.640 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T02:10:02.336284+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=18, tm_sec=59, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:20:23.640 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:20:43.642 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:20:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.767+0000 7f2c8788e700 1 Processor -- start 2024-04-25T02:20:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.767+0000 7f2c8788e700 1 -- start start 2024-04-25T02:20:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8788e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c801271d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8788e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c80127780 0x7f2c80127ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8788e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c80091c00 con 0x7f2c80095190 2024-04-25T02:20:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8788e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c80092130 con 0x7f2c80127780 2024-04-25T02:20:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8788e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80096b10 con 0x7f2c80062860 2024-04-25T02:20:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8562a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c801271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c84e29700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c80127780 0x7f2c80127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:43.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c85e2b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2c80095190 0x7f2c80095640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39470/0 (socket says 172.21.15.78:39470) 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c84e29700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c80127780 0x7f2c80127ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49334/0 (socket says 172.21.15.78:49334) 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8562a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c801271d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37526/0 (socket says 172.21.15.78:37526) 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c85e2b700 1 -- 172.21.15.78:0/2285585761 learned_addr learned my addr 172.21.15.78:0/2285585761 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8562a700 1 -- 172.21.15.78:0/2285585761 >> v2:172.21.15.78:3300/0 conn(0x7f2c80127780 msgr2=0x7f2c80127ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8562a700 1 --2- 172.21.15.78:0/2285585761 >> v2:172.21.15.78:3300/0 conn(0x7f2c80127780 0x7f2c80127ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8562a700 1 -- 172.21.15.78:0/2285585761 >> v1:172.21.15.78:6789/0 conn(0x7f2c80095190 legacy=0x7f2c80095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8562a700 1 -- 172.21.15.78:0/2285585761 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80092a40 con 0x7f2c80062860 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c84e29700 1 --2- 172.21.15.78:0/2285585761 >> v2:172.21.15.78:3300/0 conn(0x7f2c80127780 0x7f2c80127ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.768+0000 7f2c8562a700 1 --2- 172.21.15.78:0/2285585761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c801271d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f2c7c009760 tx=0x7f2c7c009060).ready entity=mon.2 client_cookie=354505a4b7d7caa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c77fff700 1 -- 172.21.15.78:0/2285585761 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c0090d0 con 0x7f2c80062860 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c77fff700 1 -- 172.21.15.78:0/2285585761 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c00f510 con 0x7f2c80062860 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c77fff700 1 -- 172.21.15.78:0/2285585761 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00f890 con 0x7f2c80062860 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c8788e700 1 -- 172.21.15.78:0/2285585761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 msgr2=0x7f2c801271d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c8788e700 1 --2- 172.21.15.78:0/2285585761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c801271d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f2c7c009760 tx=0x7f2c7c009060).stop 2024-04-25T02:20:43.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c8788e700 1 -- 172.21.15.78:0/2285585761 shutdown_connections 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c8788e700 1 --2- 172.21.15.78:0/2285585761 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c801271d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c8788e700 1 --2- 172.21.15.78:0/2285585761 >> v2:172.21.15.78:3300/0 conn(0x7f2c80127780 0x7f2c80127ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c8788e700 1 -- 172.21.15.78:0/2285585761 >> 172.21.15.78:0/2285585761 conn(0x7f2c80097450 msgr2=0x7f2c80097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c8788e700 1 -- 172.21.15.78:0/2285585761 shutdown_connections 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.769+0000 7f2c8788e700 1 -- 172.21.15.78:0/2285585761 wait complete. 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.770+0000 7f2c8788e700 1 Processor -- start 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.770+0000 7f2c8788e700 1 -- start start 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8788e700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c80119810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8788e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c80095190 0x7f2c801157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8788e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80127780 0x7f2c80115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8788e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80126dd0 con 0x7f2c80127780 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8788e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80126940 con 0x7f2c80095190 2024-04-25T02:20:43.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8788e700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80096d70 con 0x7f2c80062860 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8562a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c80119810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c84e29700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c80095190 0x7f2c801157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c84e29700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c80095190 0x7f2c801157e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51480/0 (socket says 172.21.15.78:51480) 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c85e2b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80127780 0x7f2c80115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8562a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c80119810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37532/0 (socket says 172.21.15.78:37532) 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c84e29700 1 -- 172.21.15.78:0/2218622633 learned_addr learned my addr 172.21.15.78:0/2218622633 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c84e29700 1 -- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 msgr2=0x7f2c80119810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c84e29700 1 --2- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c80119810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c84e29700 1 -- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80127780 msgr2=0x7f2c80115cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c84e29700 1 --2- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80127780 0x7f2c80115cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c84e29700 1 -- 172.21.15.78:0/2218622633 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700092a0 con 0x7f2c80095190 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c85e2b700 1 --2- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80127780 0x7f2c80115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8562a700 1 --2- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c80119810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c84e29700 1 --2- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c80095190 0x7f2c801157e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2c7000ea00 tx=0x7f2c70009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:43.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c75ffb700 1 -- 172.21.15.78:0/2218622633 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000c6a0 con 0x7f2c80095190 2024-04-25T02:20:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c75ffb700 1 -- 172.21.15.78:0/2218622633 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000c800 con 0x7f2c80095190 2024-04-25T02:20:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c75ffb700 1 -- 172.21.15.78:0/2218622633 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000cb80 con 0x7f2c80095190 2024-04-25T02:20:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.771+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c0092a0 con 0x7f2c80095190 2024-04-25T02:20:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.772+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c80117c60 con 0x7f2c80095190 2024-04-25T02:20:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.772+0000 7f2c75ffb700 1 -- 172.21.15.78:0/2218622633 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f2c7001b400 con 0x7f2c80095190 2024-04-25T02:20:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.772+0000 7f2c75ffb700 1 -- 172.21.15.78:0/2218622633 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f2c7003b740 con 0x7f2c80095190 2024-04-25T02:20:43.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.773+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c80097f70 con 0x7f2c80095190 2024-04-25T02:20:43.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.777+0000 7f2c75ffb700 1 -- 172.21.15.78:0/2218622633 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f2c70019900 con 0x7f2c80095190 2024-04-25T02:20:43.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.931+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 --> v1:172.21.15.78:6816/46507 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c80046ce0 con 0x7f2c6402bd00 2024-04-25T02:20:43.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.938+0000 7f2c75ffb700 1 -- 172.21.15.78:0/2218622633 <== mgr.4102 v1:172.21.15.78:6816/46507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256978 (unknown 2965378022 0 1631932364) 0x7f2c80046ce0 con 0x7f2c6402bd00 2024-04-25T02:20:43.945 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:20:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 >> v1:172.21.15.78:6816/46507 conn(0x7f2c6402bd00 legacy=0x7f2c6402e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c80095190 msgr2=0x7f2c801157e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 --2- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c80095190 0x7f2c801157e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2c7000ea00 tx=0x7f2c70009060).stop 2024-04-25T02:20:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 shutdown_connections 2024-04-25T02:20:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 --2- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80127780 0x7f2c80115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 --2- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f2c80062860 0x7f2c80119810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 --2- 172.21.15.78:0/2218622633 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2c80095190 0x7f2c801157e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 >> 172.21.15.78:0/2218622633 conn(0x7f2c80097450 msgr2=0x7f2c8012abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 shutdown_connections 2024-04-25T02:20:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:43.941+0000 7f2c8788e700 1 -- 172.21.15.78:0/2218622633 wait complete. 2024-04-25T02:20:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-04-25T02:20:43.956 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-04-25T02:20:42.329287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":27629,"num_write_kb":366886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5330,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27158,"ondisk_log_size":27158,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1511048,"kb_used_data":309864,"kb_used_omap":0,"kb_used_meta":1201152,"kb_avail":375976312,"statfs":{"total":386547056640,"available":384999743488,"internally_reserved":0,"allocated":317300736,"data_stored":316815546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1229979648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002871"},"pg_stats":[{"pgid":"4.3f","version":"19'354","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:52.933304+0000","last_change":"2024-04-25T02:19:52.933304+0000","last_active":"2024-04-25T02:19:52.933304+0000","last_peered":"2024-04-25T02:19:52.933304+0000","last_clean":"2024-04-25T02:19:52.933304+0000","last_became_active":"2024-04-25T02:10:02.748498+0000","last_became_peered":"2024-04-25T02:10:02.748498+0000","last_unstale":"2024-04-25T02:19:52.933304+0000","last_undegraded":"2024-04-25T02:19:52.933304+0000","last_fullsized":"2024-04-25T02:19:52.933304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'354","last_scrub_stamp":"2024-04-25T02:19:52.933192+0000","last_deep_scrub":"19'354","last_deep_scrub_stamp":"2024-04-25T02:19:52.933192+0000","last_clean_scrub_stamp":"2024-04-25T02:19:52.933192+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'368","reported_seq":385,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:50.924366+0000","last_change":"2024-04-25T02:19:50.924366+0000","last_active":"2024-04-25T02:19:50.924366+0000","last_peered":"2024-04-25T02:19:50.924366+0000","last_clean":"2024-04-25T02:19:50.924366+0000","last_became_active":"2024-04-25T02:10:02.744058+0000","last_became_peered":"2024-04-25T02:10:02.744058+0000","last_unstale":"2024-04-25T02:19:50.924366+0000","last_undegraded":"2024-04-25T02:19:50.924366+0000","last_fullsized":"2024-04-25T02:19:50.924366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'368","last_scrub_stamp":"2024-04-25T02:19:50.924244+0000","last_deep_scrub":"19'368","last_deep_scrub_stamp":"2024-04-25T02:19:50.924244+0000","last_clean_scrub_stamp":"2024-04-25T02:19:50.924244+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'358","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:35.113006+0000","last_change":"2024-04-25T02:20:35.113006+0000","last_active":"2024-04-25T02:20:35.113006+0000","last_peered":"2024-04-25T02:20:35.113006+0000","last_clean":"2024-04-25T02:20:35.113006+0000","last_became_active":"2024-04-25T02:10:02.737629+0000","last_became_peered":"2024-04-25T02:10:02.737629+0000","last_unstale":"2024-04-25T02:20:35.113006+0000","last_undegraded":"2024-04-25T02:20:35.113006+0000","last_fullsized":"2024-04-25T02:20:35.113006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'358","last_scrub_stamp":"2024-04-25T02:20:35.112892+0000","last_deep_scrub":"19'358","last_deep_scrub_stamp":"2024-04-25T02:20:35.112892+0000","last_clean_scrub_stamp":"2024-04-25T02:20:35.112892+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'335","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:30.181572+0000","last_change":"2024-04-25T02:20:30.181572+0000","last_active":"2024-04-25T02:20:30.181572+0000","last_peered":"2024-04-25T02:20:30.181572+0000","last_clean":"2024-04-25T02:20:30.181572+0000","last_became_active":"2024-04-25T02:10:02.744541+0000","last_became_peered":"2024-04-25T02:10:02.744541+0000","last_unstale":"2024-04-25T02:20:30.181572+0000","last_undegraded":"2024-04-25T02:20:30.181572+0000","last_fullsized":"2024-04-25T02:20:30.181572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'335","last_scrub_stamp":"2024-04-25T02:20:30.181448+0000","last_deep_scrub":"19'335","last_deep_scrub_stamp":"2024-04-25T02:20:30.181448+0000","last_clean_scrub_stamp":"2024-04-25T02:20:30.181448+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'366","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:29.214012+0000","last_change":"2024-04-25T02:20:29.214012+0000","last_active":"2024-04-25T02:20:29.214012+0000","last_peered":"2024-04-25T02:20:29.214012+0000","last_clean":"2024-04-25T02:20:29.214012+0000","last_became_active":"2024-04-25T02:10:02.742411+0000","last_became_peered":"2024-04-25T02:10:02.742411+0000","last_unstale":"2024-04-25T02:20:29.214012+0000","last_undegraded":"2024-04-25T02:20:29.214012+0000","last_fullsized":"2024-04-25T02:20:29.214012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'366","last_scrub_stamp":"2024-04-25T02:20:29.213900+0000","last_deep_scrub":"19'366","last_deep_scrub_stamp":"2024-04-25T02:20:29.213900+0000","last_clean_scrub_stamp":"2024-04-25T02:20:29.213900+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'364","reported_seq":381,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.728526+0000","last_change":"2024-04-25T02:20:36.728526+0000","last_active":"2024-04-25T02:20:36.728526+0000","last_peered":"2024-04-25T02:20:36.728526+0000","last_clean":"2024-04-25T02:20:36.728526+0000","last_became_active":"2024-04-25T02:10:02.731714+0000","last_became_peered":"2024-04-25T02:10:02.731714+0000","last_unstale":"2024-04-25T02:20:36.728526+0000","last_undegraded":"2024-04-25T02:20:36.728526+0000","last_fullsized":"2024-04-25T02:20:36.728526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'364","last_scrub_stamp":"2024-04-25T02:20:36.728417+0000","last_deep_scrub":"19'364","last_deep_scrub_stamp":"2024-04-25T02:20:36.728417+0000","last_clean_scrub_stamp":"2024-04-25T02:20:36.728417+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":2317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'376","reported_seq":393,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:34.764875+0000","last_change":"2024-04-25T02:20:34.764875+0000","last_active":"2024-04-25T02:20:34.764875+0000","last_peered":"2024-04-25T02:20:34.764875+0000","last_clean":"2024-04-25T02:20:34.764875+0000","last_became_active":"2024-04-25T02:10:02.734774+0000","last_became_peered":"2024-04-25T02:10:02.734774+0000","last_unstale":"2024-04-25T02:20:34.764875+0000","last_undegraded":"2024-04-25T02:20:34.764875+0000","last_fullsized":"2024-04-25T02:20:34.764875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'376","last_scrub_stamp":"2024-04-25T02:20:34.764765+0000","last_deep_scrub":"19'376","last_deep_scrub_stamp":"2024-04-25T02:20:34.764765+0000","last_clean_scrub_stamp":"2024-04-25T02:20:34.764765+0000","log_size":376,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":3216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'297","reported_seq":314,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:08.409247+0000","last_change":"2024-04-25T02:20:08.409247+0000","last_active":"2024-04-25T02:20:08.409247+0000","last_peered":"2024-04-25T02:20:08.409247+0000","last_clean":"2024-04-25T02:20:08.409247+0000","last_became_active":"2024-04-25T02:10:02.731375+0000","last_became_peered":"2024-04-25T02:10:02.731375+0000","last_unstale":"2024-04-25T02:20:08.409247+0000","last_undegraded":"2024-04-25T02:20:08.409247+0000","last_fullsized":"2024-04-25T02:20:08.409247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'297","last_scrub_stamp":"2024-04-25T02:20:08.409144+0000","last_deep_scrub":"19'297","last_deep_scrub_stamp":"2024-04-25T02:20:08.409144+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.409144+0000","log_size":297,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":2172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'371","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:20.357994+0000","last_change":"2024-04-25T02:20:20.357994+0000","last_active":"2024-04-25T02:20:20.357994+0000","last_peered":"2024-04-25T02:20:20.357994+0000","last_clean":"2024-04-25T02:20:20.357994+0000","last_became_active":"2024-04-25T02:10:02.747313+0000","last_became_peered":"2024-04-25T02:10:02.747313+0000","last_unstale":"2024-04-25T02:20:20.357994+0000","last_undegraded":"2024-04-25T02:20:20.357994+0000","last_fullsized":"2024-04-25T02:20:20.357994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'371","last_scrub_stamp":"2024-04-25T02:20:20.357892+0000","last_deep_scrub":"19'371","last_deep_scrub_stamp":"2024-04-25T02:20:20.357892+0000","last_clean_scrub_stamp":"2024-04-25T02:20:20.357892+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'351","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:05.364784+0000","last_change":"2024-04-25T02:20:05.364784+0000","last_active":"2024-04-25T02:20:05.364784+0000","last_peered":"2024-04-25T02:20:05.364784+0000","last_clean":"2024-04-25T02:20:05.364784+0000","last_became_active":"2024-04-25T02:10:02.729844+0000","last_became_peered":"2024-04-25T02:10:02.729844+0000","last_unstale":"2024-04-25T02:20:05.364784+0000","last_undegraded":"2024-04-25T02:20:05.364784+0000","last_fullsized":"2024-04-25T02:20:05.364784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'351","last_scrub_stamp":"2024-04-25T02:20:05.364633+0000","last_deep_scrub":"19'351","last_deep_scrub_stamp":"2024-04-25T02:20:05.364633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:05.364633+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'341","reported_seq":358,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:02.489243+0000","last_change":"2024-04-25T02:20:02.489243+0000","last_active":"2024-04-25T02:20:02.489243+0000","last_peered":"2024-04-25T02:20:02.489243+0000","last_clean":"2024-04-25T02:20:02.489243+0000","last_became_active":"2024-04-25T02:10:02.729803+0000","last_became_peered":"2024-04-25T02:10:02.729803+0000","last_unstale":"2024-04-25T02:20:02.489243+0000","last_undegraded":"2024-04-25T02:20:02.489243+0000","last_fullsized":"2024-04-25T02:20:02.489243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'341","last_scrub_stamp":"2024-04-25T02:20:02.489132+0000","last_deep_scrub":"19'341","last_deep_scrub_stamp":"2024-04-25T02:20:02.489132+0000","last_clean_scrub_stamp":"2024-04-25T02:20:02.489132+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":2530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'322","reported_seq":339,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:49.936957+0000","last_change":"2024-04-25T02:19:49.936957+0000","last_active":"2024-04-25T02:19:49.936957+0000","last_peered":"2024-04-25T02:19:49.936957+0000","last_clean":"2024-04-25T02:19:49.936957+0000","last_became_active":"2024-04-25T02:10:02.743219+0000","last_became_peered":"2024-04-25T02:10:02.743219+0000","last_unstale":"2024-04-25T02:19:49.936957+0000","last_undegraded":"2024-04-25T02:19:49.936957+0000","last_fullsized":"2024-04-25T02:19:49.936957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'322","last_scrub_stamp":"2024-04-25T02:19:49.936817+0000","last_deep_scrub":"19'322","last_deep_scrub_stamp":"2024-04-25T02:19:49.936817+0000","last_clean_scrub_stamp":"2024-04-25T02:19:49.936817+0000","log_size":322,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":2207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'359","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:48.915067+0000","last_change":"2024-04-25T02:19:48.915067+0000","last_active":"2024-04-25T02:19:48.915067+0000","last_peered":"2024-04-25T02:19:48.915067+0000","last_clean":"2024-04-25T02:19:48.915067+0000","last_became_active":"2024-04-25T02:10:02.742689+0000","last_became_peered":"2024-04-25T02:10:02.742689+0000","last_unstale":"2024-04-25T02:19:48.915067+0000","last_undegraded":"2024-04-25T02:19:48.915067+0000","last_fullsized":"2024-04-25T02:19:48.915067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'359","last_scrub_stamp":"2024-04-25T02:19:48.914957+0000","last_deep_scrub":"19'359","last_deep_scrub_stamp":"2024-04-25T02:19:48.914957+0000","last_clean_scrub_stamp":"2024-04-25T02:19:48.914957+0000","log_size":359,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":2645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'371","reported_seq":388,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:00.497023+0000","last_change":"2024-04-25T02:20:00.497023+0000","last_active":"2024-04-25T02:20:00.497023+0000","last_peered":"2024-04-25T02:20:00.497023+0000","last_clean":"2024-04-25T02:20:00.497023+0000","last_became_active":"2024-04-25T02:10:02.730421+0000","last_became_peered":"2024-04-25T02:10:02.730421+0000","last_unstale":"2024-04-25T02:20:00.497023+0000","last_undegraded":"2024-04-25T02:20:00.497023+0000","last_fullsized":"2024-04-25T02:20:00.497023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'371","last_scrub_stamp":"2024-04-25T02:20:00.496897+0000","last_deep_scrub":"19'371","last_deep_scrub_stamp":"2024-04-25T02:20:00.496897+0000","last_clean_scrub_stamp":"2024-04-25T02:20:00.496897+0000","log_size":371,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'363","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:17.309351+0000","last_change":"2024-04-25T02:20:17.309351+0000","last_active":"2024-04-25T02:20:17.309351+0000","last_peered":"2024-04-25T02:20:17.309351+0000","last_clean":"2024-04-25T02:20:17.309351+0000","last_became_active":"2024-04-25T02:10:02.732318+0000","last_became_peered":"2024-04-25T02:10:02.732318+0000","last_unstale":"2024-04-25T02:20:17.309351+0000","last_undegraded":"2024-04-25T02:20:17.309351+0000","last_fullsized":"2024-04-25T02:20:17.309351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'363","last_scrub_stamp":"2024-04-25T02:20:17.309221+0000","last_deep_scrub":"19'363","last_deep_scrub_stamp":"2024-04-25T02:20:17.309221+0000","last_clean_scrub_stamp":"2024-04-25T02:20:17.309221+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'380","reported_seq":394,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:42.871312+0000","last_change":"2024-04-25T02:19:42.871312+0000","last_active":"2024-04-25T02:19:42.871312+0000","last_peered":"2024-04-25T02:19:42.871312+0000","last_clean":"2024-04-25T02:19:42.871312+0000","last_became_active":"2024-04-25T02:10:53.852170+0000","last_became_peered":"2024-04-25T02:10:53.852170+0000","last_unstale":"2024-04-25T02:19:42.871312+0000","last_undegraded":"2024-04-25T02:19:42.871312+0000","last_fullsized":"2024-04-25T02:19:42.871312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'380","last_scrub_stamp":"2024-04-25T02:19:42.871220+0000","last_deep_scrub":"19'380","last_deep_scrub_stamp":"2024-04-25T02:19:42.871220+0000","last_clean_scrub_stamp":"2024-04-25T02:19:42.871220+0000","log_size":380,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"19'367","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:14.380942+0000","last_change":"2024-04-25T02:20:14.380942+0000","last_active":"2024-04-25T02:20:14.380942+0000","last_peered":"2024-04-25T02:20:14.380942+0000","last_clean":"2024-04-25T02:20:14.380942+0000","last_became_active":"2024-04-25T02:10:02.747660+0000","last_became_peered":"2024-04-25T02:10:02.747660+0000","last_unstale":"2024-04-25T02:20:14.380942+0000","last_undegraded":"2024-04-25T02:20:14.380942+0000","last_fullsized":"2024-04-25T02:20:14.380942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'367","last_scrub_stamp":"2024-04-25T02:20:14.380829+0000","last_deep_scrub":"19'367","last_deep_scrub_stamp":"2024-04-25T02:20:14.380829+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.380829+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'340","reported_seq":357,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:07.471137+0000","last_change":"2024-04-25T02:20:07.471137+0000","last_active":"2024-04-25T02:20:07.471137+0000","last_peered":"2024-04-25T02:20:07.471137+0000","last_clean":"2024-04-25T02:20:07.471137+0000","last_became_active":"2024-04-25T02:10:02.727535+0000","last_became_peered":"2024-04-25T02:10:02.727535+0000","last_unstale":"2024-04-25T02:20:07.471137+0000","last_undegraded":"2024-04-25T02:20:07.471137+0000","last_fullsized":"2024-04-25T02:20:07.471137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'340","last_scrub_stamp":"2024-04-25T02:20:07.471014+0000","last_deep_scrub":"19'340","last_deep_scrub_stamp":"2024-04-25T02:20:07.471014+0000","last_clean_scrub_stamp":"2024-04-25T02:20:07.471014+0000","log_size":340,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'356","reported_seq":373,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:40.854714+0000","last_change":"2024-04-25T02:19:40.854714+0000","last_active":"2024-04-25T02:19:40.854714+0000","last_peered":"2024-04-25T02:19:40.854714+0000","last_clean":"2024-04-25T02:19:40.854714+0000","last_became_active":"2024-04-25T02:10:02.748516+0000","last_became_peered":"2024-04-25T02:10:02.748516+0000","last_unstale":"2024-04-25T02:19:40.854714+0000","last_undegraded":"2024-04-25T02:19:40.854714+0000","last_fullsized":"2024-04-25T02:19:40.854714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'356","last_scrub_stamp":"2024-04-25T02:19:40.854586+0000","last_deep_scrub":"19'356","last_deep_scrub_stamp":"2024-04-25T02:19:40.854586+0000","last_clean_scrub_stamp":"2024-04-25T02:19:40.854586+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'401","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:59.508453+0000","last_change":"2024-04-25T02:19:59.508453+0000","last_active":"2024-04-25T02:19:59.508453+0000","last_peered":"2024-04-25T02:19:59.508453+0000","last_clean":"2024-04-25T02:19:59.508453+0000","last_became_active":"2024-04-25T02:10:02.737194+0000","last_became_peered":"2024-04-25T02:10:02.737194+0000","last_unstale":"2024-04-25T02:19:59.508453+0000","last_undegraded":"2024-04-25T02:19:59.508453+0000","last_fullsized":"2024-04-25T02:19:59.508453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'401","last_scrub_stamp":"2024-04-25T02:19:59.508346+0000","last_deep_scrub":"19'401","last_deep_scrub_stamp":"2024-04-25T02:19:59.508346+0000","last_clean_scrub_stamp":"2024-04-25T02:19:59.508346+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'344","reported_seq":358,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:39.836256+0000","last_change":"2024-04-25T02:19:39.836256+0000","last_active":"2024-04-25T02:19:39.836256+0000","last_peered":"2024-04-25T02:19:39.836256+0000","last_clean":"2024-04-25T02:19:39.836256+0000","last_became_active":"2024-04-25T02:10:53.852317+0000","last_became_peered":"2024-04-25T02:10:53.852317+0000","last_unstale":"2024-04-25T02:19:39.836256+0000","last_undegraded":"2024-04-25T02:19:39.836256+0000","last_fullsized":"2024-04-25T02:19:39.836256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'344","last_scrub_stamp":"2024-04-25T02:19:39.836145+0000","last_deep_scrub":"19'344","last_deep_scrub_stamp":"2024-04-25T02:19:39.836145+0000","last_clean_scrub_stamp":"2024-04-25T02:19:39.836145+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"19'383","reported_seq":400,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:04.410252+0000","last_change":"2024-04-25T02:20:04.410252+0000","last_active":"2024-04-25T02:20:04.410252+0000","last_peered":"2024-04-25T02:20:04.410252+0000","last_clean":"2024-04-25T02:20:04.410252+0000","last_became_active":"2024-04-25T02:10:02.731595+0000","last_became_peered":"2024-04-25T02:10:02.731595+0000","last_unstale":"2024-04-25T02:20:04.410252+0000","last_undegraded":"2024-04-25T02:20:04.410252+0000","last_fullsized":"2024-04-25T02:20:04.410252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'383","last_scrub_stamp":"2024-04-25T02:20:04.410115+0000","last_deep_scrub":"19'383","last_deep_scrub_stamp":"2024-04-25T02:20:04.410115+0000","last_clean_scrub_stamp":"2024-04-25T02:20:04.410115+0000","log_size":383,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":390,"num_write_kb":2481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'350","reported_seq":367,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:33.795640+0000","last_change":"2024-04-25T02:20:33.795640+0000","last_active":"2024-04-25T02:20:33.795640+0000","last_peered":"2024-04-25T02:20:33.795640+0000","last_clean":"2024-04-25T02:20:33.795640+0000","last_became_active":"2024-04-25T02:10:02.740485+0000","last_became_peered":"2024-04-25T02:10:02.740485+0000","last_unstale":"2024-04-25T02:20:33.795640+0000","last_undegraded":"2024-04-25T02:20:33.795640+0000","last_fullsized":"2024-04-25T02:20:33.795640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'350","last_scrub_stamp":"2024-04-25T02:20:33.795524+0000","last_deep_scrub":"19'350","last_deep_scrub_stamp":"2024-04-25T02:20:33.795524+0000","last_clean_scrub_stamp":"2024-04-25T02:20:33.795524+0000","log_size":350,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":1992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'367","reported_seq":384,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:55.557095+0000","last_change":"2024-04-25T02:19:55.557095+0000","last_active":"2024-04-25T02:19:55.557095+0000","last_peered":"2024-04-25T02:19:55.557095+0000","last_clean":"2024-04-25T02:19:55.557095+0000","last_became_active":"2024-04-25T02:10:02.733293+0000","last_became_peered":"2024-04-25T02:10:02.733293+0000","last_unstale":"2024-04-25T02:19:55.557095+0000","last_undegraded":"2024-04-25T02:19:55.557095+0000","last_fullsized":"2024-04-25T02:19:55.557095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'367","last_scrub_stamp":"2024-04-25T02:19:55.556990+0000","last_deep_scrub":"19'367","last_deep_scrub_stamp":"2024-04-25T02:19:55.556990+0000","last_clean_scrub_stamp":"2024-04-25T02:19:55.556990+0000","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'386","reported_seq":403,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:54.545557+0000","last_change":"2024-04-25T02:19:54.545557+0000","last_active":"2024-04-25T02:19:54.545557+0000","last_peered":"2024-04-25T02:19:54.545557+0000","last_clean":"2024-04-25T02:19:54.545557+0000","last_became_active":"2024-04-25T02:10:02.745345+0000","last_became_peered":"2024-04-25T02:10:02.745345+0000","last_unstale":"2024-04-25T02:19:54.545557+0000","last_undegraded":"2024-04-25T02:19:54.545557+0000","last_fullsized":"2024-04-25T02:19:54.545557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'386","last_scrub_stamp":"2024-04-25T02:19:54.545439+0000","last_deep_scrub":"19'386","last_deep_scrub_stamp":"2024-04-25T02:19:54.545439+0000","last_clean_scrub_stamp":"2024-04-25T02:19:54.545439+0000","log_size":386,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'421","reported_seq":438,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:51.548406+0000","last_change":"2024-04-25T02:19:51.548406+0000","last_active":"2024-04-25T02:19:51.548406+0000","last_peered":"2024-04-25T02:19:51.548406+0000","last_clean":"2024-04-25T02:19:51.548406+0000","last_became_active":"2024-04-25T02:10:02.730777+0000","last_became_peered":"2024-04-25T02:10:02.730777+0000","last_unstale":"2024-04-25T02:19:51.548406+0000","last_undegraded":"2024-04-25T02:19:51.548406+0000","last_fullsized":"2024-04-25T02:19:51.548406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'421","last_scrub_stamp":"2024-04-25T02:19:51.548298+0000","last_deep_scrub":"19'421","last_deep_scrub_stamp":"2024-04-25T02:19:51.548298+0000","last_clean_scrub_stamp":"2024-04-25T02:19:51.548298+0000","log_size":421,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'341","reported_seq":358,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:30.815991+0000","last_change":"2024-04-25T02:20:30.815991+0000","last_active":"2024-04-25T02:20:30.815991+0000","last_peered":"2024-04-25T02:20:30.815991+0000","last_clean":"2024-04-25T02:20:30.815991+0000","last_became_active":"2024-04-25T02:10:02.746501+0000","last_became_peered":"2024-04-25T02:10:02.746501+0000","last_unstale":"2024-04-25T02:20:30.815991+0000","last_undegraded":"2024-04-25T02:20:30.815991+0000","last_fullsized":"2024-04-25T02:20:30.815991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'341","last_scrub_stamp":"2024-04-25T02:20:30.815844+0000","last_deep_scrub":"19'341","last_deep_scrub_stamp":"2024-04-25T02:20:30.815844+0000","last_clean_scrub_stamp":"2024-04-25T02:20:30.815844+0000","log_size":341,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":2339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'157","reported_seq":175,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:22.516024+0000","last_change":"2024-04-25T02:19:22.516024+0000","last_active":"2024-04-25T02:19:22.516024+0000","last_peered":"2024-04-25T02:19:22.516024+0000","last_clean":"2024-04-25T02:19:22.516024+0000","last_became_active":"2024-04-25T02:10:02.357455+0000","last_became_peered":"2024-04-25T02:10:02.357455+0000","last_unstale":"2024-04-25T02:19:22.516024+0000","last_undegraded":"2024-04-25T02:19:22.516024+0000","last_fullsized":"2024-04-25T02:19:22.516024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'157","last_scrub_stamp":"2024-04-25T02:19:22.515900+0000","last_deep_scrub":"19'157","last_deep_scrub_stamp":"2024-04-25T02:19:22.515900+0000","last_clean_scrub_stamp":"2024-04-25T02:19:22.515900+0000","log_size":157,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":16455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'334","reported_seq":351,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:19.721820+0000","last_change":"2024-04-25T02:20:19.721820+0000","last_active":"2024-04-25T02:20:19.721820+0000","last_peered":"2024-04-25T02:20:19.721820+0000","last_clean":"2024-04-25T02:20:19.721820+0000","last_became_active":"2024-04-25T02:10:02.732522+0000","last_became_peered":"2024-04-25T02:10:02.732522+0000","last_unstale":"2024-04-25T02:20:19.721820+0000","last_undegraded":"2024-04-25T02:20:19.721820+0000","last_fullsized":"2024-04-25T02:20:19.721820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'334","last_scrub_stamp":"2024-04-25T02:20:19.721706+0000","last_deep_scrub":"19'334","last_deep_scrub_stamp":"2024-04-25T02:20:19.721706+0000","last_clean_scrub_stamp":"2024-04-25T02:20:19.721706+0000","log_size":334,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'77","reported_seq":95,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.512649+0000","last_change":"2024-04-25T02:19:19.512649+0000","last_active":"2024-04-25T02:19:19.512649+0000","last_peered":"2024-04-25T02:19:19.512649+0000","last_clean":"2024-04-25T02:19:19.512649+0000","last_became_active":"2024-04-25T02:10:02.369429+0000","last_became_peered":"2024-04-25T02:10:02.369429+0000","last_unstale":"2024-04-25T02:19:19.512649+0000","last_undegraded":"2024-04-25T02:19:19.512649+0000","last_fullsized":"2024-04-25T02:19:19.512649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'77","last_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_deep_scrub":"19'77","last_deep_scrub_stamp":"2024-04-25T02:19:19.512541+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.512541+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'347","reported_seq":364,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:59.343505+0000","last_change":"2024-04-25T02:19:59.343505+0000","last_active":"2024-04-25T02:19:59.343505+0000","last_peered":"2024-04-25T02:19:59.343505+0000","last_clean":"2024-04-25T02:19:59.343505+0000","last_became_active":"2024-04-25T02:10:02.737499+0000","last_became_peered":"2024-04-25T02:10:02.737499+0000","last_unstale":"2024-04-25T02:19:59.343505+0000","last_undegraded":"2024-04-25T02:19:59.343505+0000","last_fullsized":"2024-04-25T02:19:59.343505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'347","last_scrub_stamp":"2024-04-25T02:19:59.343384+0000","last_deep_scrub":"19'347","last_deep_scrub_stamp":"2024-04-25T02:19:59.343384+0000","last_clean_scrub_stamp":"2024-04-25T02:19:59.343384+0000","log_size":347,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'246","reported_seq":264,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:52.823739+0000","last_change":"2024-04-25T02:19:52.823739+0000","last_active":"2024-04-25T02:19:52.823739+0000","last_peered":"2024-04-25T02:19:52.823739+0000","last_clean":"2024-04-25T02:19:52.823739+0000","last_became_active":"2024-04-25T02:10:02.371070+0000","last_became_peered":"2024-04-25T02:10:02.371070+0000","last_unstale":"2024-04-25T02:19:52.823739+0000","last_undegraded":"2024-04-25T02:19:52.823739+0000","last_fullsized":"2024-04-25T02:19:52.823739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'246","last_scrub_stamp":"2024-04-25T02:19:52.823636+0000","last_deep_scrub":"19'246","last_deep_scrub_stamp":"2024-04-25T02:19:52.823636+0000","last_clean_scrub_stamp":"2024-04-25T02:19:52.823636+0000","log_size":246,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:20.688299+0000","last_change":"2024-04-25T02:20:20.688299+0000","last_active":"2024-04-25T02:20:20.688299+0000","last_peered":"2024-04-25T02:20:20.688299+0000","last_clean":"2024-04-25T02:20:20.688299+0000","last_became_active":"2024-04-25T02:10:02.743905+0000","last_became_peered":"2024-04-25T02:10:02.743905+0000","last_unstale":"2024-04-25T02:20:20.688299+0000","last_undegraded":"2024-04-25T02:20:20.688299+0000","last_fullsized":"2024-04-25T02:20:20.688299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:20:20.688162+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:20:20.688162+0000","last_clean_scrub_stamp":"2024-04-25T02:20:20.688162+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'6","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.290157+0000","last_change":"2024-04-25T02:19:27.290157+0000","last_active":"2024-04-25T02:19:27.290157+0000","last_peered":"2024-04-25T02:19:27.290157+0000","last_clean":"2024-04-25T02:19:27.290157+0000","last_became_active":"2024-04-25T02:10:02.370026+0000","last_became_peered":"2024-04-25T02:10:02.370026+0000","last_unstale":"2024-04-25T02:19:27.290157+0000","last_undegraded":"2024-04-25T02:19:27.290157+0000","last_fullsized":"2024-04-25T02:19:27.290157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2024-04-25T02:19:27.290042+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2024-04-25T02:19:27.290042+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.290042+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'377","reported_seq":394,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:09.794740+0000","last_change":"2024-04-25T02:20:09.794740+0000","last_active":"2024-04-25T02:20:09.794740+0000","last_peered":"2024-04-25T02:20:09.794740+0000","last_clean":"2024-04-25T02:20:09.794740+0000","last_became_active":"2024-04-25T02:10:02.731480+0000","last_became_peered":"2024-04-25T02:10:02.731480+0000","last_unstale":"2024-04-25T02:20:09.794740+0000","last_undegraded":"2024-04-25T02:20:09.794740+0000","last_fullsized":"2024-04-25T02:20:09.794740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'377","last_scrub_stamp":"2024-04-25T02:20:09.794627+0000","last_deep_scrub":"19'377","last_deep_scrub_stamp":"2024-04-25T02:20:09.794627+0000","last_clean_scrub_stamp":"2024-04-25T02:20:09.794627+0000","log_size":377,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":2757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'81","reported_seq":99,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:15.705733+0000","last_change":"2024-04-25T02:19:15.705733+0000","last_active":"2024-04-25T02:19:15.705733+0000","last_peered":"2024-04-25T02:19:15.705733+0000","last_clean":"2024-04-25T02:19:15.705733+0000","last_became_active":"2024-04-25T02:10:02.367179+0000","last_became_peered":"2024-04-25T02:10:02.367179+0000","last_unstale":"2024-04-25T02:19:15.705733+0000","last_undegraded":"2024-04-25T02:19:15.705733+0000","last_fullsized":"2024-04-25T02:19:15.705733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'81","last_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_deep_scrub":"19'81","last_deep_scrub_stamp":"2024-04-25T02:19:15.705635+0000","last_clean_scrub_stamp":"2024-04-25T02:19:15.705635+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6184361,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'412","reported_seq":429,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:10.759375+0000","last_change":"2024-04-25T02:20:10.759375+0000","last_active":"2024-04-25T02:20:10.759375+0000","last_peered":"2024-04-25T02:20:10.759375+0000","last_clean":"2024-04-25T02:20:10.759375+0000","last_became_active":"2024-04-25T02:10:02.739945+0000","last_became_peered":"2024-04-25T02:10:02.739945+0000","last_unstale":"2024-04-25T02:20:10.759375+0000","last_undegraded":"2024-04-25T02:20:10.759375+0000","last_fullsized":"2024-04-25T02:20:10.759375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'412","last_scrub_stamp":"2024-04-25T02:20:10.759237+0000","last_deep_scrub":"19'412","last_deep_scrub_stamp":"2024-04-25T02:20:10.759237+0000","last_clean_scrub_stamp":"2024-04-25T02:20:10.759237+0000","log_size":412,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":2910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'364","reported_seq":382,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.364468+0000","last_change":"2024-04-25T02:19:25.364468+0000","last_active":"2024-04-25T02:19:25.364468+0000","last_peered":"2024-04-25T02:19:25.364468+0000","last_clean":"2024-04-25T02:19:25.364468+0000","last_became_active":"2024-04-25T02:10:02.371571+0000","last_became_peered":"2024-04-25T02:10:02.371571+0000","last_unstale":"2024-04-25T02:19:25.364468+0000","last_undegraded":"2024-04-25T02:19:25.364468+0000","last_fullsized":"2024-04-25T02:19:25.364468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'364","last_scrub_stamp":"2024-04-25T02:19:25.364369+0000","last_deep_scrub":"19'364","last_deep_scrub_stamp":"2024-04-25T02:19:25.364369+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.364369+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'363","reported_seq":380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:42.550756+0000","last_change":"2024-04-25T02:19:42.550756+0000","last_active":"2024-04-25T02:19:42.550756+0000","last_peered":"2024-04-25T02:19:42.550756+0000","last_clean":"2024-04-25T02:19:42.550756+0000","last_became_active":"2024-04-25T02:10:02.744002+0000","last_became_peered":"2024-04-25T02:10:02.744002+0000","last_unstale":"2024-04-25T02:19:42.550756+0000","last_undegraded":"2024-04-25T02:19:42.550756+0000","last_fullsized":"2024-04-25T02:19:42.550756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'363","last_scrub_stamp":"2024-04-25T02:19:42.550634+0000","last_deep_scrub":"19'363","last_deep_scrub_stamp":"2024-04-25T02:19:42.550634+0000","last_clean_scrub_stamp":"2024-04-25T02:19:42.550634+0000","log_size":363,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'310","reported_seq":328,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:44.851470+0000","last_change":"2024-04-25T02:19:44.851470+0000","last_active":"2024-04-25T02:19:44.851470+0000","last_peered":"2024-04-25T02:19:44.851470+0000","last_clean":"2024-04-25T02:19:44.851470+0000","last_became_active":"2024-04-25T02:10:02.363709+0000","last_became_peered":"2024-04-25T02:10:02.363709+0000","last_unstale":"2024-04-25T02:19:44.851470+0000","last_undegraded":"2024-04-25T02:19:44.851470+0000","last_fullsized":"2024-04-25T02:19:44.851470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'310","last_scrub_stamp":"2024-04-25T02:19:44.851352+0000","last_deep_scrub":"19'310","last_deep_scrub_stamp":"2024-04-25T02:19:44.851352+0000","last_clean_scrub_stamp":"2024-04-25T02:19:44.851352+0000","log_size":310,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8389252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":12434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'364","reported_seq":389,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:26.735843+0000","last_change":"2024-04-25T02:19:26.735843+0000","last_active":"2024-04-25T02:19:26.735843+0000","last_peered":"2024-04-25T02:19:26.735843+0000","last_clean":"2024-04-25T02:19:26.735843+0000","last_became_active":"2024-04-25T02:10:53.854713+0000","last_became_peered":"2024-04-25T02:10:53.854713+0000","last_unstale":"2024-04-25T02:19:26.735843+0000","last_undegraded":"2024-04-25T02:19:26.735843+0000","last_fullsized":"2024-04-25T02:19:26.735843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'364","last_scrub_stamp":"2024-04-25T02:19:26.735719+0000","last_deep_scrub":"19'364","last_deep_scrub_stamp":"2024-04-25T02:19:26.735719+0000","last_clean_scrub_stamp":"2024-04-25T02:19:26.735719+0000","log_size":364,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'129","reported_seq":147,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:43.842800+0000","last_change":"2024-04-25T02:19:43.842800+0000","last_active":"2024-04-25T02:19:43.842800+0000","last_peered":"2024-04-25T02:19:43.842800+0000","last_clean":"2024-04-25T02:19:43.842800+0000","last_became_active":"2024-04-25T02:10:02.364270+0000","last_became_peered":"2024-04-25T02:10:02.364270+0000","last_unstale":"2024-04-25T02:19:43.842800+0000","last_undegraded":"2024-04-25T02:19:43.842800+0000","last_fullsized":"2024-04-25T02:19:43.842800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'129","last_scrub_stamp":"2024-04-25T02:19:43.842706+0000","last_deep_scrub":"19'129","last_deep_scrub_stamp":"2024-04-25T02:19:43.842706+0000","last_clean_scrub_stamp":"2024-04-25T02:19:43.842706+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'333","reported_seq":347,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.771910+0000","last_change":"2024-04-25T02:19:27.771910+0000","last_active":"2024-04-25T02:19:27.771910+0000","last_peered":"2024-04-25T02:19:27.771910+0000","last_clean":"2024-04-25T02:19:27.771910+0000","last_became_active":"2024-04-25T02:10:53.850428+0000","last_became_peered":"2024-04-25T02:10:53.850428+0000","last_unstale":"2024-04-25T02:19:27.771910+0000","last_undegraded":"2024-04-25T02:19:27.771910+0000","last_fullsized":"2024-04-25T02:19:27.771910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:27.771815+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:27.771815+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.771815+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.296955+0000","last_change":"2024-04-25T02:19:21.296955+0000","last_active":"2024-04-25T02:19:21.296955+0000","last_peered":"2024-04-25T02:19:21.296955+0000","last_clean":"2024-04-25T02:19:21.296955+0000","last_became_active":"2024-04-25T02:10:02.369892+0000","last_became_peered":"2024-04-25T02:10:02.369892+0000","last_unstale":"2024-04-25T02:19:21.296955+0000","last_undegraded":"2024-04-25T02:19:21.296955+0000","last_fullsized":"2024-04-25T02:19:21.296955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:21.296829+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.296829+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'353","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:13.727323+0000","last_change":"2024-04-25T02:20:13.727323+0000","last_active":"2024-04-25T02:20:13.727323+0000","last_peered":"2024-04-25T02:20:13.727323+0000","last_clean":"2024-04-25T02:20:13.727323+0000","last_became_active":"2024-04-25T02:10:02.746511+0000","last_became_peered":"2024-04-25T02:10:02.746511+0000","last_unstale":"2024-04-25T02:20:13.727323+0000","last_undegraded":"2024-04-25T02:20:13.727323+0000","last_fullsized":"2024-04-25T02:20:13.727323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'353","last_scrub_stamp":"2024-04-25T02:20:13.727198+0000","last_deep_scrub":"19'353","last_deep_scrub_stamp":"2024-04-25T02:20:13.727198+0000","last_clean_scrub_stamp":"2024-04-25T02:20:13.727198+0000","log_size":353,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":2543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'3","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:31.773766+0000","last_change":"2024-04-25T02:19:31.773766+0000","last_active":"2024-04-25T02:19:31.773766+0000","last_peered":"2024-04-25T02:19:31.773766+0000","last_clean":"2024-04-25T02:19:31.773766+0000","last_became_active":"2024-04-25T02:10:02.358861+0000","last_became_peered":"2024-04-25T02:10:02.358861+0000","last_unstale":"2024-04-25T02:19:31.773766+0000","last_undegraded":"2024-04-25T02:19:31.773766+0000","last_fullsized":"2024-04-25T02:19:31.773766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-04-25T02:19:31.773623+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-04-25T02:19:31.773623+0000","last_clean_scrub_stamp":"2024-04-25T02:19:31.773623+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'406","reported_seq":423,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:56.431591+0000","last_change":"2024-04-25T02:19:56.431591+0000","last_active":"2024-04-25T02:19:56.431591+0000","last_peered":"2024-04-25T02:19:56.431591+0000","last_clean":"2024-04-25T02:19:56.431591+0000","last_became_active":"2024-04-25T02:10:02.743252+0000","last_became_peered":"2024-04-25T02:10:02.743252+0000","last_unstale":"2024-04-25T02:19:56.431591+0000","last_undegraded":"2024-04-25T02:19:56.431591+0000","last_fullsized":"2024-04-25T02:19:56.431591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'406","last_scrub_stamp":"2024-04-25T02:19:56.431479+0000","last_deep_scrub":"19'406","last_deep_scrub_stamp":"2024-04-25T02:19:56.431479+0000","last_clean_scrub_stamp":"2024-04-25T02:19:56.431479+0000","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":2547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'140","reported_seq":158,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.491862+0000","last_change":"2024-04-25T02:19:11.491862+0000","last_active":"2024-04-25T02:19:11.491862+0000","last_peered":"2024-04-25T02:19:11.491862+0000","last_clean":"2024-04-25T02:19:11.491862+0000","last_became_active":"2024-04-25T02:10:02.359248+0000","last_became_peered":"2024-04-25T02:10:02.359248+0000","last_unstale":"2024-04-25T02:19:11.491862+0000","last_undegraded":"2024-04-25T02:19:11.491862+0000","last_fullsized":"2024-04-25T02:19:11.491862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'140","last_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_deep_scrub":"19'140","last_deep_scrub_stamp":"2024-04-25T02:19:11.491759+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.491759+0000","log_size":140,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'351","reported_seq":365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:30.803636+0000","last_change":"2024-04-25T02:19:30.803636+0000","last_active":"2024-04-25T02:19:30.803636+0000","last_peered":"2024-04-25T02:19:30.803636+0000","last_clean":"2024-04-25T02:19:30.803636+0000","last_became_active":"2024-04-25T02:10:53.852688+0000","last_became_peered":"2024-04-25T02:10:53.852688+0000","last_unstale":"2024-04-25T02:19:30.803636+0000","last_undegraded":"2024-04-25T02:19:30.803636+0000","last_fullsized":"2024-04-25T02:19:30.803636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'351","last_scrub_stamp":"2024-04-25T02:19:30.803487+0000","last_deep_scrub":"19'351","last_deep_scrub_stamp":"2024-04-25T02:19:30.803487+0000","last_clean_scrub_stamp":"2024-04-25T02:19:30.803487+0000","log_size":351,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":2098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'48","reported_seq":66,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.281870+0000","last_change":"2024-04-25T02:19:19.281870+0000","last_active":"2024-04-25T02:19:19.281870+0000","last_peered":"2024-04-25T02:19:19.281870+0000","last_clean":"2024-04-25T02:19:19.281870+0000","last_became_active":"2024-04-25T02:10:02.369492+0000","last_became_peered":"2024-04-25T02:10:02.369492+0000","last_unstale":"2024-04-25T02:19:19.281870+0000","last_undegraded":"2024-04-25T02:19:19.281870+0000","last_fullsized":"2024-04-25T02:19:19.281870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'48","last_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_deep_scrub":"19'48","last_deep_scrub_stamp":"2024-04-25T02:19:19.281770+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.281770+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'375","reported_seq":392,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:05.765806+0000","last_change":"2024-04-25T02:20:05.765806+0000","last_active":"2024-04-25T02:20:05.765806+0000","last_peered":"2024-04-25T02:20:05.765806+0000","last_clean":"2024-04-25T02:20:05.765806+0000","last_became_active":"2024-04-25T02:10:02.732355+0000","last_became_peered":"2024-04-25T02:10:02.732355+0000","last_unstale":"2024-04-25T02:20:05.765806+0000","last_undegraded":"2024-04-25T02:20:05.765806+0000","last_fullsized":"2024-04-25T02:20:05.765806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-04-25T02:20:05.765699+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-04-25T02:20:05.765699+0000","last_clean_scrub_stamp":"2024-04-25T02:20:05.765699+0000","log_size":375,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":2621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'109","reported_seq":127,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.663012+0000","last_change":"2024-04-25T02:19:13.663012+0000","last_active":"2024-04-25T02:19:13.663012+0000","last_peered":"2024-04-25T02:19:13.663012+0000","last_clean":"2024-04-25T02:19:13.663012+0000","last_became_active":"2024-04-25T02:10:02.358567+0000","last_became_peered":"2024-04-25T02:10:02.358567+0000","last_unstale":"2024-04-25T02:19:13.663012+0000","last_undegraded":"2024-04-25T02:19:13.663012+0000","last_fullsized":"2024-04-25T02:19:13.663012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'109","last_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_deep_scrub":"19'109","last_deep_scrub_stamp":"2024-04-25T02:19:13.662909+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.662909+0000","log_size":109,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'396","reported_seq":413,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:35.607004+0000","last_change":"2024-04-25T02:19:35.607004+0000","last_active":"2024-04-25T02:19:35.607004+0000","last_peered":"2024-04-25T02:19:35.607004+0000","last_clean":"2024-04-25T02:19:35.607004+0000","last_became_active":"2024-04-25T02:10:02.742203+0000","last_became_peered":"2024-04-25T02:10:02.742203+0000","last_unstale":"2024-04-25T02:19:35.607004+0000","last_undegraded":"2024-04-25T02:19:35.607004+0000","last_fullsized":"2024-04-25T02:19:35.607004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'396","last_scrub_stamp":"2024-04-25T02:19:35.606880+0000","last_deep_scrub":"19'396","last_deep_scrub_stamp":"2024-04-25T02:19:35.606880+0000","last_clean_scrub_stamp":"2024-04-25T02:19:35.606880+0000","log_size":396,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'84","reported_seq":102,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:29.801974+0000","last_change":"2024-04-25T02:19:29.801974+0000","last_active":"2024-04-25T02:19:29.801974+0000","last_peered":"2024-04-25T02:19:29.801974+0000","last_clean":"2024-04-25T02:19:29.801974+0000","last_became_active":"2024-04-25T02:10:02.369893+0000","last_became_peered":"2024-04-25T02:10:02.369893+0000","last_unstale":"2024-04-25T02:19:29.801974+0000","last_undegraded":"2024-04-25T02:19:29.801974+0000","last_fullsized":"2024-04-25T02:19:29.801974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'84","last_scrub_stamp":"2024-04-25T02:19:29.801721+0000","last_deep_scrub":"19'84","last_deep_scrub_stamp":"2024-04-25T02:19:29.801721+0000","last_clean_scrub_stamp":"2024-04-25T02:19:29.801721+0000","log_size":84,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'356","reported_seq":373,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:19.666077+0000","last_change":"2024-04-25T02:19:19.666077+0000","last_active":"2024-04-25T02:19:19.666077+0000","last_peered":"2024-04-25T02:19:19.666077+0000","last_clean":"2024-04-25T02:19:19.666077+0000","last_became_active":"2024-04-25T02:10:02.744280+0000","last_became_peered":"2024-04-25T02:10:02.744280+0000","last_unstale":"2024-04-25T02:19:19.666077+0000","last_undegraded":"2024-04-25T02:19:19.666077+0000","last_fullsized":"2024-04-25T02:19:19.666077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'356","last_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_deep_scrub":"19'356","last_deep_scrub_stamp":"2024-04-25T02:19:19.665961+0000","last_clean_scrub_stamp":"2024-04-25T02:19:19.665961+0000","log_size":356,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'33","reported_seq":51,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.244079+0000","last_change":"2024-04-25T02:19:09.244079+0000","last_active":"2024-04-25T02:19:09.244079+0000","last_peered":"2024-04-25T02:19:09.244079+0000","last_clean":"2024-04-25T02:19:09.244079+0000","last_became_active":"2024-04-25T02:10:02.370370+0000","last_became_peered":"2024-04-25T02:10:02.370370+0000","last_unstale":"2024-04-25T02:19:09.244079+0000","last_undegraded":"2024-04-25T02:19:09.244079+0000","last_fullsized":"2024-04-25T02:19:09.244079+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'33","last_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_deep_scrub":"19'33","last_deep_scrub_stamp":"2024-04-25T02:19:09.243976+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.243976+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'398","reported_seq":415,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:51.347108+0000","last_change":"2024-04-25T02:19:51.347108+0000","last_active":"2024-04-25T02:19:51.347108+0000","last_peered":"2024-04-25T02:19:51.347108+0000","last_clean":"2024-04-25T02:19:51.347108+0000","last_became_active":"2024-04-25T02:10:02.740889+0000","last_became_peered":"2024-04-25T02:10:02.740889+0000","last_unstale":"2024-04-25T02:19:51.347108+0000","last_undegraded":"2024-04-25T02:19:51.347108+0000","last_fullsized":"2024-04-25T02:19:51.347108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'398","last_scrub_stamp":"2024-04-25T02:19:51.346998+0000","last_deep_scrub":"19'398","last_deep_scrub_stamp":"2024-04-25T02:19:51.346998+0000","last_clean_scrub_stamp":"2024-04-25T02:19:51.346998+0000","log_size":398,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'117","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.843685+0000","last_change":"2024-04-25T02:19:25.843685+0000","last_active":"2024-04-25T02:19:25.843685+0000","last_peered":"2024-04-25T02:19:25.843685+0000","last_clean":"2024-04-25T02:19:25.843685+0000","last_became_active":"2024-04-25T02:10:02.372513+0000","last_became_peered":"2024-04-25T02:10:02.372513+0000","last_unstale":"2024-04-25T02:19:25.843685+0000","last_undegraded":"2024-04-25T02:19:25.843685+0000","last_fullsized":"2024-04-25T02:19:25.843685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'117","last_scrub_stamp":"2024-04-25T02:19:25.843568+0000","last_deep_scrub":"19'117","last_deep_scrub_stamp":"2024-04-25T02:19:25.843568+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.843568+0000","log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":12332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":450,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'459","reported_seq":476,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:54.392846+0000","last_change":"2024-04-25T02:19:54.392846+0000","last_active":"2024-04-25T02:19:54.392846+0000","last_peered":"2024-04-25T02:19:54.392846+0000","last_clean":"2024-04-25T02:19:54.392846+0000","last_became_active":"2024-04-25T02:10:02.743184+0000","last_became_peered":"2024-04-25T02:10:02.743184+0000","last_unstale":"2024-04-25T02:19:54.392846+0000","last_undegraded":"2024-04-25T02:19:54.392846+0000","last_fullsized":"2024-04-25T02:19:54.392846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'459","last_scrub_stamp":"2024-04-25T02:19:54.392702+0000","last_deep_scrub":"19'459","last_deep_scrub_stamp":"2024-04-25T02:19:54.392702+0000","last_clean_scrub_stamp":"2024-04-25T02:19:54.392702+0000","log_size":459,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":3228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'76","reported_seq":94,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.854739+0000","last_change":"2024-04-25T02:19:21.854739+0000","last_active":"2024-04-25T02:19:21.854739+0000","last_peered":"2024-04-25T02:19:21.854739+0000","last_clean":"2024-04-25T02:19:21.854739+0000","last_became_active":"2024-04-25T02:10:02.365713+0000","last_became_peered":"2024-04-25T02:10:02.365713+0000","last_unstale":"2024-04-25T02:19:21.854739+0000","last_undegraded":"2024-04-25T02:19:21.854739+0000","last_fullsized":"2024-04-25T02:19:21.854739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'76","last_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_deep_scrub":"19'76","last_deep_scrub_stamp":"2024-04-25T02:19:21.854641+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.854641+0000","log_size":76,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'354","reported_seq":368,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:21.708606+0000","last_change":"2024-04-25T02:19:21.708606+0000","last_active":"2024-04-25T02:19:21.708606+0000","last_peered":"2024-04-25T02:19:21.708606+0000","last_clean":"2024-04-25T02:19:21.708606+0000","last_became_active":"2024-04-25T02:10:53.850781+0000","last_became_peered":"2024-04-25T02:10:53.850781+0000","last_unstale":"2024-04-25T02:19:21.708606+0000","last_undegraded":"2024-04-25T02:19:21.708606+0000","last_fullsized":"2024-04-25T02:19:21.708606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'354","last_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_deep_scrub":"19'354","last_deep_scrub_stamp":"2024-04-25T02:19:21.708495+0000","last_clean_scrub_stamp":"2024-04-25T02:19:21.708495+0000","log_size":354,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":2658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"19'32","reported_seq":50,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:17.789878+0000","last_change":"2024-04-25T02:19:17.789878+0000","last_active":"2024-04-25T02:19:17.789878+0000","last_peered":"2024-04-25T02:19:17.789878+0000","last_clean":"2024-04-25T02:19:17.789878+0000","last_became_active":"2024-04-25T02:10:02.360445+0000","last_became_peered":"2024-04-25T02:10:02.360445+0000","last_unstale":"2024-04-25T02:19:17.789878+0000","last_undegraded":"2024-04-25T02:19:17.789878+0000","last_fullsized":"2024-04-25T02:19:17.789878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'32","last_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_deep_scrub":"19'32","last_deep_scrub_stamp":"2024-04-25T02:19:17.789779+0000","last_clean_scrub_stamp":"2024-04-25T02:19:17.789779+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'332","reported_seq":349,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:24.721403+0000","last_change":"2024-04-25T02:19:24.721403+0000","last_active":"2024-04-25T02:19:24.721403+0000","last_peered":"2024-04-25T02:19:24.721403+0000","last_clean":"2024-04-25T02:19:24.721403+0000","last_became_active":"2024-04-25T02:10:02.742530+0000","last_became_peered":"2024-04-25T02:10:02.742530+0000","last_unstale":"2024-04-25T02:19:24.721403+0000","last_undegraded":"2024-04-25T02:19:24.721403+0000","last_fullsized":"2024-04-25T02:19:24.721403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'332","last_scrub_stamp":"2024-04-25T02:19:24.721294+0000","last_deep_scrub":"19'332","last_deep_scrub_stamp":"2024-04-25T02:19:24.721294+0000","last_clean_scrub_stamp":"2024-04-25T02:19:24.721294+0000","log_size":332,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'113","reported_seq":131,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.807276+0000","last_change":"2024-04-25T02:19:16.807276+0000","last_active":"2024-04-25T02:19:16.807276+0000","last_peered":"2024-04-25T02:19:16.807276+0000","last_clean":"2024-04-25T02:19:16.807276+0000","last_became_active":"2024-04-25T02:10:02.365721+0000","last_became_peered":"2024-04-25T02:10:02.365721+0000","last_unstale":"2024-04-25T02:19:16.807276+0000","last_undegraded":"2024-04-25T02:19:16.807276+0000","last_fullsized":"2024-04-25T02:19:16.807276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'113","last_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_deep_scrub":"19'113","last_deep_scrub_stamp":"2024-04-25T02:19:16.807162+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.807162+0000","log_size":113,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'328","reported_seq":345,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:38.577551+0000","last_change":"2024-04-25T02:19:38.577551+0000","last_active":"2024-04-25T02:19:38.577551+0000","last_peered":"2024-04-25T02:19:38.577551+0000","last_clean":"2024-04-25T02:19:38.577551+0000","last_became_active":"2024-04-25T02:10:02.745544+0000","last_became_peered":"2024-04-25T02:10:02.745544+0000","last_unstale":"2024-04-25T02:19:38.577551+0000","last_undegraded":"2024-04-25T02:19:38.577551+0000","last_fullsized":"2024-04-25T02:19:38.577551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'328","last_scrub_stamp":"2024-04-25T02:19:38.577424+0000","last_deep_scrub":"19'328","last_deep_scrub_stamp":"2024-04-25T02:19:38.577424+0000","last_clean_scrub_stamp":"2024-04-25T02:19:38.577424+0000","log_size":328,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.467431+0000","last_change":"2024-04-25T02:19:02.467431+0000","last_active":"2024-04-25T02:19:02.467431+0000","last_peered":"2024-04-25T02:19:02.467431+0000","last_clean":"2024-04-25T02:19:02.467431+0000","last_became_active":"2024-04-25T02:09:58.221600+0000","last_became_peered":"2024-04-25T02:09:58.221600+0000","last_unstale":"2024-04-25T02:19:02.467431+0000","last_undegraded":"2024-04-25T02:19:02.467431+0000","last_fullsized":"2024-04-25T02:19:02.467431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:02.467334+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.467334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'95","reported_seq":113,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.615993+0000","last_change":"2024-04-25T02:19:11.615993+0000","last_active":"2024-04-25T02:19:11.615993+0000","last_peered":"2024-04-25T02:19:11.615993+0000","last_clean":"2024-04-25T02:19:11.615993+0000","last_became_active":"2024-04-25T02:10:02.367270+0000","last_became_peered":"2024-04-25T02:10:02.367270+0000","last_unstale":"2024-04-25T02:19:11.615993+0000","last_undegraded":"2024-04-25T02:19:11.615993+0000","last_fullsized":"2024-04-25T02:19:11.615993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'95","last_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_deep_scrub":"19'95","last_deep_scrub_stamp":"2024-04-25T02:19:11.615813+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.615813+0000","log_size":95,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:26.561694+0000","last_change":"2024-04-25T02:19:26.561694+0000","last_active":"2024-04-25T02:19:26.561694+0000","last_peered":"2024-04-25T02:19:26.561694+0000","last_clean":"2024-04-25T02:19:26.561694+0000","last_became_active":"2024-04-25T02:10:02.744041+0000","last_became_peered":"2024-04-25T02:10:02.744041+0000","last_unstale":"2024-04-25T02:19:26.561694+0000","last_undegraded":"2024-04-25T02:19:26.561694+0000","last_fullsized":"2024-04-25T02:19:26.561694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:26.561581+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:26.561581+0000","last_clean_scrub_stamp":"2024-04-25T02:19:26.561581+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:06.911064+0000","last_change":"2024-04-25T02:19:06.911064+0000","last_active":"2024-04-25T02:19:06.911064+0000","last_peered":"2024-04-25T02:19:06.911064+0000","last_clean":"2024-04-25T02:19:06.911064+0000","last_became_active":"2024-04-25T02:09:58.221472+0000","last_became_peered":"2024-04-25T02:09:58.221472+0000","last_unstale":"2024-04-25T02:19:06.911064+0000","last_undegraded":"2024-04-25T02:19:06.911064+0000","last_fullsized":"2024-04-25T02:19:06.911064+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:06.910932+0000","last_clean_scrub_stamp":"2024-04-25T02:19:06.910932+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'16","reported_seq":34,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.302362+0000","last_change":"2024-04-25T02:19:05.302362+0000","last_active":"2024-04-25T02:19:05.302362+0000","last_peered":"2024-04-25T02:19:05.302362+0000","last_clean":"2024-04-25T02:19:05.302362+0000","last_became_active":"2024-04-25T02:10:02.360192+0000","last_became_peered":"2024-04-25T02:10:02.360192+0000","last_unstale":"2024-04-25T02:19:05.302362+0000","last_undegraded":"2024-04-25T02:19:05.302362+0000","last_fullsized":"2024-04-25T02:19:05.302362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'16","last_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_deep_scrub":"19'16","last_deep_scrub_stamp":"2024-04-25T02:19:05.302256+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.302256+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'326","reported_seq":343,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:27.576881+0000","last_change":"2024-04-25T02:19:27.576881+0000","last_active":"2024-04-25T02:19:27.576881+0000","last_peered":"2024-04-25T02:19:27.576881+0000","last_clean":"2024-04-25T02:19:27.576881+0000","last_became_active":"2024-04-25T02:10:02.732560+0000","last_became_peered":"2024-04-25T02:10:02.732560+0000","last_unstale":"2024-04-25T02:19:27.576881+0000","last_undegraded":"2024-04-25T02:19:27.576881+0000","last_fullsized":"2024-04-25T02:19:27.576881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'326","last_scrub_stamp":"2024-04-25T02:19:27.576765+0000","last_deep_scrub":"19'326","last_deep_scrub_stamp":"2024-04-25T02:19:27.576765+0000","last_clean_scrub_stamp":"2024-04-25T02:19:27.576765+0000","log_size":326,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.564824+0000","last_change":"2024-04-25T02:19:01.564824+0000","last_active":"2024-04-25T02:19:01.564824+0000","last_peered":"2024-04-25T02:19:01.564824+0000","last_clean":"2024-04-25T02:19:01.564824+0000","last_became_active":"2024-04-25T02:09:58.226082+0000","last_became_peered":"2024-04-25T02:09:58.226082+0000","last_unstale":"2024-04-25T02:19:01.564824+0000","last_undegraded":"2024-04-25T02:19:01.564824+0000","last_fullsized":"2024-04-25T02:19:01.564824+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.564726+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.564726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'243","reported_seq":261,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.526240+0000","last_change":"2024-04-25T02:19:08.526240+0000","last_active":"2024-04-25T02:19:08.526240+0000","last_peered":"2024-04-25T02:19:08.526240+0000","last_clean":"2024-04-25T02:19:08.526240+0000","last_became_active":"2024-04-25T02:10:02.360670+0000","last_became_peered":"2024-04-25T02:10:02.360670+0000","last_unstale":"2024-04-25T02:19:08.526240+0000","last_undegraded":"2024-04-25T02:19:08.526240+0000","last_fullsized":"2024-04-25T02:19:08.526240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'243","last_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_deep_scrub":"19'243","last_deep_scrub_stamp":"2024-04-25T02:19:08.526107+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.526107+0000","log_size":243,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":12388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'331","reported_seq":348,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:29.573912+0000","last_change":"2024-04-25T02:19:29.573912+0000","last_active":"2024-04-25T02:19:29.573912+0000","last_peered":"2024-04-25T02:19:29.573912+0000","last_clean":"2024-04-25T02:19:29.573912+0000","last_became_active":"2024-04-25T02:10:02.729738+0000","last_became_peered":"2024-04-25T02:10:02.729738+0000","last_unstale":"2024-04-25T02:19:29.573912+0000","last_undegraded":"2024-04-25T02:19:29.573912+0000","last_fullsized":"2024-04-25T02:19:29.573912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'331","last_scrub_stamp":"2024-04-25T02:19:29.573769+0000","last_deep_scrub":"19'331","last_deep_scrub_stamp":"2024-04-25T02:19:29.573769+0000","last_clean_scrub_stamp":"2024-04-25T02:19:29.573769+0000","log_size":331,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":2335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.862881+0000","last_change":"2024-04-25T02:19:07.862881+0000","last_active":"2024-04-25T02:19:07.862881+0000","last_peered":"2024-04-25T02:19:07.862881+0000","last_clean":"2024-04-25T02:19:07.862881+0000","last_became_active":"2024-04-25T02:09:58.226461+0000","last_became_peered":"2024-04-25T02:09:58.226461+0000","last_unstale":"2024-04-25T02:19:07.862881+0000","last_undegraded":"2024-04-25T02:19:07.862881+0000","last_fullsized":"2024-04-25T02:19:07.862881+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:07.862746+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.862746+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:01.436078+0000","last_change":"2024-04-25T02:19:01.436078+0000","last_active":"2024-04-25T02:19:01.436078+0000","last_peered":"2024-04-25T02:19:01.436078+0000","last_clean":"2024-04-25T02:19:01.436078+0000","last_became_active":"2024-04-25T02:09:58.221433+0000","last_became_peered":"2024-04-25T02:09:58.221433+0000","last_unstale":"2024-04-25T02:19:01.436078+0000","last_undegraded":"2024-04-25T02:19:01.436078+0000","last_fullsized":"2024-04-25T02:19:01.436078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:01.435931+0000","last_clean_scrub_stamp":"2024-04-25T02:19:01.435931+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'162","reported_seq":180,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:11.898853+0000","last_change":"2024-04-25T02:19:11.898853+0000","last_active":"2024-04-25T02:19:11.898853+0000","last_peered":"2024-04-25T02:19:11.898853+0000","last_clean":"2024-04-25T02:19:11.898853+0000","last_became_active":"2024-04-25T02:10:02.364342+0000","last_became_peered":"2024-04-25T02:10:02.364342+0000","last_unstale":"2024-04-25T02:19:11.898853+0000","last_undegraded":"2024-04-25T02:19:11.898853+0000","last_fullsized":"2024-04-25T02:19:11.898853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'162","last_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_deep_scrub":"19'162","last_deep_scrub_stamp":"2024-04-25T02:19:11.898758+0000","last_clean_scrub_stamp":"2024-04-25T02:19:11.898758+0000","log_size":162,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'344","reported_seq":361,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:03.772638+0000","last_change":"2024-04-25T02:20:03.772638+0000","last_active":"2024-04-25T02:20:03.772638+0000","last_peered":"2024-04-25T02:20:03.772638+0000","last_clean":"2024-04-25T02:20:03.772638+0000","last_became_active":"2024-04-25T02:10:02.738389+0000","last_became_peered":"2024-04-25T02:10:02.738389+0000","last_unstale":"2024-04-25T02:20:03.772638+0000","last_undegraded":"2024-04-25T02:20:03.772638+0000","last_fullsized":"2024-04-25T02:20:03.772638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'344","last_scrub_stamp":"2024-04-25T02:20:03.772541+0000","last_deep_scrub":"19'344","last_deep_scrub_stamp":"2024-04-25T02:20:03.772541+0000","last_clean_scrub_stamp":"2024-04-25T02:20:03.772541+0000","log_size":344,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":2553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:05.879508+0000","last_change":"2024-04-25T02:19:05.879508+0000","last_active":"2024-04-25T02:19:05.879508+0000","last_peered":"2024-04-25T02:19:05.879508+0000","last_clean":"2024-04-25T02:19:05.879508+0000","last_became_active":"2024-04-25T02:09:58.221452+0000","last_became_peered":"2024-04-25T02:09:58.221452+0000","last_unstale":"2024-04-25T02:19:05.879508+0000","last_undegraded":"2024-04-25T02:19:05.879508+0000","last_fullsized":"2024-04-25T02:19:05.879508+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:05.879394+0000","last_clean_scrub_stamp":"2024-04-25T02:19:05.879394+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'626","reported_seq":1266,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:02.344141+0000","last_change":"2024-04-25T02:19:02.344141+0000","last_active":"2024-04-25T02:19:02.344141+0000","last_peered":"2024-04-25T02:19:02.344141+0000","last_clean":"2024-04-25T02:19:02.344141+0000","last_became_active":"2024-04-25T02:10:02.355791+0000","last_became_peered":"2024-04-25T02:10:02.355791+0000","last_unstale":"2024-04-25T02:19:02.344141+0000","last_undegraded":"2024-04-25T02:19:02.344141+0000","last_fullsized":"2024-04-25T02:19:02.344141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'626","last_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_deep_scrub":"19'626","last_deep_scrub_stamp":"2024-04-25T02:19:02.344043+0000","last_clean_scrub_stamp":"2024-04-25T02:19:02.344043+0000","log_size":626,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1113626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":622,"num_write_kb":1507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'415","reported_seq":432,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:49.328465+0000","last_change":"2024-04-25T02:19:49.328465+0000","last_active":"2024-04-25T02:19:49.328465+0000","last_peered":"2024-04-25T02:19:49.328465+0000","last_clean":"2024-04-25T02:19:49.328465+0000","last_became_active":"2024-04-25T02:10:02.737471+0000","last_became_peered":"2024-04-25T02:10:02.737471+0000","last_unstale":"2024-04-25T02:19:49.328465+0000","last_undegraded":"2024-04-25T02:19:49.328465+0000","last_fullsized":"2024-04-25T02:19:49.328465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'415","last_scrub_stamp":"2024-04-25T02:19:49.328361+0000","last_deep_scrub":"19'415","last_deep_scrub_stamp":"2024-04-25T02:19:49.328361+0000","last_clean_scrub_stamp":"2024-04-25T02:19:49.328361+0000","log_size":415,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:08.840625+0000","last_change":"2024-04-25T02:19:08.840625+0000","last_active":"2024-04-25T02:19:08.840625+0000","last_peered":"2024-04-25T02:19:08.840625+0000","last_clean":"2024-04-25T02:19:08.840625+0000","last_became_active":"2024-04-25T02:09:58.218887+0000","last_became_peered":"2024-04-25T02:09:58.218887+0000","last_unstale":"2024-04-25T02:19:08.840625+0000","last_undegraded":"2024-04-25T02:19:08.840625+0000","last_fullsized":"2024-04-25T02:19:08.840625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:08.840520+0000","last_clean_scrub_stamp":"2024-04-25T02:19:08.840520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'45","reported_seq":63,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:09.518176+0000","last_change":"2024-04-25T02:19:09.518176+0000","last_active":"2024-04-25T02:19:09.518176+0000","last_peered":"2024-04-25T02:19:09.518176+0000","last_clean":"2024-04-25T02:19:09.518176+0000","last_became_active":"2024-04-25T02:10:02.359985+0000","last_became_peered":"2024-04-25T02:10:02.359985+0000","last_unstale":"2024-04-25T02:19:09.518176+0000","last_undegraded":"2024-04-25T02:19:09.518176+0000","last_fullsized":"2024-04-25T02:19:09.518176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'45","last_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_deep_scrub":"19'45","last_deep_scrub_stamp":"2024-04-25T02:19:09.518059+0000","last_clean_scrub_stamp":"2024-04-25T02:19:09.518059+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'343","reported_seq":360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:42.360853+0000","last_change":"2024-04-25T02:19:42.360853+0000","last_active":"2024-04-25T02:19:42.360853+0000","last_peered":"2024-04-25T02:19:42.360853+0000","last_clean":"2024-04-25T02:19:42.360853+0000","last_became_active":"2024-04-25T02:10:02.727113+0000","last_became_peered":"2024-04-25T02:10:02.727113+0000","last_unstale":"2024-04-25T02:19:42.360853+0000","last_undegraded":"2024-04-25T02:19:42.360853+0000","last_fullsized":"2024-04-25T02:19:42.360853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'343","last_scrub_stamp":"2024-04-25T02:19:42.360731+0000","last_deep_scrub":"19'343","last_deep_scrub_stamp":"2024-04-25T02:19:42.360731+0000","last_clean_scrub_stamp":"2024-04-25T02:19:42.360731+0000","log_size":343,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'65","reported_seq":83,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:13.839509+0000","last_change":"2024-04-25T02:19:13.839509+0000","last_active":"2024-04-25T02:19:13.839509+0000","last_peered":"2024-04-25T02:19:13.839509+0000","last_clean":"2024-04-25T02:19:13.839509+0000","last_became_active":"2024-04-25T02:10:02.369920+0000","last_became_peered":"2024-04-25T02:10:02.369920+0000","last_unstale":"2024-04-25T02:19:13.839509+0000","last_undegraded":"2024-04-25T02:19:13.839509+0000","last_fullsized":"2024-04-25T02:19:13.839509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'65","last_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_deep_scrub":"19'65","last_deep_scrub_stamp":"2024-04-25T02:19:13.839408+0000","last_clean_scrub_stamp":"2024-04-25T02:19:13.839408+0000","log_size":65,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:03.479134+0000","last_change":"2024-04-25T02:19:03.479134+0000","last_active":"2024-04-25T02:19:03.479134+0000","last_peered":"2024-04-25T02:19:03.479134+0000","last_clean":"2024-04-25T02:19:03.479134+0000","last_became_active":"2024-04-25T02:09:58.221299+0000","last_became_peered":"2024-04-25T02:09:58.221299+0000","last_unstale":"2024-04-25T02:19:03.479134+0000","last_undegraded":"2024-04-25T02:19:03.479134+0000","last_fullsized":"2024-04-25T02:19:03.479134+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:03.479027+0000","last_clean_scrub_stamp":"2024-04-25T02:19:03.479027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'368","reported_seq":385,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:02.816642+0000","last_change":"2024-04-25T02:20:02.816642+0000","last_active":"2024-04-25T02:20:02.816642+0000","last_peered":"2024-04-25T02:20:02.816642+0000","last_clean":"2024-04-25T02:20:02.816642+0000","last_became_active":"2024-04-25T02:10:02.731200+0000","last_became_peered":"2024-04-25T02:10:02.731200+0000","last_unstale":"2024-04-25T02:20:02.816642+0000","last_undegraded":"2024-04-25T02:20:02.816642+0000","last_fullsized":"2024-04-25T02:20:02.816642+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'368","last_scrub_stamp":"2024-04-25T02:20:02.816526+0000","last_deep_scrub":"19'368","last_deep_scrub_stamp":"2024-04-25T02:20:02.816526+0000","last_clean_scrub_stamp":"2024-04-25T02:20:02.816526+0000","log_size":368,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:10.845393+0000","last_change":"2024-04-25T02:19:10.845393+0000","last_active":"2024-04-25T02:19:10.845393+0000","last_peered":"2024-04-25T02:19:10.845393+0000","last_clean":"2024-04-25T02:19:10.845393+0000","last_became_active":"2024-04-25T02:09:58.218869+0000","last_became_peered":"2024-04-25T02:09:58.218869+0000","last_unstale":"2024-04-25T02:19:10.845393+0000","last_undegraded":"2024-04-25T02:19:10.845393+0000","last_fullsized":"2024-04-25T02:19:10.845393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:19:10.845259+0000","last_clean_scrub_stamp":"2024-04-25T02:19:10.845259+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'72","reported_seq":90,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:07.244226+0000","last_change":"2024-04-25T02:19:07.244226+0000","last_active":"2024-04-25T02:19:07.244226+0000","last_peered":"2024-04-25T02:19:07.244226+0000","last_clean":"2024-04-25T02:19:07.244226+0000","last_became_active":"2024-04-25T02:10:02.370194+0000","last_became_peered":"2024-04-25T02:10:02.370194+0000","last_unstale":"2024-04-25T02:19:07.244226+0000","last_undegraded":"2024-04-25T02:19:07.244226+0000","last_fullsized":"2024-04-25T02:19:07.244226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'72","last_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_deep_scrub":"19'72","last_deep_scrub_stamp":"2024-04-25T02:19:07.244087+0000","last_clean_scrub_stamp":"2024-04-25T02:19:07.244087+0000","log_size":72,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'336","reported_seq":353,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:16.688927+0000","last_change":"2024-04-25T02:19:16.688927+0000","last_active":"2024-04-25T02:19:16.688927+0000","last_peered":"2024-04-25T02:19:16.688927+0000","last_clean":"2024-04-25T02:19:16.688927+0000","last_became_active":"2024-04-25T02:10:02.748428+0000","last_became_peered":"2024-04-25T02:10:02.748428+0000","last_unstale":"2024-04-25T02:19:16.688927+0000","last_undegraded":"2024-04-25T02:19:16.688927+0000","last_fullsized":"2024-04-25T02:19:16.688927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'336","last_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_deep_scrub":"19'336","last_deep_scrub_stamp":"2024-04-25T02:19:16.688815+0000","last_clean_scrub_stamp":"2024-04-25T02:19:16.688815+0000","log_size":336,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'30","reported_seq":48,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:30.310189+0000","last_change":"2024-04-25T02:19:30.310189+0000","last_active":"2024-04-25T02:19:30.310189+0000","last_peered":"2024-04-25T02:19:30.310189+0000","last_clean":"2024-04-25T02:19:30.310189+0000","last_became_active":"2024-04-25T02:10:02.374455+0000","last_became_peered":"2024-04-25T02:10:02.374455+0000","last_unstale":"2024-04-25T02:19:30.310189+0000","last_undegraded":"2024-04-25T02:19:30.310189+0000","last_fullsized":"2024-04-25T02:19:30.310189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'30","last_scrub_stamp":"2024-04-25T02:19:30.310064+0000","last_deep_scrub":"19'30","last_deep_scrub_stamp":"2024-04-25T02:19:30.310064+0000","last_clean_scrub_stamp":"2024-04-25T02:19:30.310064+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:38.812597+0000","last_change":"2024-04-25T02:19:38.812597+0000","last_active":"2024-04-25T02:19:38.812597+0000","last_peered":"2024-04-25T02:19:38.812597+0000","last_clean":"2024-04-25T02:19:38.812597+0000","last_became_active":"2024-04-25T02:10:02.741056+0000","last_became_peered":"2024-04-25T02:10:02.741056+0000","last_unstale":"2024-04-25T02:19:38.812597+0000","last_undegraded":"2024-04-25T02:19:38.812597+0000","last_fullsized":"2024-04-25T02:19:38.812597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:38.812488+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:38.812488+0000","last_clean_scrub_stamp":"2024-04-25T02:19:38.812488+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'48","reported_seq":66,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:25.575977+0000","last_change":"2024-04-25T02:19:25.575977+0000","last_active":"2024-04-25T02:19:25.575977+0000","last_peered":"2024-04-25T02:19:25.575977+0000","last_clean":"2024-04-25T02:19:25.575977+0000","last_became_active":"2024-04-25T02:10:02.360253+0000","last_became_peered":"2024-04-25T02:10:02.360253+0000","last_unstale":"2024-04-25T02:19:25.575977+0000","last_undegraded":"2024-04-25T02:19:25.575977+0000","last_fullsized":"2024-04-25T02:19:25.575977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'48","last_scrub_stamp":"2024-04-25T02:19:25.575846+0000","last_deep_scrub":"19'48","last_deep_scrub_stamp":"2024-04-25T02:19:25.575846+0000","last_clean_scrub_stamp":"2024-04-25T02:19:25.575846+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'335","reported_seq":352,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:36.792418+0000","last_change":"2024-04-25T02:19:36.792418+0000","last_active":"2024-04-25T02:19:36.792418+0000","last_peered":"2024-04-25T02:19:36.792418+0000","last_clean":"2024-04-25T02:19:36.792418+0000","last_became_active":"2024-04-25T02:10:02.742821+0000","last_became_peered":"2024-04-25T02:10:02.742821+0000","last_unstale":"2024-04-25T02:19:36.792418+0000","last_undegraded":"2024-04-25T02:19:36.792418+0000","last_fullsized":"2024-04-25T02:19:36.792418+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'335","last_scrub_stamp":"2024-04-25T02:19:36.792293+0000","last_deep_scrub":"19'335","last_deep_scrub_stamp":"2024-04-25T02:19:36.792293+0000","last_clean_scrub_stamp":"2024-04-25T02:19:36.792293+0000","log_size":335,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":2199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'246","reported_seq":264,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:57.854639+0000","last_change":"2024-04-25T02:19:57.854639+0000","last_active":"2024-04-25T02:19:57.854639+0000","last_peered":"2024-04-25T02:19:57.854639+0000","last_clean":"2024-04-25T02:19:57.854639+0000","last_became_active":"2024-04-25T02:10:02.372416+0000","last_became_peered":"2024-04-25T02:10:02.372416+0000","last_unstale":"2024-04-25T02:19:57.854639+0000","last_undegraded":"2024-04-25T02:19:57.854639+0000","last_fullsized":"2024-04-25T02:19:57.854639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'246","last_scrub_stamp":"2024-04-25T02:19:57.854529+0000","last_deep_scrub":"19'246","last_deep_scrub_stamp":"2024-04-25T02:19:57.854529+0000","last_clean_scrub_stamp":"2024-04-25T02:19:57.854529+0000","log_size":246,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":12479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'358","reported_seq":375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:34.856685+0000","last_change":"2024-04-25T02:19:34.856685+0000","last_active":"2024-04-25T02:19:34.856685+0000","last_peered":"2024-04-25T02:19:34.856685+0000","last_clean":"2024-04-25T02:19:34.856685+0000","last_became_active":"2024-04-25T02:10:02.743032+0000","last_became_peered":"2024-04-25T02:10:02.743032+0000","last_unstale":"2024-04-25T02:19:34.856685+0000","last_undegraded":"2024-04-25T02:19:34.856685+0000","last_fullsized":"2024-04-25T02:19:34.856685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'358","last_scrub_stamp":"2024-04-25T02:19:34.856571+0000","last_deep_scrub":"19'358","last_deep_scrub_stamp":"2024-04-25T02:19:34.856571+0000","last_clean_scrub_stamp":"2024-04-25T02:19:34.856571+0000","log_size":358,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'111","reported_seq":129,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:00.870849+0000","last_change":"2024-04-25T02:20:00.870849+0000","last_active":"2024-04-25T02:20:00.870849+0000","last_peered":"2024-04-25T02:20:00.870849+0000","last_clean":"2024-04-25T02:20:00.870849+0000","last_became_active":"2024-04-25T02:10:02.365909+0000","last_became_peered":"2024-04-25T02:10:02.365909+0000","last_unstale":"2024-04-25T02:20:00.870849+0000","last_undegraded":"2024-04-25T02:20:00.870849+0000","last_fullsized":"2024-04-25T02:20:00.870849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'111","last_scrub_stamp":"2024-04-25T02:20:00.870745+0000","last_deep_scrub":"19'111","last_deep_scrub_stamp":"2024-04-25T02:20:00.870745+0000","last_clean_scrub_stamp":"2024-04-25T02:20:00.870745+0000","log_size":111,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":8241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'370","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:17.718343+0000","last_change":"2024-04-25T02:20:17.718343+0000","last_active":"2024-04-25T02:20:17.718343+0000","last_peered":"2024-04-25T02:20:17.718343+0000","last_clean":"2024-04-25T02:20:17.718343+0000","last_became_active":"2024-04-25T02:10:02.740212+0000","last_became_peered":"2024-04-25T02:10:02.740212+0000","last_unstale":"2024-04-25T02:20:17.718343+0000","last_undegraded":"2024-04-25T02:20:17.718343+0000","last_fullsized":"2024-04-25T02:20:17.718343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'370","last_scrub_stamp":"2024-04-25T02:20:17.718225+0000","last_deep_scrub":"19'370","last_deep_scrub_stamp":"2024-04-25T02:20:17.718225+0000","last_clean_scrub_stamp":"2024-04-25T02:20:17.718225+0000","log_size":370,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'58","reported_seq":76,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:33.337408+0000","last_change":"2024-04-25T02:19:33.337408+0000","last_active":"2024-04-25T02:19:33.337408+0000","last_peered":"2024-04-25T02:19:33.337408+0000","last_clean":"2024-04-25T02:19:33.337408+0000","last_became_active":"2024-04-25T02:10:02.370356+0000","last_became_peered":"2024-04-25T02:10:02.370356+0000","last_unstale":"2024-04-25T02:19:33.337408+0000","last_undegraded":"2024-04-25T02:19:33.337408+0000","last_fullsized":"2024-04-25T02:19:33.337408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'58","last_scrub_stamp":"2024-04-25T02:19:33.337308+0000","last_deep_scrub":"19'58","last_deep_scrub_stamp":"2024-04-25T02:19:33.337308+0000","last_clean_scrub_stamp":"2024-04-25T02:19:33.337308+0000","log_size":58,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'414","reported_seq":431,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:32.829574+0000","last_change":"2024-04-25T02:19:32.829574+0000","last_active":"2024-04-25T02:19:32.829574+0000","last_peered":"2024-04-25T02:19:32.829574+0000","last_clean":"2024-04-25T02:19:32.829574+0000","last_became_active":"2024-04-25T02:10:02.741761+0000","last_became_peered":"2024-04-25T02:10:02.741761+0000","last_unstale":"2024-04-25T02:19:32.829574+0000","last_undegraded":"2024-04-25T02:19:32.829574+0000","last_fullsized":"2024-04-25T02:19:32.829574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'414","last_scrub_stamp":"2024-04-25T02:19:32.829454+0000","last_deep_scrub":"19'414","last_deep_scrub_stamp":"2024-04-25T02:19:32.829454+0000","last_clean_scrub_stamp":"2024-04-25T02:19:32.829454+0000","log_size":414,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'413","reported_seq":430,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:44.539813+0000","last_change":"2024-04-25T02:19:44.539813+0000","last_active":"2024-04-25T02:19:44.539813+0000","last_peered":"2024-04-25T02:19:44.539813+0000","last_clean":"2024-04-25T02:19:44.539813+0000","last_became_active":"2024-04-25T02:10:02.732036+0000","last_became_peered":"2024-04-25T02:10:02.732036+0000","last_unstale":"2024-04-25T02:19:44.539813+0000","last_undegraded":"2024-04-25T02:19:44.539813+0000","last_fullsized":"2024-04-25T02:19:44.539813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'413","last_scrub_stamp":"2024-04-25T02:19:44.539696+0000","last_deep_scrub":"19'413","last_deep_scrub_stamp":"2024-04-25T02:19:44.539696+0000","last_clean_scrub_stamp":"2024-04-25T02:19:44.539696+0000","log_size":413,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":2919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'401","reported_seq":418,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.738465+0000","last_change":"2024-04-25T02:20:26.738465+0000","last_active":"2024-04-25T02:20:26.738465+0000","last_peered":"2024-04-25T02:20:26.738465+0000","last_clean":"2024-04-25T02:20:26.738465+0000","last_became_active":"2024-04-25T02:10:02.739671+0000","last_became_peered":"2024-04-25T02:10:02.739671+0000","last_unstale":"2024-04-25T02:20:26.738465+0000","last_undegraded":"2024-04-25T02:20:26.738465+0000","last_fullsized":"2024-04-25T02:20:26.738465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'401","last_scrub_stamp":"2024-04-25T02:20:26.738349+0000","last_deep_scrub":"19'401","last_deep_scrub_stamp":"2024-04-25T02:20:26.738349+0000","last_clean_scrub_stamp":"2024-04-25T02:20:26.738349+0000","log_size":401,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":3172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'394","reported_seq":411,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:02.325169+0000","last_change":"2024-04-25T02:20:02.325169+0000","last_active":"2024-04-25T02:20:02.325169+0000","last_peered":"2024-04-25T02:20:02.325169+0000","last_clean":"2024-04-25T02:20:02.325169+0000","last_became_active":"2024-04-25T02:10:02.743423+0000","last_became_peered":"2024-04-25T02:10:02.743423+0000","last_unstale":"2024-04-25T02:20:02.325169+0000","last_undegraded":"2024-04-25T02:20:02.325169+0000","last_fullsized":"2024-04-25T02:20:02.325169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'394","last_scrub_stamp":"2024-04-25T02:20:02.325045+0000","last_deep_scrub":"19'394","last_deep_scrub_stamp":"2024-04-25T02:20:02.325045+0000","last_clean_scrub_stamp":"2024-04-25T02:20:02.325045+0000","log_size":394,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":2934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'366","reported_seq":383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:27.779626+0000","last_change":"2024-04-25T02:20:27.779626+0000","last_active":"2024-04-25T02:20:27.779626+0000","last_peered":"2024-04-25T02:20:27.779626+0000","last_clean":"2024-04-25T02:20:27.779626+0000","last_became_active":"2024-04-25T02:10:02.737420+0000","last_became_peered":"2024-04-25T02:10:02.737420+0000","last_unstale":"2024-04-25T02:20:27.779626+0000","last_undegraded":"2024-04-25T02:20:27.779626+0000","last_fullsized":"2024-04-25T02:20:27.779626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'366","last_scrub_stamp":"2024-04-25T02:20:27.779518+0000","last_deep_scrub":"19'366","last_deep_scrub_stamp":"2024-04-25T02:20:27.779518+0000","last_clean_scrub_stamp":"2024-04-25T02:20:27.779518+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'333","reported_seq":350,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:19:50.505906+0000","last_change":"2024-04-25T02:19:50.505906+0000","last_active":"2024-04-25T02:19:50.505906+0000","last_peered":"2024-04-25T02:19:50.505906+0000","last_clean":"2024-04-25T02:19:50.505906+0000","last_became_active":"2024-04-25T02:10:02.732231+0000","last_became_peered":"2024-04-25T02:10:02.732231+0000","last_unstale":"2024-04-25T02:19:50.505906+0000","last_undegraded":"2024-04-25T02:19:50.505906+0000","last_fullsized":"2024-04-25T02:19:50.505906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'333","last_scrub_stamp":"2024-04-25T02:19:50.505793+0000","last_deep_scrub":"19'333","last_deep_scrub_stamp":"2024-04-25T02:19:50.505793+0000","last_clean_scrub_stamp":"2024-04-25T02:19:50.505793+0000","log_size":333,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":167505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23216,"ondisk_log_size":23216,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":158294345,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":622,"num_read_kb":1507,"num_write":3994,"num_write_kb":199381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5330,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":316645376,"data_stored":316588690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3942,"ondisk_log_size":3942,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705797,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370056,"kb_used_data":72832,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94001784,"statfs":{"total":96636764160,"available":96257826816,"internally_reserved":0,"allocated":74579968,"data_stored":74464209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.253,"15min":0.26900000000000002},"min":{"1min":0.17799999999999999,"5min":0.156,"15min":0.14599999999999999},"max":{"1min":0.46899999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.29399999999999998},"min":{"1min":0.20000000000000001,"5min":0.16500000000000001,"15min":0.16300000000000001},"max":{"1min":0.495,"5min":0.50900000000000001,"15min":0.53400000000000003},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.27900000000000003,"15min":0.30099999999999999},"min":{"1min":0.24299999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.373},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.28399999999999997,"15min":0.30099999999999999},"min":{"1min":0.246,"5min":0.186,"15min":0.186},"max":{"1min":0.55300000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Apr 25 02:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.30499999999999999,"15min":0.32700000000000001},"min":{"1min":0.24199999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.307,"15min":0.32400000000000001},"min":{"1min":0.28699999999999998,"5min":0.20899999999999999,"15min":0.185},"max":{"1min":0.54600000000000004,"5min":0.628,"15min":0.628},"last":0.38800000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705796,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405844,"kb_used_data":100428,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93965996,"statfs":{"total":96636764160,"available":96221179904,"internally_reserved":0,"allocated":102838272,"data_stored":102710905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.251,"15min":0.28599999999999998},"min":{"1min":0.20999999999999999,"5min":0.153,"15min":0.13200000000000001},"max":{"1min":0.44,"5min":0.44900000000000001,"15min":0.49299999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.26300000000000001,"15min":0.29399999999999998},"min":{"1min":0.23499999999999999,"5min":0.16700000000000001,"15min":0.155},"max":{"1min":0.45200000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.28199999999999997,"15min":0.315},"min":{"1min":0.28699999999999998,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.28599999999999998,"15min":0.314},"min":{"1min":0.253,"5min":0.19400000000000001,"15min":0.16700000000000001},"max":{"1min":0.48299999999999998,"5min":0.50700000000000001,"15min":0.53400000000000003},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.29799999999999999,"15min":0.32800000000000001},"min":{"1min":0.315,"5min":0.186,"15min":0.186},"max":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.441},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.32800000000000001},"min":{"1min":0.28499999999999998,"5min":0.19400000000000001,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.51900000000000002},"last":0.46800000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705796,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364024,"kb_used_data":66800,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94007816,"statfs":{"total":96636764160,"available":96264003584,"internally_reserved":0,"allocated":68403200,"data_stored":68279904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.68400000000000005,"15min":0.42999999999999999},"min":{"1min":0.23200000000000001,"5min":0.156,"15min":0.14399999999999999},"max":{"1min":0.42799999999999999,"5min":34.734000000000002,"15min":34.734000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34499999999999997,"15min":0.32400000000000001},"min":{"1min":0.254,"5min":0.16700000000000001,"15min":0.16300000000000001},"max":{"1min":0.46999999999999997,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.41299999999999998,"15min":0.35699999999999998},"min":{"1min":0.23699999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.51900000000000002,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.40999999999999998,"15min":0.35599999999999998},"min":{"1min":0.28499999999999998,"5min":0.19700000000000001,"15min":0.192},"max":{"1min":0.498,"5min":9.2899999999999991,"15min":9.2899999999999991},"last":0.439}]},{"osd":3,"last update":"Thu Apr 25 02:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.68300000000000005,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.182,"15min":0.182},"max":{"1min":0.49199999999999999,"5min":29.867999999999999,"15min":29.867999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.55900000000000005,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20100000000000001},"max":{"1min":0.501,"5min":20.276,"15min":20.276},"last":0.45600000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705797,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371124,"kb_used_data":69804,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94000716,"statfs":{"total":96636764160,"available":96256733184,"internally_reserved":0,"allocated":71479296,"data_stored":71360528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.246,"15min":0.27200000000000002},"min":{"1min":0.22900000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.443,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.26700000000000002,"15min":0.28899999999999998},"min":{"1min":0.22700000000000001,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":0.48899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.309}]},{"osd":2,"last update":"Thu Apr 25 02:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.28699999999999998,"15min":0.311},"min":{"1min":0.25900000000000001,"5min":0.154,"15min":0.153},"max":{"1min":0.504,"5min":0.53300000000000003,"15min":0.57799999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.309,"15min":0.33300000000000002},"min":{"1min":0.255,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.52000000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.377}]},{"osd":3,"last update":"Thu Apr 25 02:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.29699999999999999,"15min":0.311},"min":{"1min":0.26000000000000001,"5min":0.17999999999999999,"15min":0.17799999999999999},"max":{"1min":0.53800000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.308,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.35799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":68239360,"data_stored":68223190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":74416128,"data_stored":74407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102674432,"data_stored":102654191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:20:43.965 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T02:20:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07b4ece700 1 Processor -- start 2024-04-25T02:20:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07b4ece700 1 -- start start 2024-04-25T02:20:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07b4ece700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07b0095190 0x7f07b0095570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07b4ece700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095a60 0x7f07b012c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07b4ece700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b012c4f0 0x7f07b012e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07b4ece700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b0096570 con 0x7f07b0095190 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07b4ece700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00923f0 con 0x7f07b0095a60 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07b4ece700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0094c70 con 0x7f07b012c4f0 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07ae59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07b0095190 0x7f07b0095570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07aed9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b012c4f0 0x7f07b012e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07add9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095a60 0x7f07b012c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07aed9d700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b012c4f0 0x7f07b012e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37542/0 (socket says 172.21.15.78:37542) 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07add9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095a60 0x7f07b012c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51492/0 (socket says 172.21.15.78:51492) 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07aed9d700 1 -- 172.21.15.78:0/2267999868 learned_addr learned my addr 172.21.15.78:0/2267999868 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.106+0000 7f07ae59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07b0095190 0x7f07b0095570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49354/0 (socket says 172.21.15.78:49354) 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07add9b700 1 -- 172.21.15.78:0/2267999868 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b012c4f0 msgr2=0x7f07b012e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07add9b700 1 --2- 172.21.15.78:0/2267999868 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b012c4f0 0x7f07b012e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07add9b700 1 -- 172.21.15.78:0/2267999868 >> v2:172.21.15.78:3300/0 conn(0x7f07b0095190 msgr2=0x7f07b0095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07add9b700 1 --2- 172.21.15.78:0/2267999868 >> v2:172.21.15.78:3300/0 conn(0x7f07b0095190 0x7f07b0095570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07add9b700 1 -- 172.21.15.78:0/2267999868 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b0096da0 con 0x7f07b0095a60 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07ae59c700 1 --2- 172.21.15.78:0/2267999868 >> v2:172.21.15.78:3300/0 conn(0x7f07b0095190 0x7f07b0095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07add9b700 1 --2- 172.21.15.78:0/2267999868 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095a60 0x7f07b012c000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f07a0009760 tx=0x7f07a0009060).ready entity=mon.1 client_cookie=96a3a51148c99b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07ad59a700 1 -- 172.21.15.78:0/2267999868 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a00090d0 con 0x7f07b0095a60 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07ad59a700 1 -- 172.21.15.78:0/2267999868 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a000d4a0 con 0x7f07b0095a60 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07ad59a700 1 -- 172.21.15.78:0/2267999868 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a000d820 con 0x7f07b0095a60 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07b4ece700 1 -- 172.21.15.78:0/2267999868 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095a60 msgr2=0x7f07b012c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07b4ece700 1 --2- 172.21.15.78:0/2267999868 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095a60 0x7f07b012c000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f07a0009760 tx=0x7f07a0009060).stop 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07b4ece700 1 -- 172.21.15.78:0/2267999868 shutdown_connections 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07b4ece700 1 --2- 172.21.15.78:0/2267999868 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b012c4f0 0x7f07b012e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07b4ece700 1 --2- 172.21.15.78:0/2267999868 >> v2:172.21.15.78:3300/0 conn(0x7f07b0095190 0x7f07b0095570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07b4ece700 1 --2- 172.21.15.78:0/2267999868 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095a60 0x7f07b012c000 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.107+0000 7f07b4ece700 1 -- 172.21.15.78:0/2267999868 >> 172.21.15.78:0/2267999868 conn(0x7f07b009a970 msgr2=0x7f07b009ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.108+0000 7f07b4ece700 1 -- 172.21.15.78:0/2267999868 shutdown_connections 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.108+0000 7f07b4ece700 1 -- 172.21.15.78:0/2267999868 wait complete. 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.108+0000 7f07b4ece700 1 Processor -- start 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07b4ece700 1 -- start start 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07b4ece700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095190 0x7f07b012bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07b4ece700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b0095a60 0x7f07b0116a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07b4ece700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07b012c4f0 0x7f07b0116f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07b4ece700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b006a140 con 0x7f07b012c4f0 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07b4ece700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0092540 con 0x7f07b0095190 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07b4ece700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b011a4f0 con 0x7f07b0095a60 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07ae59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095190 0x7f07b012bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07add9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b0095a60 0x7f07b0116a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07aed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07b012c4f0 0x7f07b0116f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07add9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b0095a60 0x7f07b0116a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37550/0 (socket says 172.21.15.78:37550) 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07add9b700 1 -- 172.21.15.78:0/2276311162 learned_addr learned my addr 172.21.15.78:0/2276311162 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07ae59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095190 0x7f07b012bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51502/0 (socket says 172.21.15.78:51502) 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07ae59c700 1 -- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b0095a60 msgr2=0x7f07b0116a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07ae59c700 1 --2- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b0095a60 0x7f07b0116a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07ae59c700 1 -- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07b012c4f0 msgr2=0x7f07b0116f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07ae59c700 1 --2- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07b012c4f0 0x7f07b0116f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07ae59c700 1 -- 172.21.15.78:0/2276311162 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a40092a0 con 0x7f07b0095190 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07add9b700 1 --2- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b0095a60 0x7f07b0116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07aed9d700 1 --2- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07b012c4f0 0x7f07b0116f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.109+0000 7f07ae59c700 1 --2- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095190 0x7f07b012bac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f07a400e9b0 tx=0x7f07a4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:44.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.110+0000 7f079effd700 1 -- 172.21.15.78:0/2276311162 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4009580 con 0x7f07b0095190 2024-04-25T02:20:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.110+0000 7f079effd700 1 -- 172.21.15.78:0/2276311162 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4012600 con 0x7f07b0095190 2024-04-25T02:20:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.110+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a00092a0 con 0x7f07b0095190 2024-04-25T02:20:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.110+0000 7f079effd700 1 -- 172.21.15.78:0/2276311162 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4012980 con 0x7f07b0095190 2024-04-25T02:20:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.110+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b01187a0 con 0x7f07b0095190 2024-04-25T02:20:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.110+0000 7f079effd700 1 -- 172.21.15.78:0/2276311162 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f07a4012d30 con 0x7f07b0095190 2024-04-25T02:20:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.110+0000 7f079effd700 1 -- 172.21.15.78:0/2276311162 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f07a403b610 con 0x7f07b0095190 2024-04-25T02:20:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.111+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b0092fb0 con 0x7f07b0095190 2024-04-25T02:20:44.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.115+0000 7f079effd700 1 -- 172.21.15.78:0/2276311162 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f07a4016030 con 0x7f07b0095190 2024-04-25T02:20:44.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.278+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f07b011a120 con 0x7f07b0095190 2024-04-25T02:20:44.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.283+0000 7f079effd700 1 -- 172.21.15.78:0/2276311162 <== mon.1 v2:172.21.15.78:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f07a4019310 con 0x7f07b0095190 2024-04-25T02:20:44.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.283+0000 7f079effd700 1 -- 172.21.15.78:0/2276311162 <== mon.1 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f07a4011b00 con 0x7f07b0095190 2024-04-25T02:20:44.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.285+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 >> v1:172.21.15.78:6816/46507 conn(0x7f079002bd00 legacy=0x7f079002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.285+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095190 msgr2=0x7f07b012bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.285+0000 7f07b4ece700 1 --2- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095190 0x7f07b012bac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f07a400e9b0 tx=0x7f07a4009060).stop 2024-04-25T02:20:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.285+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 shutdown_connections 2024-04-25T02:20:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.285+0000 7f07b4ece700 1 --2- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07b012c4f0 0x7f07b0116f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.285+0000 7f07b4ece700 1 --2- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07b0095190 0x7f07b012bac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.285+0000 7f07b4ece700 1 --2- 172.21.15.78:0/2276311162 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f07b0095a60 0x7f07b0116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.285+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 >> 172.21.15.78:0/2276311162 conn(0x7f07b009a970 msgr2=0x7f07b0099520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.286+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 shutdown_connections 2024-04-25T02:20:44.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.286+0000 7f07b4ece700 1 -- 172.21.15.78:0/2276311162 wait complete. 2024-04-25T02:20:44.301 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:20:44.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.410+0000 7fa820d40700 1 Processor -- start 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.410+0000 7fa820d40700 1 -- start start 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa820d40700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c062860 0x7fa81c1271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa820d40700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c1277a0 0x7fa81c127ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa820d40700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c096490 con 0x7fa81c095190 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa820d40700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c062c40 con 0x7fa81c062860 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa820d40700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c091b90 con 0x7fa81c1277a0 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa81ad9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa81c095190 0x7fa81c095610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39472/0 (socket says 172.21.15.78:39472) 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa81a59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c062860 0x7fa81c1271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa81ad9d700 1 -- 172.21.15.78:0/3434081284 learned_addr learned my addr 172.21.15.78:0/3434081284 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa819d9b700 1 --2- 172.21.15.78:0/3434081284 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c1277a0 0x7fa81c127ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa81959a700 1 -- 172.21.15.78:0/3434081284 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515898825 0 0) 0x7fa81c096490 con 0x7fa81c095190 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa819d9b700 1 -- 172.21.15.78:0/3434081284 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c062860 msgr2=0x7fa81c1271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa819d9b700 1 --2- 172.21.15.78:0/3434081284 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c062860 0x7fa81c1271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa819d9b700 1 -- 172.21.15.78:0/3434081284 >> v1:172.21.15.78:6789/0 conn(0x7fa81c095190 legacy=0x7fa81c095610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa819d9b700 1 -- 172.21.15.78:0/3434081284 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c091e50 con 0x7fa81c1277a0 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.411+0000 7fa81a59c700 1 --2- 172.21.15.78:0/3434081284 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c062860 0x7fa81c1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa819d9b700 1 --2- 172.21.15.78:0/3434081284 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c1277a0 0x7fa81c127ba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fa80c0097c0 tx=0x7fa80c009060).ready entity=mon.2 client_cookie=7cfcee5e8f194cea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa81959a700 1 -- 172.21.15.78:0/3434081284 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00f510 con 0x7fa81c1277a0 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa81959a700 1 -- 172.21.15.78:0/3434081284 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa80c00f670 con 0x7fa81c1277a0 2024-04-25T02:20:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa81959a700 1 -- 172.21.15.78:0/3434081284 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00fa10 con 0x7fa81c1277a0 2024-04-25T02:20:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa820d40700 1 -- 172.21.15.78:0/3434081284 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c1277a0 msgr2=0x7fa81c127ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa820d40700 1 --2- 172.21.15.78:0/3434081284 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c1277a0 0x7fa81c127ba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fa80c0097c0 tx=0x7fa80c009060).stop 2024-04-25T02:20:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa820d40700 1 -- 172.21.15.78:0/3434081284 shutdown_connections 2024-04-25T02:20:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa820d40700 1 --2- 172.21.15.78:0/3434081284 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c062860 0x7fa81c1271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa820d40700 1 --2- 172.21.15.78:0/3434081284 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c1277a0 0x7fa81c127ba0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa820d40700 1 -- 172.21.15.78:0/3434081284 >> 172.21.15.78:0/3434081284 conn(0x7fa81c097450 msgr2=0x7fa81c097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa820d40700 1 -- 172.21.15.78:0/3434081284 shutdown_connections 2024-04-25T02:20:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.412+0000 7fa820d40700 1 -- 172.21.15.78:0/3434081284 wait complete. 2024-04-25T02:20:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.413+0000 7fa820d40700 1 Processor -- start 2024-04-25T02:20:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.413+0000 7fa820d40700 1 -- start start 2024-04-25T02:20:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa820d40700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81c062860 0x7fa81c1269e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa820d40700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c095190 0x7fa81c1159b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa820d40700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c1277a0 0x7fa81c115ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa820d40700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c096d20 con 0x7fa81c062860 2024-04-25T02:20:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa820d40700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c118eb0 con 0x7fa81c1277a0 2024-04-25T02:20:44.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa820d40700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c127200 con 0x7fa81c095190 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81ad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c1277a0 0x7fa81c115ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81c062860 0x7fa81c1269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa819d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c095190 0x7fa81c1159b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81ad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c1277a0 0x7fa81c115ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51520/0 (socket says 172.21.15.78:51520) 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81c062860 0x7fa81c1269e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49362/0 (socket says 172.21.15.78:49362) 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa819d9b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c095190 0x7fa81c1159b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37572/0 (socket says 172.21.15.78:37572) 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81ad9d700 1 -- 172.21.15.78:0/3284668070 learned_addr learned my addr 172.21.15.78:0/3284668070 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81ad9d700 1 -- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c095190 msgr2=0x7fa81c1159b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81ad9d700 1 --2- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c095190 0x7fa81c1159b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81ad9d700 1 -- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81c062860 msgr2=0x7fa81c1269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81ad9d700 1 --2- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81c062860 0x7fa81c1269e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81ad9d700 1 -- 172.21.15.78:0/3284668070 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100092a0 con 0x7fa81c1277a0 2024-04-25T02:20:44.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa819d9b700 1 --2- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c095190 0x7fa81c1159b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa81ad9d700 1 --2- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c1277a0 0x7fa81c115ea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa81400c7e0 tx=0x7fa814007f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa80affd700 1 -- 172.21.15.78:0/3284668070 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814005d30 con 0x7fa81c1277a0 2024-04-25T02:20:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa80affd700 1 -- 172.21.15.78:0/3284668070 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa814005e90 con 0x7fa81c1277a0 2024-04-25T02:20:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c0092a0 con 0x7fa81c1277a0 2024-04-25T02:20:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.414+0000 7fa80affd700 1 -- 172.21.15.78:0/3284668070 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814007340 con 0x7fa81c1277a0 2024-04-25T02:20:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.415+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c119af0 con 0x7fa81c1277a0 2024-04-25T02:20:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.415+0000 7fa80affd700 1 -- 172.21.15.78:0/3284668070 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fa814007730 con 0x7fa81c1277a0 2024-04-25T02:20:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.415+0000 7fa80affd700 1 -- 172.21.15.78:0/3284668070 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fa81403b270 con 0x7fa81c1277a0 2024-04-25T02:20:44.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.415+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c097f70 con 0x7fa81c1277a0 2024-04-25T02:20:44.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.420+0000 7fa80affd700 1 -- 172.21.15.78:0/3284668070 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fa81401c3e0 con 0x7fa81c1277a0 2024-04-25T02:20:44.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.615+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa81c046ce0 con 0x7fa81c1277a0 2024-04-25T02:20:44.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.615+0000 7fa80affd700 1 -- 172.21.15.78:0/3284668070 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fa81401a300 con 0x7fa81c1277a0 2024-04-25T02:20:44.619 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:20:44.619 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:02.698771+0000","modified":"2024-04-25T02:10:04.706190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 >> v1:172.21.15.78:6816/46507 conn(0x7fa7fc02bd00 legacy=0x7fa7fc02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c1277a0 msgr2=0x7fa81c115ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 --2- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c1277a0 0x7fa81c115ea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa81400c7e0 tx=0x7fa814007f90).stop 2024-04-25T02:20:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 shutdown_connections 2024-04-25T02:20:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 --2- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa81c1277a0 0x7fa81c115ea0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 --2- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81c062860 0x7fa81c1269e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 --2- 172.21.15.78:0/3284668070 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fa81c095190 0x7fa81c1159b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 >> 172.21.15.78:0/3284668070 conn(0x7fa81c097450 msgr2=0x7fa81c12ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:44.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 shutdown_connections 2024-04-25T02:20:44.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.617+0000 7fa820d40700 1 -- 172.21.15.78:0/3284668070 wait complete. 2024-04-25T02:20:44.622 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-25T02:20:44.632 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:44.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989ec2c700 1 Processor -- start 2024-04-25T02:20:44.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989ec2c700 1 -- start start 2024-04-25T02:20:44.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989ec2c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989805e960 0x7f9898098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989ec2c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9898099330 0x7f9898099730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989ec2c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989812d120 0x7f989812f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989ec2c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989806ad80 con 0x7f9898099330 2024-04-25T02:20:44.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989ec2c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989805ed40 con 0x7f989812d120 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989ec2c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98980682e0 con 0x7f989805e960 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f9897fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9898099330 0x7f9898099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989c9c8700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989805e960 0x7f9898098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989d1c9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989812d120 0x7f989812f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989c9c8700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989805e960 0x7f9898098e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37578/0 (socket says 172.21.15.78:37578) 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f9897fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9898099330 0x7f9898099730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49372/0 (socket says 172.21.15.78:49372) 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.743+0000 7f989c9c8700 1 -- 172.21.15.78:0/2766039498 learned_addr learned my addr 172.21.15.78:0/2766039498 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f9897fff700 1 -- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989805e960 msgr2=0x7f9898098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f9897fff700 1 --2- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989805e960 0x7f9898098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f9897fff700 1 -- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989812d120 msgr2=0x7f989812f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f9897fff700 1 --2- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989812d120 0x7f989812f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f9897fff700 1 -- 172.21.15.78:0/2766039498 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898069060 con 0x7f9898099330 2024-04-25T02:20:44.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f9897fff700 1 --2- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 0x7f9898099730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f9884009790 tx=0x7f9884009060).ready entity=mon.0 client_cookie=e10bda1e9e0e614b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f98977fe700 1 -- 172.21.15.78:0/2766039498 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988400d4a0 con 0x7f9898099330 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f98977fe700 1 -- 172.21.15.78:0/2766039498 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f988400d600 con 0x7f9898099330 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f98977fe700 1 -- 172.21.15.78:0/2766039498 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988400d9a0 con 0x7f9898099330 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f989ec2c700 1 -- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 msgr2=0x7f9898099730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.744+0000 7f989ec2c700 1 --2- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 0x7f9898099730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f9884009790 tx=0x7f9884009060).stop 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.745+0000 7f989ec2c700 1 -- 172.21.15.78:0/2766039498 shutdown_connections 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.745+0000 7f989ec2c700 1 --2- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989812d120 0x7f989812f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.745+0000 7f989ec2c700 1 --2- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989805e960 0x7f9898098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.745+0000 7f989ec2c700 1 --2- 172.21.15.78:0/2766039498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 0x7f9898099730 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.745+0000 7f989ec2c700 1 -- 172.21.15.78:0/2766039498 >> 172.21.15.78:0/2766039498 conn(0x7f98980974d0 msgr2=0x7f9898099f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.745+0000 7f989ec2c700 1 -- 172.21.15.78:0/2766039498 shutdown_connections 2024-04-25T02:20:44.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.745+0000 7f989ec2c700 1 -- 172.21.15.78:0/2766039498 wait complete. 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.745+0000 7f989ec2c700 1 Processor -- start 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.745+0000 7f989ec2c700 1 -- start start 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f989ec2c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989805e960 0x7f989812bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f989ec2c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 0x7f989812c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f989ec2c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989812d120 0x7f98981260b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f989ec2c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898127540 con 0x7f9898099330 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f989ec2c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9898129c10 con 0x7f989805e960 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f989ec2c700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9898091520 con 0x7f989812d120 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f9897fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 0x7f989812c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f989c9c8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989805e960 0x7f989812bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f9897fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 0x7f989812c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49386/0 (socket says 172.21.15.78:49386) 2024-04-25T02:20:44.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f9897fff700 1 -- 172.21.15.78:0/1558643520 learned_addr learned my addr 172.21.15.78:0/1558643520 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f989d1c9700 1 --2- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989812d120 0x7f98981260b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f9897fff700 1 -- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989812d120 msgr2=0x7f98981260b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f9897fff700 1 --2- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989812d120 0x7f98981260b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f9897fff700 1 -- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989805e960 msgr2=0x7f989812bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f9897fff700 1 --2- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989805e960 0x7f989812bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f9897fff700 1 -- 172.21.15.78:0/1558643520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98840092a0 con 0x7f9898099330 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.746+0000 7f989c9c8700 1 --2- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989805e960 0x7f989812bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.747+0000 7f9897fff700 1 --2- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 0x7f989812c170 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9884010000 tx=0x7f9884009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.747+0000 7f98957fa700 1 -- 172.21.15.78:0/1558643520 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988400d4a0 con 0x7f9898099330 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.747+0000 7f98957fa700 1 -- 172.21.15.78:0/1558643520 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f988400dd10 con 0x7f9898099330 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.747+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9898129600 con 0x7f9898099330 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.747+0000 7f98957fa700 1 -- 172.21.15.78:0/1558643520 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988400de80 con 0x7f9898099330 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.747+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989812a280 con 0x7f9898099330 2024-04-25T02:20:44.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.747+0000 7f98957fa700 1 -- 172.21.15.78:0/1558643520 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9884018070 con 0x7f9898099330 2024-04-25T02:20:44.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.747+0000 7f98957fa700 1 -- 172.21.15.78:0/1558643520 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f988403ca50 con 0x7f9898099330 2024-04-25T02:20:44.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.748+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989809a660 con 0x7f9898099330 2024-04-25T02:20:44.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.752+0000 7f98957fa700 1 -- 172.21.15.78:0/1558643520 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f9884026400 con 0x7f9898099330 2024-04-25T02:20:44.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.947+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9898093b90 con 0x7f9898099330 2024-04-25T02:20:44.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.947+0000 7f98957fa700 1 -- 172.21.15.78:0/1558643520 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7f98840253a0 con 0x7f9898099330 2024-04-25T02:20:44.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:20:44.951 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:10:02.698771+0000","modified":"2024-04-25T02:10:04.706190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6817/281509915","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6817","nonce":281509915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:44.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 >> v1:172.21.15.78:6816/46507 conn(0x7f987c02bd00 legacy=0x7f987c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 msgr2=0x7f989812c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:44.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 --2- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 0x7f989812c170 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9884010000 tx=0x7f9884009060).stop 2024-04-25T02:20:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 shutdown_connections 2024-04-25T02:20:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 --2- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f989812d120 0x7f98981260b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 --2- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f989805e960 0x7f989812bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 --2- 172.21.15.78:0/1558643520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9898099330 0x7f989812c170 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 >> 172.21.15.78:0/1558643520 conn(0x7f98980974d0 msgr2=0x7f9898092b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 shutdown_connections 2024-04-25T02:20:44.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:44.949+0000 7f989ec2c700 1 -- 172.21.15.78:0/1558643520 wait complete. 2024-04-25T02:20:44.955 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-04-25T02:20:44.964 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:45.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f909a16a700 1 Processor -- start 2024-04-25T02:20:45.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f909a16a700 1 -- start start 2024-04-25T02:20:45.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f909a16a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9094127eb0 0x7f90941271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f909a16a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f9094131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f909a16a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9094096490 con 0x7f9094062860 2024-04-25T02:20:45.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f909a16a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9094062c40 con 0x7f9094127eb0 2024-04-25T02:20:45.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f909a16a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9094091b90 con 0x7f909412fb30 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f9093fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f9094131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f9092ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9094127eb0 0x7f90941271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f90937fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9094062860 0x7f90941277a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39478/0 (socket says 172.21.15.78:39478) 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f9093fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f9094131f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51538/0 (socket says 172.21.15.78:51538) 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f90937fe700 1 -- 172.21.15.78:0/3316293676 learned_addr learned my addr 172.21.15.78:0/3316293676 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.074+0000 7f9092ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9094127eb0 0x7f90941271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49388/0 (socket says 172.21.15.78:49388) 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f9092ffd700 1 -- 172.21.15.78:0/3316293676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 msgr2=0x7f9094131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f9092ffd700 1 --2- 172.21.15.78:0/3316293676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f9094131f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f9092ffd700 1 -- 172.21.15.78:0/3316293676 >> v1:172.21.15.78:6789/0 conn(0x7f9094062860 legacy=0x7f90941277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f9092ffd700 1 -- 172.21.15.78:0/3316293676 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094091e50 con 0x7f9094127eb0 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f90927fc700 1 -- 172.21.15.78:0/3316293676 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990127207 0 0) 0x7f9094096490 con 0x7f9094062860 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f9093fff700 1 --2- 172.21.15.78:0/3316293676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f9094131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:45.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f9092ffd700 1 --2- 172.21.15.78:0/3316293676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094127eb0 0x7f90941271f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f9088009760 tx=0x7f9088009060).ready entity=mon.0 client_cookie=4e4eff910fa0fa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f90927fc700 1 -- 172.21.15.78:0/3316293676 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800f510 con 0x7f9094127eb0 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f90927fc700 1 -- 172.21.15.78:0/3316293676 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f908800f670 con 0x7f9094127eb0 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f90927fc700 1 -- 172.21.15.78:0/3316293676 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800fa10 con 0x7f9094127eb0 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f909a16a700 1 -- 172.21.15.78:0/3316293676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094127eb0 msgr2=0x7f90941271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f909a16a700 1 --2- 172.21.15.78:0/3316293676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094127eb0 0x7f90941271f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f9088009760 tx=0x7f9088009060).stop 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f909a16a700 1 -- 172.21.15.78:0/3316293676 shutdown_connections 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f909a16a700 1 --2- 172.21.15.78:0/3316293676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f9094131f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f909a16a700 1 --2- 172.21.15.78:0/3316293676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094127eb0 0x7f90941271f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.075+0000 7f909a16a700 1 -- 172.21.15.78:0/3316293676 >> 172.21.15.78:0/3316293676 conn(0x7f9094097450 msgr2=0x7f9094097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.076+0000 7f909a16a700 1 -- 172.21.15.78:0/3316293676 shutdown_connections 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.076+0000 7f909a16a700 1 -- 172.21.15.78:0/3316293676 wait complete. 2024-04-25T02:20:45.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.076+0000 7f909a16a700 1 Processor -- start 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f909a16a700 1 -- start start 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f909a16a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094062860 0x7f90941110b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f909a16a700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9094127eb0 0x7f909412bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f909a16a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f909412c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f909a16a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909412eec0 con 0x7f9094062860 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f909a16a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90941320f0 con 0x7f909412fb30 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f909a16a700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9094096d20 con 0x7f9094127eb0 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f90937fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094062860 0x7f90941110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f90937fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094062860 0x7f90941110b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49398/0 (socket says 172.21.15.78:49398) 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f90937fe700 1 -- 172.21.15.78:0/2128753100 learned_addr learned my addr 172.21.15.78:0/2128753100 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:45.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f9092ffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9094127eb0 0x7f909412bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f9093fff700 1 --2- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f909412c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f90937fe700 1 -- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9094127eb0 msgr2=0x7f909412bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f90937fe700 1 --2- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9094127eb0 0x7f909412bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f90937fe700 1 -- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 msgr2=0x7f909412c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f90937fe700 1 --2- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f909412c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f90937fe700 1 -- 172.21.15.78:0/2128753100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c009a20 con 0x7f9094062860 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.077+0000 7f9092ffd700 1 --2- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9094127eb0 0x7f909412bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.078+0000 7f90937fe700 1 --2- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094062860 0x7f90941110b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f908400c490 tx=0x7f9084007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.078+0000 7f907bfff700 1 -- 172.21.15.78:0/2128753100 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908400ce40 con 0x7f9094062860 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.078+0000 7f907bfff700 1 -- 172.21.15.78:0/2128753100 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f90840072e0 con 0x7f9094062860 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.078+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90880092a0 con 0x7f9094062860 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.078+0000 7f907bfff700 1 -- 172.21.15.78:0/2128753100 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90840057a0 con 0x7f9094062860 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.078+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909412d990 con 0x7f9094062860 2024-04-25T02:20:45.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.078+0000 7f907bfff700 1 -- 172.21.15.78:0/2128753100 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f9084005bd0 con 0x7f9094062860 2024-04-25T02:20:45.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.079+0000 7f907bfff700 1 -- 172.21.15.78:0/2128753100 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7f908403aa60 con 0x7f9094062860 2024-04-25T02:20:45.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.079+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9094097f70 con 0x7f9094062860 2024-04-25T02:20:45.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.083+0000 7f907bfff700 1 -- 172.21.15.78:0/2128753100 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f908401b750 con 0x7f9094062860 2024-04-25T02:20:45.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.241+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f909412cb70 con 0x7f9094062860 2024-04-25T02:20:45.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.242+0000 7f907bfff700 1 -- 172.21.15.78:0/2128753100 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11609 (secure 0 0 0) 0x7f9084011350 con 0x7f9094062860 2024-04-25T02:20:45.246 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-04-25T02:20:45.247 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"c7765ec7-39fd-490f-9c17-2b734a0c4de0","created":"2024-04-25T02:09:47.235180+0000","modified":"2024-04-25T02:10:53.832053+0000","last_up_change":"2024-04-25T02:09:56.203305+0000","last_in_change":"2024-04-25T02:09:49.314637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:09:56.245660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:09:57.192525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:10:00.989685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:10:01.680090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fc6c0a8-450e-4322-a503-465f74e096d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6804","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6805","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6807","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6806","nonce":47107}]},"public_addr":"172.21.15.78:6804/47107","cluster_addr":"172.21.15.78:6805/47107","heartbeat_back_addr":"172.21.15.78:6807/47107","heartbeat_front_addr":"172.21.15.78:6806/47107","state":["exists","up"]},{"osd":1,"uuid":"dc7402bc-ceb2-4d7b-82f9-a9e4295eebbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6800","nonce":47106}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6801","nonce":47106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6803","nonce":47106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6802","nonce":47106}]},"public_addr":"172.21.15.78:6800/47106","cluster_addr":"172.21.15.78:6801/47106","heartbeat_back_addr":"172.21.15.78:6803/47106","heartbeat_front_addr":"172.21.15.78:6802/47106","state":["exists","up"]},{"osd":2,"uuid":"459db897-8690-47e4-ad90-743b2b35f006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6808","nonce":47116}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6810","nonce":47116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6814","nonce":47116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6812","nonce":47116}]},"public_addr":"172.21.15.78:6808/47116","cluster_addr":"172.21.15.78:6810/47116","heartbeat_back_addr":"172.21.15.78:6814/47116","heartbeat_front_addr":"172.21.15.78:6812/47116","state":["exists","up"]},{"osd":3,"uuid":"b0d12360-a3a8-4fde-bf7a-e5a2514abe27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6809","nonce":47117}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6811","nonce":47117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6815","nonce":47117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.78:6813","nonce":47117}]},"public_addr":"172.21.15.78:6809/47117","cluster_addr":"172.21.15.78:6811/47117","heartbeat_back_addr":"172.21.15.78:6815/47117","heartbeat_front_addr":"172.21.15.78:6813/47117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.419442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.428509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.494304+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:09:54.517988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0},{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:20:45.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 >> v1:172.21.15.78:6816/46507 conn(0x7f908002bd00 legacy=0x7f908002e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094062860 msgr2=0x7f90941110b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 --2- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094062860 0x7f90941110b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f908400c490 tx=0x7f9084007e40).stop 2024-04-25T02:20:45.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 shutdown_connections 2024-04-25T02:20:45.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 --2- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f909412fb30 0x7f909412c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 --2- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9094062860 0x7f90941110b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 --2- 172.21.15.78:0/2128753100 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f9094127eb0 0x7f909412bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 >> 172.21.15.78:0/2128753100 conn(0x7f9094097450 msgr2=0x7f9094092d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:45.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 shutdown_connections 2024-04-25T02:20:45.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.244+0000 7f909a16a700 1 -- 172.21.15.78:0/2128753100 wait complete. 2024-04-25T02:20:45.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:20:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.371+0000 7fc5b20fc700 1 Processor -- start 2024-04-25T02:20:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.371+0000 7fc5b20fc700 1 -- start start 2024-04-25T02:20:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5b20fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5ac0972f0 0x7fc5ac1279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5b20fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac12a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5b20fc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac097c30 con 0x7fc5ac12acc0 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5b20fc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac0976d0 con 0x7fc5ac0972f0 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5b20fc700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac065420 con 0x7fc5ac127ee0 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aaffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac12a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aaffd700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac12a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37610/0 (socket says 172.21.15.78:37610) 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5ab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5ac0972f0 0x7fc5ac1279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5abfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc5ac12acc0 0x7fc5ac131b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39486/0 (socket says 172.21.15.78:39486) 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aaffd700 1 -- 172.21.15.78:0/3684216709 learned_addr learned my addr 172.21.15.78:0/3684216709 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aaffd700 1 -- 172.21.15.78:0/3684216709 >> v2:172.21.15.78:3300/0 conn(0x7fc5ac0972f0 msgr2=0x7fc5ac1279f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aaffd700 1 --2- 172.21.15.78:0/3684216709 >> v2:172.21.15.78:3300/0 conn(0x7fc5ac0972f0 0x7fc5ac1279f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aaffd700 1 -- 172.21.15.78:0/3684216709 >> v1:172.21.15.78:6789/0 conn(0x7fc5ac12acc0 legacy=0x7fc5ac131b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aaffd700 1 -- 172.21.15.78:0/3684216709 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac064e60 con 0x7fc5ac127ee0 2024-04-25T02:20:45.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5ab7fe700 1 --2- 172.21.15.78:0/3684216709 >> v2:172.21.15.78:3300/0 conn(0x7fc5ac0972f0 0x7fc5ac1279f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aaffd700 1 --2- 172.21.15.78:0/3684216709 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac12a7d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc59c006fd0 tx=0x7fc59c0090f0).ready entity=mon.2 client_cookie=e03c44f3a8b84108 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aa7fc700 1 -- 172.21.15.78:0/3684216709 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00b580 con 0x7fc5ac127ee0 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aa7fc700 1 -- 172.21.15.78:0/3684216709 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc59c00b6e0 con 0x7fc5ac127ee0 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.372+0000 7fc5aa7fc700 1 -- 172.21.15.78:0/3684216709 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00ba80 con 0x7fc5ac127ee0 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.373+0000 7fc5b20fc700 1 -- 172.21.15.78:0/3684216709 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 msgr2=0x7fc5ac12a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.373+0000 7fc5b20fc700 1 --2- 172.21.15.78:0/3684216709 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac12a7d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc59c006fd0 tx=0x7fc59c0090f0).stop 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.373+0000 7fc5b20fc700 1 -- 172.21.15.78:0/3684216709 shutdown_connections 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.373+0000 7fc5b20fc700 1 --2- 172.21.15.78:0/3684216709 >> v2:172.21.15.78:3300/0 conn(0x7fc5ac0972f0 0x7fc5ac1279f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.373+0000 7fc5b20fc700 1 --2- 172.21.15.78:0/3684216709 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac12a7d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.373+0000 7fc5b20fc700 1 -- 172.21.15.78:0/3684216709 >> 172.21.15.78:0/3684216709 conn(0x7fc5ac09c550 msgr2=0x7fc5ac0983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.373+0000 7fc5b20fc700 1 -- 172.21.15.78:0/3684216709 shutdown_connections 2024-04-25T02:20:45.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.373+0000 7fc5b20fc700 1 -- 172.21.15.78:0/3684216709 wait complete. 2024-04-25T02:20:45.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.374+0000 7fc5b20fc700 1 Processor -- start 2024-04-25T02:20:45.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.374+0000 7fc5b20fc700 1 -- start start 2024-04-25T02:20:45.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5b20fc700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac1179e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5b20fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5ac12acc0 0x7fc5ac113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5b20fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5ac113f30 0x7fc5ac1143b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5b20fc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac124b10 con 0x7fc5ac12acc0 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5b20fc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac064a40 con 0x7fc5ac113f30 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5b20fc700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac116f40 con 0x7fc5ac127ee0 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5ab7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac1179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5ab7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac1179e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37624/0 (socket says 172.21.15.78:37624) 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5ab7fe700 1 -- 172.21.15.78:0/228041589 learned_addr learned my addr 172.21.15.78:0/228041589 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5aaffd700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5ac12acc0 0x7fc5ac113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5abfff700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5ac113f30 0x7fc5ac1143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5ab7fe700 1 -- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5ac113f30 msgr2=0x7fc5ac1143b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5ab7fe700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5ac113f30 0x7fc5ac1143b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5ab7fe700 1 -- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5ac12acc0 msgr2=0x7fc5ac113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5ab7fe700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5ac12acc0 0x7fc5ac113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5ab7fe700 1 -- 172.21.15.78:0/228041589 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00092a0 con 0x7fc5ac127ee0 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5aaffd700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5ac12acc0 0x7fc5ac113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:45.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.375+0000 7fc5ab7fe700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac1179e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fc5a000e9b0 tx=0x7fc5a0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:45.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.376+0000 7fc593fff700 1 -- 172.21.15.78:0/228041589 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000c670 con 0x7fc5ac127ee0 2024-04-25T02:20:45.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.376+0000 7fc593fff700 1 -- 172.21.15.78:0/228041589 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5a000c7d0 con 0x7fc5ac127ee0 2024-04-25T02:20:45.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.376+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c009370 con 0x7fc5ac127ee0 2024-04-25T02:20:45.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.376+0000 7fc593fff700 1 -- 172.21.15.78:0/228041589 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000cb50 con 0x7fc5ac127ee0 2024-04-25T02:20:45.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.376+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac115e30 con 0x7fc5ac127ee0 2024-04-25T02:20:45.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.376+0000 7fc593fff700 1 -- 172.21.15.78:0/228041589 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fc5a001b400 con 0x7fc5ac127ee0 2024-04-25T02:20:45.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.376+0000 7fc593fff700 1 -- 172.21.15.78:0/228041589 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3872+0+0 (secure 0 0 0) 0x7fc5a003b7c0 con 0x7fc5ac127ee0 2024-04-25T02:20:45.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.377+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac09b070 con 0x7fc5ac127ee0 2024-04-25T02:20:45.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.381+0000 7fc593fff700 1 -- 172.21.15.78:0/228041589 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fc5a0016020 con 0x7fc5ac127ee0 2024-04-25T02:20:45.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:45.576+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc5ac114f00 con 0x7fc5ac127ee0 2024-04-25T02:20:46.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.286+0000 7fc593fff700 1 -- 172.21.15.78:0/228041589 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc5a002a090 con 0x7fc5ac127ee0 2024-04-25T02:20:46.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.294+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 >> v1:172.21.15.78:6816/46507 conn(0x7fc59802bd30 legacy=0x7fc59802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.294+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 msgr2=0x7fc5ac1179e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.294+0000 7fc5b20fc700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac1179e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fc5a000e9b0 tx=0x7fc5a0009060).stop 2024-04-25T02:20:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.294+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 shutdown_connections 2024-04-25T02:20:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.294+0000 7fc5b20fc700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5ac113f30 0x7fc5ac1143b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.294+0000 7fc5b20fc700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fc5ac127ee0 0x7fc5ac1179e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.294+0000 7fc5b20fc700 1 --2- 172.21.15.78:0/228041589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5ac12acc0 0x7fc5ac113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.294+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 >> 172.21.15.78:0/228041589 conn(0x7fc5ac0972f0 msgr2=0x7fc5ac1264c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.297+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 shutdown_connections 2024-04-25T02:20:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.297+0000 7fc5b20fc700 1 -- 172.21.15.78:0/228041589 wait complete. 2024-04-25T02:20:46.301 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:20:46.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:20:46.336 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-04-25T02:20:46.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.436+0000 7f27b676b700 1 Processor -- start 2024-04-25T02:20:46.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.436+0000 7f27b676b700 1 -- start start 2024-04-25T02:20:46.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27b676b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0065d60 0x7f27b00972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27b676b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27b0127fb0 0x7f27b012afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27b676b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b00652a0 con 0x7f27b0127b70 2024-04-25T02:20:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27b676b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b0066140 con 0x7f27b0127fb0 2024-04-25T02:20:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27b676b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00649e0 con 0x7f27b0065d60 2024-04-25T02:20:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27affff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0065d60 0x7f27b00972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27b4d08700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27b0127fb0 0x7f27b012afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27affff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0065d60 0x7f27b00972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51572/0 (socket says 172.21.15.78:51572) 2024-04-25T02:20:46.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27affff700 1 -- 172.21.15.78:0/3587499294 learned_addr learned my addr 172.21.15.78:0/3587499294 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27affff700 1 -- 172.21.15.78:0/3587499294 >> v2:172.21.15.78:3300/0 conn(0x7f27b0127fb0 msgr2=0x7f27b012afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27affff700 1 --2- 172.21.15.78:0/3587499294 >> v2:172.21.15.78:3300/0 conn(0x7f27b0127fb0 0x7f27b012afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27affff700 1 -- 172.21.15.78:0/3587499294 >> v1:172.21.15.78:6789/0 conn(0x7f27b0127b70 legacy=0x7f27b012a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27affff700 1 -- 172.21.15.78:0/3587499294 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b0097fb0 con 0x7f27b0065d60 2024-04-25T02:20:46.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27b4d08700 1 --2- 172.21.15.78:0/3587499294 >> v2:172.21.15.78:3300/0 conn(0x7f27b0127fb0 0x7f27b012afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27affff700 1 --2- 172.21.15.78:0/3587499294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0065d60 0x7f27b00972f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f27a4006fd0 tx=0x7f27a40090f0).ready entity=mon.1 client_cookie=e6b08e99080541fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27aeffd700 1 -- 172.21.15.78:0/3587499294 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a400b580 con 0x7f27b0065d60 2024-04-25T02:20:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27aeffd700 1 -- 172.21.15.78:0/3587499294 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f27a400b6e0 con 0x7f27b0065d60 2024-04-25T02:20:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.437+0000 7f27aeffd700 1 -- 172.21.15.78:0/3587499294 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a400ba80 con 0x7f27b0065d60 2024-04-25T02:20:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.438+0000 7f27b676b700 1 -- 172.21.15.78:0/3587499294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0065d60 msgr2=0x7f27b00972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.438+0000 7f27b676b700 1 --2- 172.21.15.78:0/3587499294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0065d60 0x7f27b00972f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f27a4006fd0 tx=0x7f27a40090f0).stop 2024-04-25T02:20:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.438+0000 7f27b676b700 1 -- 172.21.15.78:0/3587499294 shutdown_connections 2024-04-25T02:20:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.438+0000 7f27b676b700 1 --2- 172.21.15.78:0/3587499294 >> v2:172.21.15.78:3300/0 conn(0x7f27b0127fb0 0x7f27b012afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.438+0000 7f27b676b700 1 --2- 172.21.15.78:0/3587499294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0065d60 0x7f27b00972f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.438+0000 7f27b676b700 1 -- 172.21.15.78:0/3587499294 >> 172.21.15.78:0/3587499294 conn(0x7f27b009ba80 msgr2=0x7f27b009be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.438+0000 7f27b676b700 1 -- 172.21.15.78:0/3587499294 shutdown_connections 2024-04-25T02:20:46.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.438+0000 7f27b676b700 1 -- 172.21.15.78:0/3587499294 wait complete. 2024-04-25T02:20:46.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27b676b700 1 Processor -- start 2024-04-25T02:20:46.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27b676b700 1 -- start start 2024-04-25T02:20:46.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27b676b700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f27b0065d60 0x7f27b0125530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27b676b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27b0127b70 0x7f27b0114500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27b676b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0127fb0 0x7f27b01149f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27b676b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0117a00 con 0x7f27b0127b70 2024-04-25T02:20:46.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27b676b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b01185d0 con 0x7f27b0127fb0 2024-04-25T02:20:46.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27b676b700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27b009b030 con 0x7f27b0065d60 2024-04-25T02:20:46.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27affff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f27b0065d60 0x7f27b0125530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27b4d08700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0127fb0 0x7f27b01149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27affff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f27b0065d60 0x7f27b0125530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37638/0 (socket says 172.21.15.78:37638) 2024-04-25T02:20:46.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27affff700 1 -- 172.21.15.78:0/1825490741 learned_addr learned my addr 172.21.15.78:0/1825490741 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:46.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.439+0000 7f27af7fe700 1 --2- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27b0127b70 0x7f27b0114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27affff700 1 -- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0127fb0 msgr2=0x7f27b01149f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27affff700 1 --2- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0127fb0 0x7f27b01149f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27affff700 1 -- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27b0127b70 msgr2=0x7f27b0114500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27affff700 1 --2- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27b0127b70 0x7f27b0114500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27affff700 1 -- 172.21.15.78:0/1825490741 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8009a20 con 0x7f27b0065d60 2024-04-25T02:20:46.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27b4d08700 1 --2- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0127fb0 0x7f27b01149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:46.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27affff700 1 --2- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f27b0065d60 0x7f27b0125530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f27b0064b20 tx=0x7f27a40090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27acff9700 1 -- 172.21.15.78:0/1825490741 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a400be40 con 0x7f27b0065d60 2024-04-25T02:20:46.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27acff9700 1 -- 172.21.15.78:0/1825490741 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f27a400b850 con 0x7f27b0065d60 2024-04-25T02:20:46.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27acff9700 1 -- 172.21.15.78:0/1825490741 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a401c420 con 0x7f27b0065d60 2024-04-25T02:20:46.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a4009370 con 0x7f27b0065d60 2024-04-25T02:20:46.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.440+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b0115900 con 0x7f27b0065d60 2024-04-25T02:20:46.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.441+0000 7f27acff9700 1 -- 172.21.15.78:0/1825490741 <== mon.2 v2:172.21.15.78:3302/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f27a401c7d0 con 0x7f27b0065d60 2024-04-25T02:20:46.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.441+0000 7f27acff9700 1 -- 172.21.15.78:0/1825490741 <== mon.2 v2:172.21.15.78:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3915+0+0 (secure 0 0 0) 0x7f27a403ce20 con 0x7f27b0065d60 2024-04-25T02:20:46.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.441+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b0063870 con 0x7f27b0065d60 2024-04-25T02:20:46.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.446+0000 7f27acff9700 1 -- 172.21.15.78:0/1825490741 <== mon.2 v2:172.21.15.78:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f27a401a3d0 con 0x7f27b0065d60 2024-04-25T02:20:46.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:46.643+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f27b0115300 con 0x7f27b0065d60 2024-04-25T02:20:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.297+0000 7f27acff9700 1 -- 172.21.15.78:0/1825490741 <== mon.2 v2:172.21.15.78:3302/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f27a4018b40 con 0x7f27b0065d60 2024-04-25T02:20:47.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.300+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 >> v1:172.21.15.78:6816/46507 conn(0x7f279c02bd00 legacy=0x7f279c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.300+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f27b0065d60 msgr2=0x7f27b0125530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.300+0000 7f27b676b700 1 --2- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f27b0065d60 0x7f27b0125530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f27b0064b20 tx=0x7f27a40090f0).stop 2024-04-25T02:20:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.300+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 shutdown_connections 2024-04-25T02:20:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.300+0000 7f27b676b700 1 --2- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27b0127fb0 0x7f27b01149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.301+0000 7f27b676b700 1 --2- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f27b0065d60 0x7f27b0125530 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.301+0000 7f27b676b700 1 --2- 172.21.15.78:0/1825490741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27b0127b70 0x7f27b0114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.301+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 >> 172.21.15.78:0/1825490741 conn(0x7f27b009ba80 msgr2=0x7f27b00996f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.301+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 shutdown_connections 2024-04-25T02:20:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.301+0000 7f27b676b700 1 -- 172.21.15.78:0/1825490741 wait complete. 2024-04-25T02:20:47.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:20:47.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe046595700 1 Processor -- start 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe046595700 1 -- start start 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe046595700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040062860 0x7fe04012af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe046595700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe04012ab00 0x7fe04012b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe046595700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe040095190 0x7fe040095640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe046595700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe040062c40 con 0x7fe040095190 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe046595700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0400922e0 con 0x7fe04012ab00 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe046595700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe040091a10 con 0x7fe040062860 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe044b32700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe040095190 0x7fe040095640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe04012ab00 0x7fe04012b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03ffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040062860 0x7fe04012af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03ffff700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040062860 0x7fe04012af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3302/0 says I am v2:172.21.15.78:37654/0 (socket says 172.21.15.78:37654) 2024-04-25T02:20:47.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe044b32700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe040095190 0x7fe040095640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49476/0 (socket says 172.21.15.78:49476) 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe04012ab00 0x7fe04012b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:51584/0 (socket says 172.21.15.78:51584) 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03ffff700 1 -- 172.21.15.78:0/1886258641 learned_addr learned my addr 172.21.15.78:0/1886258641 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03ffff700 1 -- 172.21.15.78:0/1886258641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe04012ab00 msgr2=0x7fe04012b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03ffff700 1 --2- 172.21.15.78:0/1886258641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe04012ab00 0x7fe04012b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03ffff700 1 -- 172.21.15.78:0/1886258641 >> v2:172.21.15.78:3300/0 conn(0x7fe040095190 msgr2=0x7fe040095640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03ffff700 1 --2- 172.21.15.78:0/1886258641 >> v2:172.21.15.78:3300/0 conn(0x7fe040095190 0x7fe040095640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03ffff700 1 -- 172.21.15.78:0/1886258641 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04012b970 con 0x7fe040062860 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03f7fe700 1 --2- 172.21.15.78:0/1886258641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe04012ab00 0x7fe04012b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe044b32700 1 --2- 172.21.15.78:0/1886258641 >> v2:172.21.15.78:3300/0 conn(0x7fe040095190 0x7fe040095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.481+0000 7fe03ffff700 1 --2- 172.21.15.78:0/1886258641 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040062860 0x7fe04012af90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fe030009830 tx=0x7fe0300090f0).ready entity=mon.2 client_cookie=84c26fe25f77510c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe03effd700 1 -- 172.21.15.78:0/1886258641 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03000f510 con 0x7fe040062860 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe03effd700 1 -- 172.21.15.78:0/1886258641 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe03000f670 con 0x7fe040062860 2024-04-25T02:20:47.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe03effd700 1 -- 172.21.15.78:0/1886258641 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03000fa10 con 0x7fe040062860 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe046595700 1 -- 172.21.15.78:0/1886258641 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040062860 msgr2=0x7fe04012af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe046595700 1 --2- 172.21.15.78:0/1886258641 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040062860 0x7fe04012af90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fe030009830 tx=0x7fe0300090f0).stop 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe046595700 1 -- 172.21.15.78:0/1886258641 shutdown_connections 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe046595700 1 --2- 172.21.15.78:0/1886258641 >> v2:172.21.15.78:3300/0 conn(0x7fe040095190 0x7fe040095640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe046595700 1 --2- 172.21.15.78:0/1886258641 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040062860 0x7fe04012af90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe046595700 1 --2- 172.21.15.78:0/1886258641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe04012ab00 0x7fe04012b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe046595700 1 -- 172.21.15.78:0/1886258641 >> 172.21.15.78:0/1886258641 conn(0x7fe04009a970 msgr2=0x7fe04009ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe046595700 1 -- 172.21.15.78:0/1886258641 shutdown_connections 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.482+0000 7fe046595700 1 -- 172.21.15.78:0/1886258641 wait complete. 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.483+0000 7fe046595700 1 Processor -- start 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.483+0000 7fe046595700 1 -- start start 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe046595700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe040062860 0x7fe040115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe046595700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040095190 0x7fe040115770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe046595700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe040115c60 0x7fe040140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe046595700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe040096c60 con 0x7fe040062860 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe046595700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe040117820 con 0x7fe040115c60 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe046595700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe040117dc0 con 0x7fe040095190 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe040062860 0x7fe040115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03f7fe700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040095190 0x7fe040115770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe040062860 0x7fe040115280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49484/0 (socket says 172.21.15.78:49484) 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03ffff700 1 -- 172.21.15.78:0/3478745893 learned_addr learned my addr 172.21.15.78:0/3478745893 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe044b32700 1 --2- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe040115c60 0x7fe040140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03ffff700 1 -- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040095190 msgr2=0x7fe040115770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03ffff700 1 --2- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040095190 0x7fe040115770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03ffff700 1 -- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe040115c60 msgr2=0x7fe040140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03ffff700 1 --2- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe040115c60 0x7fe040140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03ffff700 1 -- 172.21.15.78:0/3478745893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe038009a20 con 0x7fe040062860 2024-04-25T02:20:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03ffff700 1 --2- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe040062860 0x7fe040115280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fe040091ba0 tx=0x7fe0300090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03cff9700 1 -- 172.21.15.78:0/3478745893 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03000fe50 con 0x7fe040062860 2024-04-25T02:20:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03cff9700 1 -- 172.21.15.78:0/3478745893 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe03000f7e0 con 0x7fe040062860 2024-04-25T02:20:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0340092a0 con 0x7fe040062860 2024-04-25T02:20:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe03cff9700 1 -- 172.21.15.78:0/3478745893 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03001c420 con 0x7fe040062860 2024-04-25T02:20:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.484+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe030009370 con 0x7fe040062860 2024-04-25T02:20:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.485+0000 7fe03cff9700 1 -- 172.21.15.78:0/3478745893 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7fe03001c850 con 0x7fe040062860 2024-04-25T02:20:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.485+0000 7fe03cff9700 1 -- 172.21.15.78:0/3478745893 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3915+0+0 (secure 0 0 0) 0x7fe03003ce70 con 0x7fe040062860 2024-04-25T02:20:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.485+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe040125c00 con 0x7fe040062860 2024-04-25T02:20:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.491+0000 7fe03cff9700 1 -- 172.21.15.78:0/3478745893 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7fe030020080 con 0x7fe040062860 2024-04-25T02:20:47.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:47.653+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe040125a00 con 0x7fe040062860 2024-04-25T02:20:48.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.299+0000 7fe03cff9700 1 -- 172.21.15.78:0/3478745893 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v21) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe03002a030 con 0x7fe040062860 2024-04-25T02:20:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.307+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 >> v1:172.21.15.78:6816/46507 conn(0x7fe02c02bd00 legacy=0x7fe02c02e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.307+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe040062860 msgr2=0x7fe040115280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.307+0000 7fe046595700 1 --2- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe040062860 0x7fe040115280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fe040091ba0 tx=0x7fe0300090f0).stop 2024-04-25T02:20:48.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.307+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 shutdown_connections 2024-04-25T02:20:48.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.308+0000 7fe046595700 1 --2- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe040115c60 0x7fe040140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.308+0000 7fe046595700 1 --2- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe040062860 0x7fe040115280 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.308+0000 7fe046595700 1 --2- 172.21.15.78:0/3478745893 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7fe040095190 0x7fe040115770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.308+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 >> 172.21.15.78:0/3478745893 conn(0x7fe04009a970 msgr2=0x7fe0401275e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:48.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.311+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 shutdown_connections 2024-04-25T02:20:48.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.311+0000 7fe046595700 1 -- 172.21.15.78:0/3478745893 wait complete. 2024-04-25T02:20:48.331 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:20:48.347 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:20:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503cace700 1 Processor -- start 2024-04-25T02:20:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503cace700 1 -- start start 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503cace700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038097750 0x7f5038095b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503cace700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038096710 0x7f5038132390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503cace700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50380931b0 con 0x7f5038090d40 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503cace700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5038097b30 con 0x7f5038096710 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503cace700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5038092640 con 0x7f5038097750 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503659c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038097750 0x7f5038095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f5035d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5038090d40 0x7f5038096000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39528/0 (socket says 172.21.15.78:39528) 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f5036d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038096710 0x7f5038132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f5035d9b700 1 -- 172.21.15.78:0/586983369 learned_addr learned my addr 172.21.15.78:0/586983369 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503559a700 1 -- 172.21.15.78:0/586983369 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416722083 0 0) 0x7f50380931b0 con 0x7f5038090d40 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503659c700 1 -- 172.21.15.78:0/586983369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038096710 msgr2=0x7f5038132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503659c700 1 --2- 172.21.15.78:0/586983369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038096710 0x7f5038132390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503659c700 1 -- 172.21.15.78:0/586983369 >> v1:172.21.15.78:6789/0 conn(0x7f5038090d40 legacy=0x7f5038096000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f503659c700 1 -- 172.21.15.78:0/586983369 --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503805ed80 con 0x7f5038097750 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.470+0000 7f5036d9d700 1 --2- 172.21.15.78:0/586983369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038096710 0x7f5038132390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503659c700 1 --2- 172.21.15.78:0/586983369 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038097750 0x7f5038095b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5028009790 tx=0x7f5028009060).ready entity=mon.2 client_cookie=8ecc243bbdb0a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503559a700 1 -- 172.21.15.78:0/586983369 <== mon.2 v2:172.21.15.78:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800f510 con 0x7f5038097750 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503559a700 1 -- 172.21.15.78:0/586983369 <== mon.2 v2:172.21.15.78:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f502800f670 con 0x7f5038097750 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503559a700 1 -- 172.21.15.78:0/586983369 <== mon.2 v2:172.21.15.78:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800fa10 con 0x7f5038097750 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503cace700 1 -- 172.21.15.78:0/586983369 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038097750 msgr2=0x7f5038095b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503cace700 1 --2- 172.21.15.78:0/586983369 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038097750 0x7f5038095b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5028009790 tx=0x7f5028009060).stop 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503cace700 1 -- 172.21.15.78:0/586983369 shutdown_connections 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503cace700 1 --2- 172.21.15.78:0/586983369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038096710 0x7f5038132390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503cace700 1 --2- 172.21.15.78:0/586983369 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038097750 0x7f5038095b10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503cace700 1 -- 172.21.15.78:0/586983369 >> 172.21.15.78:0/586983369 conn(0x7f503809abf0 msgr2=0x7f5038096c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503cace700 1 -- 172.21.15.78:0/586983369 shutdown_connections 2024-04-25T02:20:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.471+0000 7f503cace700 1 -- 172.21.15.78:0/586983369 wait complete. 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.472+0000 7f503cace700 1 Processor -- start 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.472+0000 7f503cace700 1 -- start start 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f503cace700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038096710 0x7f5038088320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f503cace700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5038097750 0x7f5038088810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f503cace700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038088d00 0x7f5038140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f503cace700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5038089790 con 0x7f5038097750 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f503cace700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503808b7d0 con 0x7f5038088d00 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f503cace700 1 -- --> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5038089160 con 0x7f5038096710 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5035d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5038097750 0x7f5038088810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5036d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038088d00 0x7f5038140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f503659c700 1 --2- >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038096710 0x7f5038088320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5035d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5038097750 0x7f5038088810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49490/0 (socket says 172.21.15.78:49490) 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5035d9b700 1 -- 172.21.15.78:0/2459213320 learned_addr learned my addr 172.21.15.78:0/2459213320 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5036d9d700 1 -- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038096710 msgr2=0x7f5038088320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5036d9d700 1 --2- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038096710 0x7f5038088320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5036d9d700 1 -- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5038097750 msgr2=0x7f5038088810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5036d9d700 1 --2- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5038097750 0x7f5038088810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5036d9d700 1 -- 172.21.15.78:0/2459213320 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5030009a20 con 0x7f5038088d00 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5036d9d700 1 --2- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038088d00 0x7f5038140a50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5030009f10 tx=0x7f503000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5026ffd700 1 -- 172.21.15.78:0/2459213320 <== mon.1 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503000cb70 con 0x7f5038088d00 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5026ffd700 1 -- 172.21.15.78:0/2459213320 <== mon.1 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f503000f040 con 0x7f5038088d00 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50280092a0 con 0x7f5038088d00 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f5026ffd700 1 -- 172.21.15.78:0/2459213320 <== mon.1 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503000cee0 con 0x7f5038088d00 2024-04-25T02:20:48.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.473+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503808b480 con 0x7f5038088d00 2024-04-25T02:20:48.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.474+0000 7f5026ffd700 1 -- 172.21.15.78:0/2459213320 <== mon.1 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 31635+0+0 (secure 0 0 0) 0x7f5030013610 con 0x7f5038088d00 2024-04-25T02:20:48.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.474+0000 7f5026ffd700 1 -- 172.21.15.78:0/2459213320 <== mon.1 v2:172.21.15.78:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3477+0+0 (secure 0 0 0) 0x7f503003bb10 con 0x7f5038088d00 2024-04-25T02:20:48.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.474+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503808bcb0 con 0x7f5038088d00 2024-04-25T02:20:48.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.480+0000 7f5026ffd700 1 -- 172.21.15.78:0/2459213320 <== mon.1 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+157521 (secure 0 0 0) 0x7f503001d460 con 0x7f5038088d00 2024-04-25T02:20:48.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:48.638+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f503806c550 con 0x7f5038088d00 2024-04-25T02:20:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.337+0000 7f5026ffd700 1 -- 172.21.15.78:0/2459213320 <== mon.1 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v22) v1 ==== 169+0+0 (secure 0 0 0) 0x7f503002b0d0 con 0x7f5038088d00 2024-04-25T02:20:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.360+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 >> v1:172.21.15.78:6816/46507 conn(0x7f501802bd30 legacy=0x7f501802e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.360+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038088d00 msgr2=0x7f5038140a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.360+0000 7f503cace700 1 --2- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038088d00 0x7f5038140a50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5030009f10 tx=0x7f503000b040).stop 2024-04-25T02:20:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.360+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 shutdown_connections 2024-04-25T02:20:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.360+0000 7f503cace700 1 --2- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5038088d00 0x7f5038140a50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.360+0000 7f503cace700 1 --2- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3302/0,v1:172.21.15.78:6791/0] conn(0x7f5038096710 0x7f5038088320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.360+0000 7f503cace700 1 --2- 172.21.15.78:0/2459213320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5038097750 0x7f5038088810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.360+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 >> 172.21.15.78:0/2459213320 conn(0x7f503809abf0 msgr2=0x7f50381315b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.364+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 shutdown_connections 2024-04-25T02:20:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-04-25T02:20:49.365+0000 7f503cace700 1 -- 172.21.15.78:0/2459213320 wait complete. 2024-04-25T02:20:49.384 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-04-25T02:20:49.403 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T02:20:49.403 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:20:49.404 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:20:49.415 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:20:49.416 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T02:20:49.416 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T02:20:49.416 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:20:49.482 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T02:20:49.482 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T02:20:49.483 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:20:49.550 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T02:20:49.550 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T02:20:49.550 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:20:49.616 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T02:20:49.616 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T02:20:49.616 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:20:49.685 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T02:20:49.685 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T02:20:49.685 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T02:20:49.685 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:20:49.746 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T02:20:49.746 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T02:20:49.747 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T02:20:49.747 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:20:49.796 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T02:20:49.797 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T02:20:49.797 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:20:49.846 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T02:20:49.846 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T02:20:49.846 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:20:49.896 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T02:20:49.896 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T02:20:49.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-25T02:20:49.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:20:49.971 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T02:20:50.275 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:20:50.275 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T02:20:50.411 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:20:50.412 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T02:20:50.491 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:20:50.491 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T02:20:50.556 INFO:tasks.ceph:Archiving mon data... 2024-04-25T02:20:50.557 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/data/mon.a.tgz 2024-04-25T02:20:50.557 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-04-25T02:20:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.sAP5TjYiXx 2024-04-25T02:20:50.575 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sAP5TjYiXx 2024-04-25T02:20:50.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.sAP5TjYiXx 2024-04-25T02:20:50.895 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.sAP5TjYiXx is 573KB 2024-04-25T02:20:50.993 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.sAP5TjYiXx 2024-04-25T02:20:51.010 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/data/mon.b.tgz 2024-04-25T02:20:51.010 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-04-25T02:20:51.067 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.zC1A42EFbd 2024-04-25T02:20:51.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.zC1A42EFbd 2024-04-25T02:20:51.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.zC1A42EFbd 2024-04-25T02:20:51.366 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.zC1A42EFbd is 574KB 2024-04-25T02:20:51.463 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.zC1A42EFbd 2024-04-25T02:20:51.480 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/data/mon.c.tgz 2024-04-25T02:20:51.481 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-04-25T02:20:51.538 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.bOZ70kMh1x 2024-04-25T02:20:51.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.bOZ70kMh1x 2024-04-25T02:20:51.752 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.bOZ70kMh1x 2024-04-25T02:20:51.839 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.bOZ70kMh1x is 574KB 2024-04-25T02:20:51.936 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.bOZ70kMh1x 2024-04-25T02:20:51.953 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T02:20:51.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:20:51.994 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:20:52.076 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:20:52.096 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:20:52.096 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T02:20:52.097 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/remote/smithi078/crash 2024-04-25T02:20:52.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:20:52.143 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/remote/smithi195/crash 2024-04-25T02:20:52.144 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:20:52.173 INFO:tasks.ceph:Compressing logs... 2024-04-25T02:20:52.174 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:20:52.188 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:20:52.241 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52672.log 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54894.log 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53064.log 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54894.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52672.log.gz 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55797.log 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54894.log.gz 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55091.log 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55797.log: gzip 87.7%-5 --verbose -- /var/log/ceph/ceph-client.admin.57126.log -- replaced with /var/log/ceph/ceph-client.admin.53064.log.gz 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55797.log.gz 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57077.log 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55091.log.gz 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51089.log 2024-04-25T02:20:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57077.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.57126.log.gz 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57477.log 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52555.log 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57077.log.gz 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51089.log.gz 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57830.log 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52555.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57477.log.gz 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50990.log 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52555.log.gz 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55503.log 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57830.log.gz 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56538.log 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50990.log: /var/log/ceph/ceph-client.admin.55503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53464.log 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50990.log.gz 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52554.log 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55503.log.gz 2024-04-25T02:20:52.243 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56538.log.gz 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57175.log 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53464.log.gz 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:gzip /var/log/ceph/ceph-client.admin.52554.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52819.log 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55552.log 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52554.log.gz 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54893.log 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57175.log.gz 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52819.log.gz 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57371.log 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0%/var/log/ceph/ceph-client.admin.54893.log: -- replaced with /var/log/ceph/ceph-client.admin.55552.log.gz 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56832.log 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54893.log.gz 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51188.log 2024-04-25T02:20:52.244 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57371.log.gz 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54692.log 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51188.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56832.log.gz 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51888.log 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8%/var/log/ceph/ceph-client.admin.54692.log: -- replaced with /var/log/ceph/ceph-client.admin.51188.log.gz 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54327.log 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54692.log.gz 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56734.log 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54327.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51888.log.gz 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56636.log 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54327.log.gz 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57879.log 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56734.log.gz 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51986.log 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47213.log 2024-04-25T02:20:52.245 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56636.log.gz 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57879.log.gz 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51986.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47213.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.51986.log.gz-5 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:--verbose -- /var/log/ceph/ceph-client.admin.51937.log 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.2.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47213.log.gz 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57636.log 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55405.log 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0%/var/log/ceph/ceph-client.admin.57636.log: -- replaced with /var/log/ceph/ceph-client.admin.51937.log.gz 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51396.log 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57636.log.gz 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52162.log 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55405.log: /var/log/ceph/ceph-client.admin.51396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55013.log 2024-04-25T02:20:52.246 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55405.log.gz 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52162.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51396.log.gz 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52721.log 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55013.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52162.log.gz 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52502.log 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52721.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55013.log.gz 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52358.log 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52502.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52721.log.gz 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54278.log 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52502.log.gz 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54503.log 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52358.log.gz 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53407.log 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54503.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54278.log.gz 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51496.log 2024-04-25T02:20:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53407.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54503.log.gz 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56489.log 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53407.log.gz 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55895.log 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51496.log.gz 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56489.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56489.log.gz 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54698.log 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55895.log.gz 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56930.log 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47105.log 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56930.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54698.log.gz 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57732.log 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56930.log.gz 2024-04-25T02:20:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53211.log 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47105.log.gz 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51545.log 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr: 95.1% 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57732.log.gz 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57322.log 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53211.log: /var/log/ceph/ceph-client.admin.51545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54895.log 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53211.log.gz 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57322.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51545.log.gz 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57526.log 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57322.log.gz 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57028.log 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54895.log: /var/log/ceph/ceph-client.admin.57526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52160.log 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54895.log.gz 2024-04-25T02:20:52.249 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57526.log.gz 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56293.log 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54025.log 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52160.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57028.log.gz 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56293.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52160.log.gz 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54025.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56293.log.gz 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51790.log 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51692.log 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54025.log.gz 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55699.log 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51692.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51790.log.gz 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57995.log 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55699.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51692.log.gz 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56342.log 2024-04-25T02:20:52.250 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55699.log.gz 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54123.log 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57928.log 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57995.log.gz 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56342.log: /var/log/ceph/ceph-client.admin.54123.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56342.log.gz 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54123.log.gz 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52035.log 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56587.log 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57928.log.gz 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50941.log 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56587.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52035.log.gz 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56587.log.gz 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50941.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50941.log.gz 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57273.log 2024-04-25T02:20:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54500.log 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55454.log 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54500.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57273.log.gz 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54500.log.gz 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55454.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55454.log.gz 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55748.log 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55846.log 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52770.log 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55846.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55748.log.gz 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51741.log 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55846.log.gz 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52770.log: /var/log/ceph/ceph-client.admin.51741.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52770.log.gz 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51741.log.gz 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54172.log 2024-04-25T02:20:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50892.log 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53878.log 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54172.log.gz 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52357.log 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53878.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50892.log.gz 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54501.log 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53878.log.gz 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51139.log 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54501.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52357.log.gz 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51139.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54501.log.gz 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51347.log 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51139.log.gz 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57685.log 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46849.log 2024-04-25T02:20:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51347.log: /var/log/ceph/ceph-client.admin.57685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54699.log 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51347.log.gz 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57685.log.gz 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55209.log 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52966.log 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46849.log.gz/var/log/ceph/ceph-client.admin.54699.log: 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55209.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54699.log.gz 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52966.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55209.log.gz 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52966.log.gz 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46952.log 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57577.log 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46504.log 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46952.log.gz 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57577.log: /var/log/ceph/ceph-client.admin.46504.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57577.log.gz 2024-04-25T02:20:52.254 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.46504.log.gz 2024-04-25T02:20:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53162.log 2024-04-25T02:20:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54376.log 2024-04-25T02:20:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55601.log 2024-04-25T02:20:52.255 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53162.log.gz 2024-04-25T02:20:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51239.log 2024-04-25T02:20:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55601.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54376.log.gzgzip 2024-04-25T02:20:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:-5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T02:20:52.255 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55601.log.gz 2024-04-25T02:20:52.256 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42281.log 2024-04-25T02:20:52.257 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40648.log 2024-04-25T02:20:52.257 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.0.42281.log: /var/log/ceph/ceph-client.0.40648.log: 88.6% -- replaced with /var/log/ceph/ceph-client.0.40648.log.gz 2024-04-25T02:20:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55356.log 2024-04-25T02:20:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52917.log 2024-04-25T02:20:52.260 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51239.log.gz 2024-04-25T02:20:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55356.log: /var/log/ceph/ceph-client.admin.52917.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55356.log.gz 2024-04-25T02:20:52.260 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52917.log.gz 2024-04-25T02:20:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55039.log 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56881.log 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53927.log 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56881.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55039.log.gz 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53927.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56881.log.gz 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53927.log.gz 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.40228.log 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53829.log 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.40228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46897.log 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.40228.log.gz 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53829.log: /var/log/ceph/ceph-client.admin.46897.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53829.log.gz 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46897.log.gz 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56685.log 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53976.log 2024-04-25T02:20:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53113.log 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6%/var/log/ceph/ceph-client.admin.53976.log: -- replaced with /var/log/ceph/ceph-client.admin.56685.log.gz 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53113.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53976.log.gz 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53113.log.gz 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51290.log 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55944.log 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51290.log: /var/log/ceph/ceph-client.admin.55944.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51290.log.gz 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55944.log.gz 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55258.log 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56440.log 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55258.log: /var/log/ceph/ceph-client.admin.56440.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55258.log.gz 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56440.log.gz 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T02:20:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50582.log 2024-04-25T02:20:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50582.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50582.log.gz 2024-04-25T02:20:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56391.log 2024-04-25T02:20:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56391.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56391.log.gz 2024-04-25T02:20:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50700.log 2024-04-25T02:20:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50700.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50700.log.gz 2024-04-25T02:20:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54697.log 2024-04-25T02:20:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54697.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54697.log.gz 2024-04-25T02:20:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T02:20:52.269 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54074.log 2024-04-25T02:20:52.285 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54074.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54074.log.gz 2024-04-25T02:20:52.296 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56042.log 2024-04-25T02:20:52.307 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56042.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56042.log.gz 2024-04-25T02:20:52.318 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55307.log 2024-04-25T02:20:52.323 INFO:teuthology.orchestra.run.smithi078.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T02:20:52.324 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55307.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55307.log.gz 2024-04-25T02:20:52.324 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T02:20:52.342 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: 95.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T02:20:52.342 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57781.log 2024-04-25T02:20:52.343 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57781.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57781.log.gz 2024-04-25T02:20:52.343 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52868.log 2024-04-25T02:20:52.345 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52868.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52868.log.gz 2024-04-25T02:20:52.345 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53633.log 2024-04-25T02:20:52.346 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53633.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53633.log.gz 2024-04-25T02:20:52.346 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53260.log 2024-04-25T02:20:52.347 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53260.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53260.log.gz 2024-04-25T02:20:52.347 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51839.log 2024-04-25T02:20:52.348 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51839.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51839.log.gz 2024-04-25T02:20:52.348 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53309.log 2024-04-25T02:20:52.349 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53309.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53309.log.gz 2024-04-25T02:20:52.350 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52301.log 2024-04-25T02:20:52.351 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52301.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52301.log.gz 2024-04-25T02:20:52.351 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52476.log 2024-04-25T02:20:52.352 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52476.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52476.log.gz 2024-04-25T02:20:52.352 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55993.log 2024-04-25T02:20:52.353 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55993.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55993.log.gz 2024-04-25T02:20:52.353 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53513.log 2024-04-25T02:20:52.355 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53513.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53513.log.gz 2024-04-25T02:20:52.355 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50774.log 2024-04-25T02:20:52.356 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50774.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50774.log.gz 2024-04-25T02:20:52.356 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57224.log 2024-04-25T02:20:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57224.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.57224.log.gz 2024-04-25T02:20:52.357 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57420.log 2024-04-25T02:20:52.358 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57420.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57420.log.gz 2024-04-25T02:20:52.358 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52306.log 2024-04-25T02:20:52.359 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52306.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52306.log.gz 2024-04-25T02:20:52.360 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51039.log 2024-04-25T02:20:52.361 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51039.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51039.log.gz 2024-04-25T02:20:52.361 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53015.log 2024-04-25T02:20:52.362 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53015.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53015.log.gz 2024-04-25T02:20:52.362 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52161.log 2024-04-25T02:20:52.363 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52161.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52161.log.gz 2024-04-25T02:20:52.363 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56783.log 2024-04-25T02:20:52.364 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56783.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56783.log.gz 2024-04-25T02:20:52.364 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50843.log 2024-04-25T02:20:52.366 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50843.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50843.log.gz 2024-04-25T02:20:52.366 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53731.log 2024-04-25T02:20:52.367 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53731.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53731.log.gz 2024-04-25T02:20:52.367 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50651.log 2024-04-25T02:20:52.368 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50651.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50651.log.gz 2024-04-25T02:20:52.368 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54502.log 2024-04-25T02:20:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54502.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.54502.log.gz 2024-04-25T02:20:52.369 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56244.log 2024-04-25T02:20:52.370 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56244.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56244.log.gz 2024-04-25T02:20:52.370 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51594.log 2024-04-25T02:20:52.372 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51594.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51594.log.gz 2024-04-25T02:20:52.372 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55650.log 2024-04-25T02:20:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55650.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55650.log.gz 2024-04-25T02:20:52.373 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53358.log 2024-04-25T02:20:52.374 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53358.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53358.log.gz 2024-04-25T02:20:52.374 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56979.log 2024-04-25T02:20:52.375 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56979.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56979.log.gz 2024-04-25T02:20:52.376 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51445.log 2024-04-25T02:20:52.377 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51445.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51445.log.gz 2024-04-25T02:20:52.377 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58094.log 2024-04-25T02:20:52.378 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58094.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58094.log.gz 2024-04-25T02:20:52.378 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58045.log 2024-04-25T02:20:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58045.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58045.log.gz 2024-04-25T02:20:52.379 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46800.log 2024-04-25T02:20:52.380 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46800.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46800.log.gz 2024-04-25T02:20:52.380 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53682.log 2024-04-25T02:20:52.381 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53682.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53682.log.gz 2024-04-25T02:20:52.382 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T02:20:52.390 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54817.log 2024-04-25T02:20:52.410 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54817.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54817.log.gz 2024-04-25T02:20:52.410 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56115.log 2024-04-25T02:20:52.413 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56115.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56115.log.gz 2024-04-25T02:20:52.413 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54221.log 2024-04-25T02:20:52.424 INFO:teuthology.orchestra.run.smithi078.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T02:20:52.427 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54221.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54221.log.gz 2024-04-25T02:20:52.427 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53780.log 2024-04-25T02:20:52.427 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53780.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53780.log.gz 2024-04-25T02:20:52.427 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55092.log 2024-04-25T02:20:52.427 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55092.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55092.log.gz 2024-04-25T02:20:52.427 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52159.log 2024-04-25T02:20:52.430 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52159.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52159.log.gz 2024-04-25T02:20:52.430 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53584.log 2024-04-25T02:20:52.431 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53584.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53584.log.gz 2024-04-25T02:20:52.431 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51643.log 2024-04-25T02:20:52.432 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51643.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51643.log.gz 2024-04-25T02:20:52.448 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T02:20:52.602 INFO:teuthology.orchestra.run.smithi078.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T02:20:53.984 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T02:20:54.215 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T02:20:54.380 INFO:teuthology.orchestra.run.smithi078.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T02:20:54.949 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T02:21:53.468 INFO:teuthology.orchestra.run.smithi078.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T02:21:53.469 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-04-25T02:21:53.469 INFO:teuthology.orchestra.run.smithi078.stderr:real 1m1.267s 2024-04-25T02:21:53.470 INFO:teuthology.orchestra.run.smithi078.stderr:user 1m7.931s 2024-04-25T02:21:53.470 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m2.471s 2024-04-25T02:23:04.484 INFO:teuthology.orchestra.run.smithi195.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.42281.log.gz 2024-04-25T02:23:04.486 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-04-25T02:23:04.486 INFO:teuthology.orchestra.run.smithi195.stderr:real 2m12.251s 2024-04-25T02:23:04.486 INFO:teuthology.orchestra.run.smithi195.stderr:user 2m7.960s 2024-04-25T02:23:04.486 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m4.104s 2024-04-25T02:23:04.487 INFO:tasks.ceph:Archiving logs... 2024-04-25T02:23:04.487 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/remote/smithi078/log 2024-04-25T02:23:04.488 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:23:14.812 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/remote/smithi195/log 2024-04-25T02:23:14.813 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:23:39.479 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T02:23:39.673 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T02:23:39.673 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:23:39.676 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:23:39.769 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T02:23:40.560 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T02:23:40.561 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:23:40.564 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:23:40.582 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2024-04-25T02:23:40.585 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2024-04-25T02:23:40.588 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:23:40.588 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-04-25T02:23:40.588 INFO:teuthology.orchestra.run.smithi078.stdout:^- hv01.front.sepia.ceph.com 2 6 377 3 +1784us[+1784us] +/- 573ms 2024-04-25T02:23:40.588 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -277us[ -251us] +/- 54ms 2024-04-25T02:23:40.588 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +344us[ +344us] +/- 62ms 2024-04-25T02:23:40.588 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:23:40.591 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:23:40.591 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-25T02:23:40.591 INFO:teuthology.orchestra.run.smithi195.stdout:^- hv01.front.sepia.ceph.com 2 6 377 5 +1807us[+1844us] +/- 573ms 2024-04-25T02:23:40.591 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv02.front.sepia.ceph.com 3 6 377 5 -251us[ -214us] +/- 54ms 2024-04-25T02:23:40.591 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +372us[ +372us] +/- 62ms 2024-04-25T02:23:40.591 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:23:40.592 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T02:23:41.574 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T02:23:41.574 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T02:23:42.198 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:23:42.273 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:23:42.342 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:23:42.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:23:42.379 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:23:42.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:23:42.411 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T02:23:42.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T02:23:42.528 INFO:teuthology.task.internal:Duration was 1339.552815 seconds 2024-04-25T02:23:42.529 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T02:23:42.578 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T02:23:42.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:23:42.581 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:23:42.631 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:23:42.634 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:23:43.114 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T02:23:43.115 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-04-25T02:23:43.115 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:23:43.143 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T02:23:43.143 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:23:43.169 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T02:23:43.169 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:23:43.186 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:23:43.255 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T02:23:43.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:23:43.259 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:23:43.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T02:23:43.353 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T02:23:43.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:23:43.386 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:23:43.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T02:23:43.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:23:43.431 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:23:43.458 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-04-25T02:23:43.480 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-04-25T02:23:43.502 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:23:43.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:23:43.561 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:23:43.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:23:43.578 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T02:23:43.591 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T02:23:43.592 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/remote/smithi078 2024-04-25T02:23:43.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:23:43.641 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672371/remote/smithi195 2024-04-25T02:23:43.641 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:23:43.680 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T02:23:43.680 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:23:43.683 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:23:43.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T02:23:43.747 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T02:23:43.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T02:23:43.770 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T02:23:43.770 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:23:43.773 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:23:43.789 INFO:teuthology.orchestra.run.smithi078.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:23 /home/ubuntu/cephtest 2024-04-25T02:23:43.790 INFO:teuthology.orchestra.run.smithi195.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:23 /home/ubuntu/cephtest 2024-04-25T02:23:43.791 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T02:23:43.813 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T02:23:43.917 INFO:teuthology.run:Summary data: description: fs/upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/blogbench}} duration: 1339.5528151988983 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T02:23:43.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:23:43.994 INFO:teuthology.run:pass